Truncated answers when querying chatgpt with Matlab

Some users (like here for example: https://www.mathworks.com/matlabcentral/answers/1894530-connecting-to-chatgpt-using-api ) have pointed out that we can ask chatgpt to write Matlab code.

I was curious and I have been playing with the code below a bit but I seem to get truncated annswers

import matlab.net.*
import matlab.net.http.*

% Define the API endpoint Davinci
api_endpoint = "https://api.openai.com/v1/engines/text-davinci-003/completions";

% Define the API key from https://beta.openai.com/account/api-keys
api_key = "your_api_key";

prompt = "Matlab code to replace string in multiple text files";

parameters = struct('prompt', prompt, 'max_tokens', 100);

% Define the headers for the API request
headers = matlab.net.http.HeaderField('Content-Type', 'application/json');
headers(2) = matlab.net.http.HeaderField('Authorization', ['Bearer ' + api_key]);

% Define the request message
request = matlab.net.http.RequestMessage('post', headers, parameters);

% Send the request and store the response
response = send(request, URI(api_endpoint));

% Extract the response text
response_text = response.Body.Data;
response_text = response_text.choices(1).text;
disp(response_text)

Its not immediately clear if the problem lies with the code above or with chatgpt. Has anyone experienced truncated answers from chatgpt ?

Answer 1

[Hans Scharler]

The "max_tokens" parameter limits the response from OpenAI language models.

Try increasing it to 1000.

parameters = struct('prompt', prompt, 'max_tokens', 1000);

Answer 2

[the cyclist]

My impression from searching the same topic is that there is an unpublished token limit (which will roughly translate to a character limit) for both input and output to ChatGPT. (This is not MATLAB specific.)

[012786534]

Perhaps but I have read that chatgpt has a character limit of 2048 characters per response, which is far more than I get when querying with Matlab. In the example above, I get a complete answer when I ask the same question directly on Introducing ChatGPT (openai.com).

[the cyclist]

Looking at your code a bit more closely ...

Did you realize that this line

parameters = struct('prompt', prompt, 'max_tokens', 100);

is setting the maximum token value that your code is asking for? Set that higher.