max_tokens | integer | - | - | The maximum number of tokens the model can generate in the response. |
temperature | float | - | 1.0 | Controls the randomness of the output. Lower values produce more focused responses, higher values produce more creative outputs. Range in 0.0 - 2.0. |
top_p | float | - | 1.0 | Nucleus sampling parameter. The model considers tokens with top_p cumulative probability mass. Range in 0.0 - 1.0. |
stream | boolean | - | false | If true, returns a stream of server-sent events (SSE) as the response is generated. |
stop | string/array | - | - | Up to 4 sequences where the API will stop generating further tokens. |
n | integer | - | 1 | How many chat completion choices to generate for each input message. |
presence_penalty | float | - | 0 | Penalizes new tokens based on whether they appear in the text so far. Range in -2.0 - 2.0. |
frequency_penalty | float | - | 0 | Penalizes new tokens based on their existing frequency in the text so far. Range in -2.0 - 2.0. |