GET
/v1/schemas/nvidia/chat/meta/codellama-70b
Accept:
| field | recorded source |
|---|---|
| schema | Source linked above. upstream-spec Source trace39ece49bbb335c8727d614edbd0044eb53da02e4bee5f3df52e853e9db3b290e{
"fetchedAt": 1791535404,
"extractorVersion": "1",
"verifiedAt": null
} |
Request body
10 properties · 1 required · 0 $defs| property | type | description | constraints |
|---|---|---|---|
| messages* | string | object[] | A list of messages comprising the conversation so far. | |
| model | string | default: "meta/codellama-70b" | |
| max_tokens | integer | The maximum number of tokens to generate in any given call. Note that the model is not aware of this value, and generation will simply stop at the number of tokens specified. | n ≥ 1 · default: 1024 |
| stream | boolean | If set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events (SSE) as they become available (JSON responses are prefixed by `data: `), with the stream terminated by a `data: [DONE]` message. | default: false |
| temperature | number | The sampling temperature to use for text generation. The higher the temperature value is, the less deterministic the output text will be. It is not recommended to modify both temperature and top_p in the same call. | 0 ≤ n ≤ 1 · default: 0.1 |
| top_p | number | The top-p sampling mass used for text generation. The top-p value determines the probability mass that is sampled at sampling time. For example, if top_p = 0.2, only the most likely tokens (summing to 0.2 cumulative probability) will be sampled. It is not reco… | 0 ≤ n ≤ 1 · default: 1 |
| stop | string[] | string | A string or a list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence. | nullable |
| frequency_penalty | number | Indicates how much to penalize new tokens based on their existing frequency in the text so far, decreasing model likelihood to repeat the same line verbatim. | -2 ≤ n ≤ 2 · default: 0 |
| presence_penalty | number | Positive values penalize new tokens based on whether they appear in the text so far, increasing model likelihood to talk about new topics. | -2 ≤ n ≤ 2 · default: 0 |
| seed | integer | The model generates random results. Changing the input seed alone will produce a different response with similar characteristics. It is possible to reproduce results by fixing the input seed (assuming all other hyperparameters are also fixed). | default: 0 |
Validate a payload
before you spend tokensshell
$ curl -X POST https://modelschemas.com/v1/validate \
-d '{"provider":"nvidia","endpointId":"meta/codellama-70b","payload":{…}}'
→ {"valid": false, "errors": [{"path": "#", "keyword": "required", …}]}