GET
/v1/schemas/replicate/chat/models/ibm-granite/granite-4.1-8b/predictions
Accept:
| field | recorded source |
|---|---|
| schema | Source linked above. upstream-spec Source trace9be2bde0c5a6812dae3669ad9e4d4e612b68030dfa9909903b64aa903db29576{
"fetchedAt": 1791350061,
"extractorVersion": "1",
"verifiedAt": null
} |
Request body
4 properties · 1 required · 1 $defs| property | type | description | constraints |
|---|---|---|---|
| input* | Input | ||
| stream | boolean | **This field is deprecated.** | |
| webhook | string | An HTTPS URL for receiving a webhook when the prediction has new output. The webhook will be a POST request where the request body is the same as the response body of the [get prediction](#predictions.get) operation. If there are network problems, we will retr… | |
| webhook_events_filter | enum[] | By default, we will send requests to your webhook URL whenever there are new outputs or the prediction has finished. You can change which events trigger webhook requests by specifying `webhook_events_filter` in the prediction request: |
Types
1 $defsInputobject
| seed | integer | Random seed. Leave unspecified to randomize the seed. | |
| stop | string[] | A list of sequences to stop generation at. For example, ["<end>","<stop>"] will stop generation at the first instance of "<end>" or "<stop>". | |
| tools | object[] | Tools for request. Passed to the chat template. | |
| top_k | integer | The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering). | |
| top_p | number | A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751). | |
| prompt | string | Completion API user prompt. | |
| stream | boolean | Request streaming response. | |
| messages | object[] | Chat completion API messages. | |
| documents | object[] | Documents for request. Passed to the chat template. | |
| max_tokens | integer | max_tokens is deprecated in favor of the max_completion_tokens field. | deprecated |
| min_tokens | integer | The minimum number of tokens the model should generate as output. | default: 0 |
| temperature | number | The value used to modulate the next token probabilities. | |
| tool_choice | string | Tool choice for request. If the choice is a specific function, this should be specified as a JSON string. | |
| chat_template | string | A template to format the prompt with. If not specified, the chat template provided by the model will be used. | |
| system_prompt | string | Completion API system prompt. The chat template provides a good default. | |
| response_format | object | An object specifying the format that the model must output. | |
| presence_penalty | number | Presence penalty | |
| frequency_penalty | number | Frequency penalty | |
| repetition_penalty | number | Repetition penalty | |
| chat_template_kwargs | object | Additional arguments to be passed to the chat template. | |
| add_generation_prompt | boolean | Add generation prompt. Passed to the chat template. Defaults to True. | default: true |
| max_completion_tokens | integer | An upper bound for the number of tokens that can be generated for a completion, including visible output tokens and reasoning tokens. |
Validate a payload
before you spend tokensshell
$ curl -X POST https://modelschemas.com/v1/validate \
-d '{"provider":"replicate","endpointId":"models/ibm-granite/granite-4.1-8b/predictions","payload":{…}}'
→ {"valid": false, "errors": [{"path": "#", "keyword": "required", …}]}