GET
/v1/schemas/fal/video/fal-ai/ltx-2.3-22b/audio-to-video/lora
Accept:
| field | recorded source |
|---|---|
| schema | Source linked above.Source tracec0ac5878a3c0fb87e14a5ba92eb7c84ae78d5ba6c2406def8983ef200f8e957b{
"fetchedAt": 1783331098,
"extractorVersion": "1",
"verifiedAt": null
} |
Request body
39 properties · 3 required · 2 $defs| property | type | description | constraints |
|---|---|---|---|
| prompt* | string | The prompt to generate the video from. | |
| loras* | LoRAInput[] | The LoRAs to use for the generation. | |
| audio_url* | string | The URL of the audio to generate the video from. | |
| image_url | string | Optional URL of an image to use as the first frame of the video. | nullable |
| audio_strength | number | Audio conditioning strength. Values below 1.0 will allow the model to change the audio, while a value of exactly 1.0 will use the input audio without modification. | 0 ≤ n ≤ 1 · default: 1 |
| use_multiscale | boolean | Whether to use multi-scale generation. If True, the model will generate the video at a smaller scale first, then use the smaller video to guide the generation of a video at or above your requested size. This results in better coherence and details. | default: true |
| enable_prompt_expansion | boolean | Whether to enable prompt expansion. | default: true |
| seed | integer | The seed for the random number generator. | nullable |
| audio_modality_scale | number | The modality scale for the audio. Controls the ratio between video and audio modalities. | 0 ≤ n ≤ 10 · default: 3 |
| video_cfg_scale | number | The Classifier-Free Guidance (CFG) scale for the video. Higher values result in more consistent and focused video content. | 1 ≤ n ≤ 20 · default: 3 |
| enable_safety_checker | boolean | Whether to enable the safety checker. | default: true |
| match_audio_length | boolean | When enabled, the number of frames will be calculated based on the audio duration and FPS. When disabled, use the specified num_frames. | default: true |
| acceleration | enum | The acceleration level to use. | none | regular | high | full · default: "regular" |
| video_modality_scale | number | The modality scale for the video. Controls the ratio between video and audio modalities. | 0 ≤ n ≤ 10 · default: 3 |
| preprocess_audio | boolean | Whether to preprocess the audio before using it as conditioning. | default: true |
| video_rescaling_scale | number | The rescaling scale for the video. Controls the ratio between classifier-free guidance and spatiotemporal guidance. | 0 ≤ n ≤ 1 · default: 0.7 |
| use_restart_sampling | boolean | Whether to use restart sampling. This will inject a small amount of noise during each denoising step, which can help improve the quality of the generated video. | default: false |
| image_strength | number | The strength of the image to use for the video generation. | 0 ≤ n ≤ 1 · default: 1 |
| num_frames | integer | The number of frames to generate. | 9 ≤ n ≤ 481 · default: 121 |
| num_inference_steps | integer | The number of inference steps to use. | 8 ≤ n ≤ 50 · default: 40 |
| fps | number | The frames per second of the generated video. | 1 ≤ n ≤ 60 · default: 24 |
| distill_lora_second_pass_scale | number | The scale of the distill LoRA to use for the second and subsequent passes. | 0 ≤ n ≤ 1 · default: 0.5 |
| scheduler | enum | The scheduler to use. | ltx2 | linear_quadratic | beta · default: "ltx2" |
| end_image_strength | number | The strength of the end image to use for the video generation. | 0 ≤ n ≤ 1 · default: 1 |
| video_stg_scale | number | The Spatiotemporal Guidance (STG) scale for the video. Higher values result in more consistent and focused video content. | 0 ≤ n ≤ 20 · default: 0 |
| negative_prompt | string | The negative prompt to generate the video from. | default: "news broadcast, 3d animation, c… |
| audio_cfg_scale | number | The Classifier-Free Guidance (CFG) scale for the audio. Higher values result in more consistent and focused audio content. | 1 ≤ n ≤ 20 · default: 7 |
| audio_rescaling_scale | number | The rescaling scale for the audio. Controls the ratio between classifier-free guidance and spatiotemporal guidance. | 0 ≤ n ≤ 1 · default: 0.7 |
| video_output_type | enum | The output type of the generated video. | X264 (.mp4) | VP9 (.webm) | PRORES4444 (.mov) | GIF (.gif) · default: "X264 (.mp4)" |
| video_write_mode | enum | The write mode of the generated video. | fast | balanced | small · default: "balanced" |
| distill_lora_first_pass_scale | number | The scale of the distill LoRA to use for the first pass. Set to 0 to disable. | 0 ≤ n ≤ 1 · default: 0.2 |
| video_size | ImageSize | enum | The size of the generated video. Use 'auto' to match the input image dimensions if provided. | default: "landscape_16_9" |
| camera_lora | enum | The camera LoRA to use. This allows you to control the camera movement of the generated video more accurately than just prompting the model to move the camera. | dolly_in | dolly_out | dolly_left | dolly_right | jib_up | jib_down · +2 more · default: "none" |
| camera_lora_scale | number | The scale of the camera LoRA to use. This allows you to control the camera movement of the generated video more accurately than just prompting the model to move the camera. | 0 ≤ n ≤ 1 · default: 1 |
| audio_stg_scale | number | The Spatiotemporal Guidance (STG) scale for the audio. Higher values result in more consistent and focused audio content. | 0 ≤ n ≤ 20 · default: 0 |
| video_quality | enum | The quality of the generated video. | low | medium | high | maximum · default: "high" |
| end_image_url | string | The URL of the image to use as the end of the video. | nullable |
| sync_mode | boolean | If `True`, the media will be returned as a data URI and the output data won't be available in the request history. | default: false |
| gradient_estimation_gamma | number | The gamma of gradient estimation during denoising. Set to 0 to disable. | 0 ≤ n ≤ 10 · default: 2 |
Types
2 $defsImageSizeobject
| height | integer | The height of the generated image. | 0 < n ≤ 14142 · default: 512 |
| width | integer | The width of the generated image. | 0 < n ≤ 14142 · default: 512 |
LoRAInputobject
LoRA weight configuration.
| scale | number | Scale factor for LoRA application (0.0 to 4.0). | 0 ≤ n ≤ 4 · default: 1 |
| path* | string | URL, HuggingFace repo ID (owner/repo) to lora weights. | |
| weight_name | string | Name of the LoRA weight. Only used if `path` is a HuggingFace repository, and is only required when the repository contains multiple LoRA weights. | nullable |
Validate a payload
before you spend tokensshell
$ curl -X POST https://modelschemas.com/v1/validate \
-d '{"provider":"fal","endpointId":"fal-ai/ltx-2.3-22b/audio-to-video/lora","payload":{…}}'
→ {"valid": false, "errors": [{"path": "#", "keyword": "required", …}]}