Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Lightricks
/
LTX-2.3-22b-LoRA-Foley-V2A

Text-to-Audio
Diffusion Single File
LTX-2
English
lora
ltx-2.3
foley
video-to-audio
audio
Model card Files Files and versions
xet
Community
5

Instructions to use Lightricks/LTX-2.3-22b-LoRA-Foley-V2A with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Diffusion Single File

    How to use Lightricks/LTX-2.3-22b-LoRA-Foley-V2A with Diffusion Single File:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • LTX-2

    How to use Lightricks/LTX-2.3-22b-LoRA-Foley-V2A with LTX-2:

    # Install the LTX-2 pipelines
    git clone https://github.com/Lightricks/LTX-2.git
    cd LTX-2
    uv sync --frozen
    # Download the weights from this repo, plus the Gemma text encoder
    hf download Lightricks/LTX-2.3-22b-LoRA-Foley-V2A --local-dir models/LTX-2.3-22b-LoRA-Foley-V2A
    hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
    # Text/image-to-video with the LoRA on the HQ two-stage base pipeline
    uv run python -m ltx_pipelines.ti2vid_two_stages_hq \
        --checkpoint-path path/to/checkpoint.safetensors \
        --distilled-lora path/to/distilled_lora.safetensors 0.8 \
        --spatial-upsampler-path path/to/spatial_upsampler.safetensors \
        --gemma-root models/gemma-3-12b \
        --lora models/LTX-2.3-22b-LoRA-Foley-V2A/<weights>.safetensors 1.0 \
        --prompt "your prompt here" \
        --output-path output.mp4
    # For image-to-video, add: --image path/to/image.jpg 0 0.8
  • Notebooks
  • Google Colab
  • Kaggle
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Commercial use of generated Foley outputs under the LTX-2.3 Community License

#5 opened 7 days ago by
Carabin

custom Node problems

#4 opened about 2 months ago by
Mntzr

Does this only work with dev model?

#3 opened 4 months ago by
darklight00

Demo for this model on Spaces

❤️ 1
#2 opened 4 months ago by
multimodalart

8 step distill support

#1 opened 4 months ago by
ZKong
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs