Quantumbraid commited on
Commit
cd95e4d
·
verified ·
1 Parent(s): 4188c7d

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +92 -0
  2. lora_weights_step_02000.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-2
4
+ - ltx-video
5
+ - text-to-video
6
+ - audio-video
7
+ pinned: true
8
+ language:
9
+ - en
10
+ license: other
11
+ pipeline_tag: text-to-video
12
+ library_name: diffusers
13
+ ---
14
+
15
+ # ltx2-lora2
16
+
17
+ Trained with the [LTX LoRA Trainer](https://huggingface.co/spaces/ltx-community/ltx2-lora-trainer) — powered by [LTX-2](https://github.com/Lightricks/LTX-2).
18
+
19
+ This is a **Text-to-Video LoRA** fine-tuned from [`ltx-2.3-22b-dev.safetensors`](https://huggingface.co/Lightricks/LTX-2.3) on custom data.
20
+
21
+ ## Model Details
22
+
23
+ - **Base Model:** [`ltx-2.3-22b-dev.safetensors`](https://huggingface.co/Lightricks/LTX-2.3)
24
+ - **LoRA type:** Text-to-Video LoRA
25
+ - **Training Type:** LoRA fine-tuning
26
+ - **Training Steps:** 2000
27
+ - **Learning Rate:** 0.0001
28
+ - **Batch Size:** 1
29
+
30
+ ## Sample Outputs
31
+
32
+ | | | | |
33
+ |:---:|:---:|:---:|:---:|
34
+
35
+
36
+ ## Usage
37
+
38
+ ### 🧨 Diffusers
39
+
40
+ > LTX-2.3 support is currently on the diffusers `main` branch:
41
+ > `pip install git+https://github.com/huggingface/diffusers.git`
42
+
43
+ ```python
44
+ import torch
45
+ from diffusers import LTX2Pipeline
46
+ from diffusers.pipelines.ltx2.export_utils import encode_video
47
+ from diffusers.pipelines.ltx2.utils import DEFAULT_NEGATIVE_PROMPT
48
+
49
+ pipe = LTX2Pipeline.from_pretrained(
50
+ "diffusers/LTX-2.3-Diffusers", torch_dtype=torch.bfloat16
51
+ )
52
+ pipe.enable_model_cpu_offload()
53
+
54
+ # Load this LoRA
55
+ pipe.load_lora_weights("Quantumbraid/ltx2-lora2", weight_name="lora_weights_step_02000.safetensors", adapter_name="lora")
56
+ pipe.set_adapters("lora", 1.0)
57
+
58
+ video, audio = pipe(
59
+ prompt="<your prompt>",
60
+ negative_prompt=DEFAULT_NEGATIVE_PROMPT,
61
+ width=768, height=512, num_frames=49, frame_rate=25.0,
62
+ num_inference_steps=30, guidance_scale=4.0,
63
+ output_type="np", return_dict=False,
64
+ )
65
+ encode_video(video[0], fps=25.0, output_path="output.mp4")
66
+ ```
67
+
68
+ For the full reference implementation and ComfyUI workflows, see the [official LTX-2 repository](https://github.com/Lightricks/LTX-2).
69
+
70
+ ### 🔌 Using Trained LoRAs in ComfyUI
71
+
72
+ In order to use the trained LoRA in ComfyUI, follow these steps:
73
+
74
+ 1. Copy your trained LoRA checkpoint (`.safetensors` file) to the `models/loras` folder in your ComfyUI installation.
75
+ 2. In your ComfyUI workflow:
76
+ - Add the "Load LoRA" node to choose your LoRA file
77
+ - Connect it to the "Load Checkpoint" node to apply the LoRA to the base model
78
+
79
+ You can find reference Text-to-Video (T2V) and Image-to-Video (I2V) workflows in the
80
+ official [LTX-2 repository](https://github.com/Lightricks/LTX-2).
81
+
82
+ ### Example Prompts
83
+
84
+
85
+
86
+
87
+ This model inherits the license of the base model ([`ltx-2.3-22b-dev.safetensors`](https://huggingface.co/Lightricks/LTX-2.3)).
88
+
89
+ ## Acknowledgments
90
+
91
+ - Base model: [Lightricks](https://huggingface.co/Lightricks/LTX-2)
92
+ - Trainer: [LTX-2](https://github.com/Lightricks/LTX-2)
lora_weights_step_02000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8a774a82cd15b03c6344d8fc5a62e7f06d83238a077aaab6dfb7fbdbc3ce233
3
+ size 428150680