Instructions to use zac/testing-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use zac/testing-lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Qwen/Qwen-Image", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("zac/testing-lora") prompt = "John" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
| tags: | |
| - image-to-video | |
| - lora | |
| - diffusers | |
| - template:sd-lora | |
| - ai-toolkit | |
| base_model: Qwen/Qwen-Image | |
| license: creativeml-openrail-m | |
| inference: | |
| parameters: | |
| width: 1024 | |
| height: 1024 | |
| instance_prompt: John | |
| # testing-lora | |
| Model trained with [AI Toolkit by Ostris](https://github.com/ostris/ai-toolkit) | |
| ## Trigger words | |
| You should use `John` to trigger the image generation. | |
| ## Download model and use it with ComfyUI, AUTOMATIC1111, SD.Next, Invoke AI, etc. | |
| Weights for this model are available in Safetensors format. | |
| [Download](zac/testing-lora/tree/main) them in the Files & versions tab. | |
| ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers) | |
| ```py | |
| from diffusers import AutoPipelineForText2Image | |
| import torch | |
| pipeline = AutoPipelineForText2Image.from_pretrained('Qwen/Qwen-Image', torch_dtype=torch.bfloat16).to('cuda') | |
| pipeline.load_lora_weights('zac/testing-lora', weight_name='testing_000001250.safetensors') | |
| image = pipeline('John').images[0] | |
| image.save("my_image.png") | |
| ``` | |
| For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters) | |