Instructions to use PrunaAI/Pruna-Q-Image-2.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use PrunaAI/Pruna-Q-Image-2.1 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Qwen/Qwen-Image-2.1", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("PrunaAI/Pruna-Q-Image-2.1") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,19 +15,32 @@ tags:
|
|
| 15 |
---
|
| 16 |
<!-- header start -->
|
| 17 |
<!-- 200823 -->
|
| 18 |
-
<
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
</a>
|
| 22 |
-
</div>
|
| 23 |
<!-- header end -->
|
| 24 |
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
<div align="center">
|
| 32 |
|
| 33 |
<h1 style="color: #9334E9;">⚡ Pruna-Qwen-Image-2.1</h1>
|
|
@@ -56,7 +69,6 @@ on DMD. Improved using Qwen.**
|
|
| 56 |
> visual quality of the base model. We are still improving the distillation and
|
| 57 |
> will update this repository as new versions become available.
|
| 58 |
|
| 59 |
-
|
| 60 |
## Variants
|
| 61 |
|
| 62 |
Both adapters are v0.1. Pick one based on whether you need **quality** or **speed**.
|
|
@@ -82,12 +94,33 @@ inference speed, not a guarantee of quality at that resolution.
|
|
| 82 |
|
| 83 |
## Benchmarking
|
| 84 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 85 |
Text-to-image with the official Qwen model-card example prompt, BF16, batch size 1,
|
| 86 |
on one NVIDIA H100 80GB. Median of 3 requests after one warmup per configuration.
|
| 87 |
Includes prompt encoding, denoising, and decoding; excludes PNG saving, model
|
| 88 |
-
loading, and warmup. Base: 40 steps with KV cache on; Pruna-Qwen-Image-2.1
|
| 89 |
KV cache off, as configured for this benchmark. The examples below enable KV caching for
|
| 90 |
-
Pruna-Qwen-Image-2.1
|
| 91 |
no CFG, compilation, or CPU offload. These timings do not imply equal image quality.
|
| 92 |
|
| 93 |
## Quickstart
|
|
@@ -164,7 +197,7 @@ image = pipe(
|
|
| 164 |
).images[0]
|
| 165 |
```
|
| 166 |
|
| 167 |
-
## Recommended settings
|
| 168 |
|
| 169 |
- **Use the sigma schedule that matches your adapter**, and keep the scheduler
|
| 170 |
at `shift=1.0` with dynamic shifting off so the sigmas are not shifted twice.
|
|
@@ -174,7 +207,7 @@ image = pipe(
|
|
| 174 |
- **No CFG.** Keep `true_cfg_scale=1.0` and do not pass a negative prompt.
|
| 175 |
- **Keep the LoRA strength at 1.0.**
|
| 176 |
- **Write detailed prompts for text-to-image.** Longer prompts that describe
|
| 177 |
-
the subject, setting, lighting and style work noticeably better than short
|
| 178 |
ones.
|
| 179 |
|
| 180 |
## Limitations
|
|
@@ -184,7 +217,7 @@ image = pipe(
|
|
| 184 |
visibly worse.
|
| 185 |
- Short or vague text-to-image prompts give weaker results.
|
| 186 |
- The adapters are only intended for the settings above. Other step counts,
|
| 187 |
-
schedules or CFG values are not supported.
|
| 188 |
|
| 189 |
## What this is not
|
| 190 |
|
|
@@ -203,7 +236,7 @@ Hangzhou Tongyi Laboratory Technology Co., Ltd. All Rights Reserved.
|
|
| 203 |
|
| 204 |
## What's next?
|
| 205 |
|
| 206 |
-
- **Use Pruna-Qwen-Image-2.1
|
| 207 |
- Compress your own models with [Pruna](https://github.com/PrunaAI/pruna) and give us a ⭐️ for more efficiency!
|
| 208 |
- Want to use our optimized image models right away? Check [P-Image-Ideogram](https://www.pruna.ai/p-image-ideogram) and [P-Image-Edit](https://www.pruna.ai/p-image-edit).
|
| 209 |
|
|
|
|
| 15 |
---
|
| 16 |
<!-- header start -->
|
| 17 |
<!-- 200823 -->
|
| 18 |
+
<p align="center">
|
| 19 |
+
<img src="assets/Pruna-Qwen-Image-2.1.png" width="800">
|
| 20 |
+
</p>
|
|
|
|
|
|
|
| 21 |
<!-- header end -->
|
| 22 |
|
| 23 |
+
<p align="center">
|
| 24 |
+
<a href="https://github.com/PrunaAI/pruna">
|
| 25 |
+
<img src="https://img.shields.io/badge/GitHub-PrunaAI-9334E9?style=plastic&logo=github&logoColor=white" alt="GitHub">
|
| 26 |
+
</a>
|
| 27 |
+
|
| 28 |
+
<a href="https://twitter.com/PrunaAI">
|
| 29 |
+
<img src="https://img.shields.io/badge/Twitter%2FX-@PrunaAI-9334E9?style=plastic&logo=x&logoColor=white" alt="Twitter/X">
|
| 30 |
+
</a>
|
| 31 |
+
|
| 32 |
+
<a href="https://www.linkedin.com/company/pruna-ai">
|
| 33 |
+
<img src="https://img.shields.io/badge/LinkedIn-PrunaAI-9334E9?style=plastic&logo=linkedin&logoColor=white" alt="LinkedIn">
|
| 34 |
+
</a>
|
| 35 |
+
|
| 36 |
+
<a href="https://discord.com/invite/JFQmtFKCjd">
|
| 37 |
+
<img src="https://img.shields.io/badge/Discord-Join%20us-9334E9?style=plastic&logo=discord&logoColor=white" alt="Discord">
|
| 38 |
+
</a>
|
| 39 |
+
|
| 40 |
+
<a href="https://dashboard.pruna.ai/login?utm_source=huggingface&utm_medium=org_card&utm_campaign=hf_traffic">
|
| 41 |
+
<img src="https://img.shields.io/badge/Performance%20Models-Try%20them%20now-9334E9?style=plastic&logo=data:image/svg%2bxml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI0MTEiIGhlaWdodD0iNDc3IiBmaWxsPSJub25lIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMjMuNzAzIDMwMC41MzJjLTEuODQyLS42NzQtNC4xNDItMS4wNTctNS43MDMtMi4wMjktMTIuNTU4LTcuODQ2LTguODM3LTI1LjE3MiA1LjI1NS0yOC4zNjFhLjY2LjY2IDAgMCAwIC4zNDgtLjIwMS42LjYgMCAwIDAgLjE1Ni0uMzZxNi40OS04MS45ODYgNjguNTc3LTEzNC42MjlhLjM0LjM0IDAgMCAwIC4wOTItLjEyNS4zMy4zMyAwIDAgMC0uMDI2LS4zLjMzLjMzIDAgMCAwLS4xMTItLjEwOGMtNC4xMTUtMi40OTctOC42NC00Ljc1LTEyLjM1My03LjQ0M2ExOTAgMTkwIDAgMCAxLTE4Ljc5NC0xNS41MjJjLTIuOTM2LTIuNzY4LTMuNzAzLTUuODkxLjU4LTcuNzdhLjUuNSAwIDAgMCAuMjgtLjYwOEM1MyA3NS45NSA0OC40MTcgNDguNTk5IDQ1LjUxOCAxOS42NXEtLjM5My0zLjg1Mi0uMjcxLTYuMzJhLjc1Ljc1IDAgMCAxIC4xMzQtLjQuNy43IDAgMCAxIC4zMjQtLjI1NXEyLjEwNC0uODQyIDUuODQ0LTEuNDMxYzU4LjExNC05LjEzNiAxMjcuMDA5IDguNDI1IDE0NC4zMDcgNzIuNjQ1cS4xMDMuMzY0LjE3OCAwIDUuMDk2LTI0LjA5NyA0LjYzOC00OC4xOTMtLjA0Ny0yLjc4NyAxLjg3OS00Ljc4OCAxMC40MDctMTAuOCAyNC43OTgtOC42ODdjNy40NzEgMS4wOTUgNy43NDIgNC42MzggNy4yMDkgMTEuMWEzMzQgMzM0IDAgMCAxLTExLjg4NCA2NC43MDYuMzg4LjM4OCAwIDAgMCAuMTgyLjQ0NC40LjQgMCAwIDAgLjE2NC4wNTFjOTIuNDIxIDguNDUzIDE1OC44NzUgNzkuNDg5IDE2NS4wODQgMTcxLjI3NGExIDEgMCAwIDAgLjEyOS40MjQuODMuODMgMCAwIDAgLjI5MS4yOTZjMy43NSAyLjE3IDYuMiAyLjIxNiA4Ljg1NSA2LjU5MiA1LjA2OCA4LjMzMiAxLjQ1IDIwLjQzMS04LjU5MyAyMi40N2ExLjcxIDEuNzEgMCAwIDAtMS4zNjUgMS40NjhxLTkuMTczIDc1LjM4My02NC43NjIgMTIzLjM3MWMtMjguNjIyIDI0LjcwNC02NS43NDQgMzkuNzQ5LTEwMy40NjQgNDIuMzMtMTAwLjM1OSA2Ljg2My0xODQuNDg2LTY1LjYyMi0xOTUuMDA1LTE2NS41N2EuOC44IDAgMCAwLS4xNTQtLjM5NS43NC43NCAwIDAgMC0uMzMzLS4yNU0xNTEuMzM4IDk3LjY0M2wxOS4wNjYgMTkuMzc1YS41LjUgMCAwIDAgLjE1LjEuNS41IDAgMCAwIC4xNzYuMDMxLjQzLjQzIDAgMCAwIC4zMTktLjE1cTEwLjg0Ny0xMi40NjUgNy40NDMtMjguMTU1Yy00LjUzNS0yMC44Ni0xOC41OTgtMzcuNjY0LTM3LjI3MS00OC4zODktMjEuMDY3LTEyLjY4OS00Ny44NjUtMTUuOTA1LTcyLjI4LTE0Ljg0cS0uNjE3LjAzLS4xNC40MjJsNjMuNDcyIDUzLjMyNmEuNC40IDAgMCAwIC4xNDQuMDcyLjM0LjM0IDAgMCAwIC4zMDEtLjA2OC4zLjMgMCAwIDAgLjA4OC0uMTI2IDQ3IDQ3IDAgMCAwIDMuMjgyLTEzLjA4MXEuMDIzLS4yMzMuMTI0LS40MzN0LjI2OC0uMzM0YzIuOTU1LTIuNDc4IDQuMTE1LjQ1OCA0LjY5NCAyLjg1MnEyLjMyIDkuNTM3LjE4NyAxOS4yNDRhMS40OCAxLjQ4IDAgMCAwIC40NCAxLjQwM3ptLTYuNTI2IDkuMjk1LTkuMDI0LTEwLjI3NmEuNy43IDAgMCAwLS4zNDMtLjIwNy44Ni44NiAwIDAgMC0uNDMzIDBxLTExLjY4IDMuMDIxLTIzLjExNC0uODIyYy01LjgxNi0zLjg1Mi0uNzU4LTUuNTE3IDIuNTktNS44MTZxNS45MTgtLjUzMyAxMS43MzUtMi41MDZhLjMuMyAwIDAgMCAuMTI3LS4wOC4zLjMgMCAwIDAgLjA3My0uMTMzLjM0LjM0IDAgMCAwIC4wMDEtLjE1NC4zNC4zNCAwIDAgMC0uMDctLjEzOGMtMTkuNDU5LTIxLjE1LTQwLjc2LTQwLjI0NS02Mi4yNzUtNTkuMjY0cS0uMzU2LS4zMTgtLjMxOC4xNWEzMDggMzA4IDAgMCAwIDguMzg3IDUxLjgwMmM0LjU5MiAxOC4zMDggMTMuNzU1IDM0LjE1NyAzMS44NDggNDEuODcycTI2LjI0NyAxMS4xODIgNTMuNzI5IDIuODMzYS41ODMuNTgzIDAgMCAwIC4yOTktLjg4OCAyMzUgMjM1IDAgMCAwLTEzLjIxMi0xNi4zNzNtNDUuMTI1IDQ5Ljc0NXEtMTIuNTk1IDEuMzE4LTIzLjQ0MS01LjU4M2MtMy4wNzctNC44OTkgMi4wNjYtOC41OTMgNS40NDItMTEuMTgzYS41ODQuNTg0IDAgMCAwIC4xODctLjcwMSA4LjQ2IDguNDYgMCAwIDAtMy40ODgtMy44NjIuODEuODEgMCAwIDAtLjgyMy4wMDljLTE2LjY5MSA5Ljk3Ny0zNC40ODUgMTAuNzgyLTUzLjE4NiA2Ljk2N3EtMS41Ny0uMzItMi44NTIuNjQ1LTYxLjQ1MSA0Ni4zNy02OS42NyAxMjMuOTEzLS42ODMgNi40MzMtMS44MDYgOC44MjdjLTIuOTQ1IDYuMzAyLTcuNzcgNy44NDUtMTQuMjIyIDkuNDcycS0uNDQ5LjExMyAwIC4yMzRjOS4yNzYgMi4zMSAxNC42OCA2LjE0MyAxNi4wNzQgMTYuNDAxIDguNDYyIDYyLjQ5IDQ4Ljk0IDExNy44NjQgMTEwLjM4MyAxMzguMzQxYTEwNCAxMDQgMCAwIDAgMTEuMDA2IDMuNTA3YzkyLjY0NSAyMy45MDkgMTgxLjIzMi0zMy42NjIgMjAyLjgwNC0xMjUuMDU0cTEuNjA5LTYuNzkgMy40NS0xOS4wODVjMS4xMDQtNy4zOTYgNS42OTUtMTIuMTE4IDEzLjE0Ny0xMy41NjguNDEyLS4wODQgMS45MDgtLjc1Ny4yODEtLjk5MS04LjA1MS0xLjE0MS0xMi4yNC02LjM4Ni0xMi45ODgtMTQuMTI4cS0xLjA3NS0xMS4yNS0yLjUxNi0xOS4wMzhjLTExLjc3Mi02My44OTItNTYuMzgzLTExNC41NzItMTE5LjI4NS0xMzEuNDZxLTE1LjEyLTMuODgtMzAuOTg3LTUuMjQ1YS4zODYuMzg2IDAgMCAwLS40MDIuMjUyIDE2OC42IDE2OC42IDAgMCAxLTExLjM1MiAyNC44NTRjLTQuMTMzIDcuNDA2LTguMTYzIDE1LjQ5NC0xNS43NTYgMTYuNDc2Ii8+PGNpcmNsZSBjeD0iMTQwLjA2NSIgY3k9IjI3My4wMyIgcj0iNTAuNjE4IiBzdHJva2U9IiNmZmYiIHN0cm9rZS13aWR0aD0iOS4yMDMiLz48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMTQ2Ljk2NyAyNDIuMDkyYzE1LjY3MiAwIDI4LjM3NiAxMy45NjMgMjguMzc2IDMxLjE4OHMtMTIuNzA0IDMxLjE4OS0yOC4zNzYgMzEuMTg5LTI4LjM3Ny0xMy45NjQtMjguMzc3LTMxLjE4OWMwLTIuNjI1LjI5Ny01LjE3NC44NTItNy42MSAxLjYwNyAzLjcyNyA1LjMxMyA2LjMzOCA5LjYyOSA2LjMzOCA1Ljc4OSAwIDEwLjQ4MS00LjY5MyAxMC40ODItMTAuNDgycy00LjY5My0xMC40ODEtMTAuNDgyLTEwLjQ4MWMtLjc2MSAwLTEuNTA0LjA4My0yLjIxOS4yMzcgNS4xMzktNS42NzYgMTIuMjUzLTkuMTkgMjAuMTE1LTkuMTkiLz48Y2lyY2xlIGN4PSIyNjkuOTMyIiBjeT0iMjczLjAzIiByPSI1MC42MTgiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSI5LjIwMyIvPjxwYXRoIGZpbGw9IiNmZmYiIGQ9Ik0yNzYuODM0IDI0Mi4wOTJjMTUuNjcyIDAgMjguMzc2IDEzLjk2MyAyOC4zNzYgMzEuMTg4cy0xMi43MDQgMzEuMTg5LTI4LjM3NiAzMS4xODktMjguMzc3LTEzLjk2NC0yOC4zNzctMzEuMTg5YzAtMi42MjUuMjk3LTUuMTc0Ljg1My03LjYxIDEuNjA2IDMuNzI3IDUuMzEyIDYuMzM4IDkuNjI4IDYuMzM4IDUuNzg5IDAgMTAuNDgyLTQuNjkzIDEwLjQ4Mi0xMC40ODJzLTQuNjkzLTEwLjQ4MS0xMC40ODItMTAuNDgxYy0uNzYxIDAtMS41MDQuMDgzLTIuMjE5LjIzNyA1LjEzOS01LjY3NiAxMi4yNTQtOS4xOSAyMC4xMTUtOS4xOSIvPjxwYXRoIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSI5LjIwMyIgZD0iTTE3Ny4xMzUgMzQ1LjMyOGMuODk5LS4yNCAyLjgwMS0uMTk3IDYuMzA0LjQ2NCA2LjMxMSAxLjE5IDE2LjU4NSA0LjIyMSAyNi4xMjIgNC4yMjEgOS40NTIgMCAxNy4xMTgtMS45MjYgMjEuMzgzLTIuNjAzLjc3LS4xMjMgMS4zODUtLjE5OSAxLjg3OC0uMjM3LS4zNCAxMy44NDMtMTIuODkzIDI3LjcxLTI3Ljg2OCAyNy43MS0xNS4xNzIgMC0yNy44NzYtMTMuODM1LTI3Ljg3Ni0yOC44MTEgMC0uMzU3LjAyOS0uNTk2LjA1Ny0uNzQ0WiIvPjwvc3ZnPg==" alt="Performance Models">
|
| 42 |
+
</a>
|
| 43 |
+
</p>
|
| 44 |
<div align="center">
|
| 45 |
|
| 46 |
<h1 style="color: #9334E9;">⚡ Pruna-Qwen-Image-2.1</h1>
|
|
|
|
| 69 |
> visual quality of the base model. We are still improving the distillation and
|
| 70 |
> will update this repository as new versions become available.
|
| 71 |
|
|
|
|
| 72 |
## Variants
|
| 73 |
|
| 74 |
Both adapters are v0.1. Pick one based on whether you need **quality** or **speed**.
|
|
|
|
| 94 |
|
| 95 |
## Benchmarking
|
| 96 |
|
| 97 |
+
Use a table; Hugging Face can otherwise render the `<img>` elements as separate blocks.
|
| 98 |
+
|
| 99 |
+
<table>
|
| 100 |
+
<tr>
|
| 101 |
+
<td width="50%">
|
| 102 |
+
<img src="assets/Pruna-Qwen-Image-2.1-t2i-1024.png" width="100%">
|
| 103 |
+
</td>
|
| 104 |
+
<td width="50%">
|
| 105 |
+
<img src="assets/Pruna-Qwen-Image-2.1-t2i-2048.png" width="100%">
|
| 106 |
+
</td>
|
| 107 |
+
</tr>
|
| 108 |
+
<tr>
|
| 109 |
+
<td width="50%">
|
| 110 |
+
<img src="assets/Pruna-Qwen-Image-2.1-i2i-1024.png" width="100%">
|
| 111 |
+
</td>
|
| 112 |
+
<td width="50%">
|
| 113 |
+
<img src="assets/Pruna-Qwen-Image-2.1-i2i-2048.png" width="100%">
|
| 114 |
+
</td>
|
| 115 |
+
</tr>
|
| 116 |
+
</table>
|
| 117 |
+
|
| 118 |
Text-to-image with the official Qwen model-card example prompt, BF16, batch size 1,
|
| 119 |
on one NVIDIA H100 80GB. Median of 3 requests after one warmup per configuration.
|
| 120 |
Includes prompt encoding, denoising, and decoding; excludes PNG saving, model
|
| 121 |
+
loading, and warmup. Base: 40 steps with KV cache on; Pruna-Qwen-Image-2.1: 5 or 8 steps with
|
| 122 |
KV cache off, as configured for this benchmark. The examples below enable KV caching for
|
| 123 |
+
Pruna-Qwen-Image-2.1; the chart has not been remeasured with that setting. LoRAs were unmerged;
|
| 124 |
no CFG, compilation, or CPU offload. These timings do not imply equal image quality.
|
| 125 |
|
| 126 |
## Quickstart
|
|
|
|
| 197 |
).images[0]
|
| 198 |
```
|
| 199 |
|
| 200 |
+
### Recommended settings
|
| 201 |
|
| 202 |
- **Use the sigma schedule that matches your adapter**, and keep the scheduler
|
| 203 |
at `shift=1.0` with dynamic shifting off so the sigmas are not shifted twice.
|
|
|
|
| 207 |
- **No CFG.** Keep `true_cfg_scale=1.0` and do not pass a negative prompt.
|
| 208 |
- **Keep the LoRA strength at 1.0.**
|
| 209 |
- **Write detailed prompts for text-to-image.** Longer prompts that describe
|
| 210 |
+
the subject, setting, lighting, and style work noticeably better than short
|
| 211 |
ones.
|
| 212 |
|
| 213 |
## Limitations
|
|
|
|
| 217 |
visibly worse.
|
| 218 |
- Short or vague text-to-image prompts give weaker results.
|
| 219 |
- The adapters are only intended for the settings above. Other step counts,
|
| 220 |
+
schedules, or CFG values are not supported.
|
| 221 |
|
| 222 |
## What this is not
|
| 223 |
|
|
|
|
| 236 |
|
| 237 |
## What's next?
|
| 238 |
|
| 239 |
+
- **Use Pruna-Qwen-Image-2.1 to generate and edit images with Qwen-Image-2.1 in a few steps.**
|
| 240 |
- Compress your own models with [Pruna](https://github.com/PrunaAI/pruna) and give us a ⭐️ for more efficiency!
|
| 241 |
- Want to use our optimized image models right away? Check [P-Image-Ideogram](https://www.pruna.ai/p-image-ideogram) and [P-Image-Edit](https://www.pruna.ai/p-image-edit).
|
| 242 |
|