Image-to-Image
Diffusers
Safetensors
English
FluxKleinPipeline
image-editing
instruction-based-image-editing
4k
distillation
dcae
Instructions to use openvivo/BluePixel-Turbo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use openvivo/BluePixel-Turbo with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("openvivo/BluePixel-Turbo", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,96 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
datasets:
|
| 6 |
+
- openvivo/VINS-120K
|
| 7 |
+
base_model: black-forest-labs/FLUX.2-klein-9B
|
| 8 |
+
library_name: diffusers
|
| 9 |
+
pipeline_tag: image-to-image
|
| 10 |
+
metrics:
|
| 11 |
+
- vins-4keval-plus-plus-overall
|
| 12 |
+
- vins-4keval-plus-plus-nc
|
| 13 |
+
- imgedit-bench-score
|
| 14 |
+
- cie-bench-total
|
| 15 |
+
tags:
|
| 16 |
+
- image-editing
|
| 17 |
+
- instruction-based-image-editing
|
| 18 |
+
- 4k
|
| 19 |
+
- distillation
|
| 20 |
+
- dcae
|
| 21 |
---
|
| 22 |
+
|
| 23 |
+
# BluePixel-Turbo
|
| 24 |
+
|
| 25 |
+
**Native 4K instruction-based image editing in 4 steps.**
|
| 26 |
+
|
| 27 |
+
[Project Page](https://tech.vivo.com/) · [Code](https://github.com/vivo/BluePixel) · [Dataset](https://huggingface.co/datasets/openvivo/VINS-120K)
|
| 28 |
+
|
| 29 |
+
BluePixel-Turbo is the distilled image editing model from **BluePixel: Toward Native 4K Agentic Image Editing**, developed by vivo. It builds on [FLUX.2-klein-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-9B) with a DCAE-F64 autoencoder for efficient native 4K editing.
|
| 30 |
+
|
| 31 |
+
- **Native 4K output** without cascaded super-resolution.
|
| 32 |
+
- **4-step inference** through source-anchored target projection (SATP), distilled from a 50-step teacher.
|
| 33 |
+
- **Long-tail editing skills** learned through ACE-MOPD, followed by reinforcement learning for aesthetics and instruction fidelity.
|
| 34 |
+
- **8.7 seconds per 4K edit** on a single Kunlunxin P800 XPU (BF16), as reported on the project page. Latency varies by hardware.
|
| 35 |
+
|
| 36 |
+
## Quick Start
|
| 37 |
+
|
| 38 |
+
Use the custom Diffusers-based pipeline provided in the code repository:
|
| 39 |
+
|
| 40 |
+
```bash
|
| 41 |
+
git clone https://github.com/vivo/BluePixel.git
|
| 42 |
+
cd BluePixel
|
| 43 |
+
pip install -r requirements.txt
|
| 44 |
+
pip install --upgrade diffusers huggingface_hub
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
Run from the cloned repository in a CUDA environment with BF16 support:
|
| 48 |
+
|
| 49 |
+
```python
|
| 50 |
+
import torch
|
| 51 |
+
from PIL import Image
|
| 52 |
+
from huggingface_hub import snapshot_download
|
| 53 |
+
from vins_infer import load_pipeline
|
| 54 |
+
|
| 55 |
+
model_dir = snapshot_download("openvivo/BluePixel-Turbo")
|
| 56 |
+
pipe = load_pipeline(
|
| 57 |
+
model_dir=model_dir,
|
| 58 |
+
device="cuda:0",
|
| 59 |
+
vae_tiling=False, # Enable to reduce autoencoder memory usage.
|
| 60 |
+
lora_scale=None,
|
| 61 |
+
shift=0.0,
|
| 62 |
+
mu_mode="empirical",
|
| 63 |
+
)
|
| 64 |
+
|
| 65 |
+
image = Image.open("assets/test_input.jpg").convert("RGB")
|
| 66 |
+
result = pipe(
|
| 67 |
+
image=image,
|
| 68 |
+
instruction="Make the sky sunset orange and add warm light.",
|
| 69 |
+
num_inference_steps=4,
|
| 70 |
+
guidance_scale=3.0,
|
| 71 |
+
target_pixels=4096 * 4096,
|
| 72 |
+
generator=torch.Generator(device="cuda:0").manual_seed(42),
|
| 73 |
+
).images[0]
|
| 74 |
+
result.save("output.png")
|
| 75 |
+
```
|
| 76 |
+
|
| 77 |
+
The pipeline approximately preserves the input aspect ratio and aligns dimensions to multiples of 64; non-square inputs produce non-square outputs. Use a Diffusers version that includes the FLUX.2 components imported by `vins_infer.py`.
|
| 78 |
+
|
| 79 |
+
## Benchmarks
|
| 80 |
+
|
| 81 |
+
Results below are reported for **BluePixel** on the [project page](https://tech.vivo.com/); the page does not assign each quality score specifically to this Turbo checkpoint.
|
| 82 |
+
|
| 83 |
+
| Benchmark | Metric / category | Result |
|
| 84 |
+
| :--- | :--- | :--- |
|
| 85 |
+
| VINS-4KEval++ | Overall | **8.62**, 2nd of 7 models |
|
| 86 |
+
| VINS-4KEval++ | Non-edited-region consistency (NC) | **9.06** |
|
| 87 |
+
| ImgEdit-Bench | Hybrid / Action | **4.59 / 4.93**, 1st in both |
|
| 88 |
+
| CIE-Bench | Total, before → after ACE-MOPD | **6.24 → 8.87** |
|
| 89 |
+
|
| 90 |
+
The metadata uses descriptive custom metric identifiers for these measures. See the project page for training details and the broader BluePixel Agent framework.
|
| 91 |
+
|
| 92 |
+
## Limitations and License
|
| 93 |
+
|
| 94 |
+
Intended for image editing with English instructions. Outputs may contain artifacts or unintended changes; review results before use.
|
| 95 |
+
|
| 96 |
+
Released under **Apache-2.0**. See [LICENSE](https://github.com/vivo/BluePixel/blob/main/LICENSE) and [NOTICE](https://github.com/vivo/BluePixel/blob/main/NOTICE).
|