Plams commited on
Commit
5972883
·
verified ·
1 Parent(s): c5c7c04

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +93 -0
README.md CHANGED
@@ -1,3 +1,96 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ datasets:
6
+ - openvivo/VINS-120K
7
+ base_model: black-forest-labs/FLUX.2-klein-9B
8
+ library_name: diffusers
9
+ pipeline_tag: image-to-image
10
+ metrics:
11
+ - vins-4keval-plus-plus-overall
12
+ - vins-4keval-plus-plus-nc
13
+ - imgedit-bench-score
14
+ - cie-bench-total
15
+ tags:
16
+ - image-editing
17
+ - instruction-based-image-editing
18
+ - 4k
19
+ - distillation
20
+ - dcae
21
  ---
22
+
23
+ # BluePixel-Turbo
24
+
25
+ **Native 4K instruction-based image editing in 4 steps.**
26
+
27
+ [Project Page](https://tech.vivo.com/) · [Code](https://github.com/vivo/BluePixel) · [Dataset](https://huggingface.co/datasets/openvivo/VINS-120K)
28
+
29
+ BluePixel-Turbo is the distilled image editing model from **BluePixel: Toward Native 4K Agentic Image Editing**, developed by vivo. It builds on [FLUX.2-klein-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-9B) with a DCAE-F64 autoencoder for efficient native 4K editing.
30
+
31
+ - **Native 4K output** without cascaded super-resolution.
32
+ - **4-step inference** through source-anchored target projection (SATP), distilled from a 50-step teacher.
33
+ - **Long-tail editing skills** learned through ACE-MOPD, followed by reinforcement learning for aesthetics and instruction fidelity.
34
+ - **8.7 seconds per 4K edit** on a single Kunlunxin P800 XPU (BF16), as reported on the project page. Latency varies by hardware.
35
+
36
+ ## Quick Start
37
+
38
+ Use the custom Diffusers-based pipeline provided in the code repository:
39
+
40
+ ```bash
41
+ git clone https://github.com/vivo/BluePixel.git
42
+ cd BluePixel
43
+ pip install -r requirements.txt
44
+ pip install --upgrade diffusers huggingface_hub
45
+ ```
46
+
47
+ Run from the cloned repository in a CUDA environment with BF16 support:
48
+
49
+ ```python
50
+ import torch
51
+ from PIL import Image
52
+ from huggingface_hub import snapshot_download
53
+ from vins_infer import load_pipeline
54
+
55
+ model_dir = snapshot_download("openvivo/BluePixel-Turbo")
56
+ pipe = load_pipeline(
57
+ model_dir=model_dir,
58
+ device="cuda:0",
59
+ vae_tiling=False, # Enable to reduce autoencoder memory usage.
60
+ lora_scale=None,
61
+ shift=0.0,
62
+ mu_mode="empirical",
63
+ )
64
+
65
+ image = Image.open("assets/test_input.jpg").convert("RGB")
66
+ result = pipe(
67
+ image=image,
68
+ instruction="Make the sky sunset orange and add warm light.",
69
+ num_inference_steps=4,
70
+ guidance_scale=3.0,
71
+ target_pixels=4096 * 4096,
72
+ generator=torch.Generator(device="cuda:0").manual_seed(42),
73
+ ).images[0]
74
+ result.save("output.png")
75
+ ```
76
+
77
+ The pipeline approximately preserves the input aspect ratio and aligns dimensions to multiples of 64; non-square inputs produce non-square outputs. Use a Diffusers version that includes the FLUX.2 components imported by `vins_infer.py`.
78
+
79
+ ## Benchmarks
80
+
81
+ Results below are reported for **BluePixel** on the [project page](https://tech.vivo.com/); the page does not assign each quality score specifically to this Turbo checkpoint.
82
+
83
+ | Benchmark | Metric / category | Result |
84
+ | :--- | :--- | :--- |
85
+ | VINS-4KEval++ | Overall | **8.62**, 2nd of 7 models |
86
+ | VINS-4KEval++ | Non-edited-region consistency (NC) | **9.06** |
87
+ | ImgEdit-Bench | Hybrid / Action | **4.59 / 4.93**, 1st in both |
88
+ | CIE-Bench | Total, before → after ACE-MOPD | **6.24 → 8.87** |
89
+
90
+ The metadata uses descriptive custom metric identifiers for these measures. See the project page for training details and the broader BluePixel Agent framework.
91
+
92
+ ## Limitations and License
93
+
94
+ Intended for image editing with English instructions. Outputs may contain artifacts or unintended changes; review results before use.
95
+
96
+ Released under **Apache-2.0**. See [LICENSE](https://github.com/vivo/BluePixel/blob/main/LICENSE) and [NOTICE](https://github.com/vivo/BluePixel/blob/main/NOTICE).