wizdroid commited on
Commit
6113950
Β·
verified Β·
1 Parent(s): 86a0404

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +97 -41
README.md CHANGED
@@ -4,6 +4,11 @@ license: mit
4
 
5
  # πŸš€ ComfyUI Workflows by wizdroid
6
 
 
 
 
 
 
7
  **High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
8
 
9
  These workflows power consistent character generation, multi-reference image-to-image pipelines, lightning-fast turbo inference, state-of-the-art upscaling, and intelligent dataset preparation.
@@ -26,81 +31,129 @@ These workflows power consistent character generation, multi-reference image-to-
26
 
27
  ## πŸ“ Workflows
28
 
29
- | Workflow | Type | Key Features | Best For |
30
- |---------------------------|---------------|---------------------------------------------------|----------|
31
- | `flux2-klein-t2i.json` | Text-to-Image | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
32
- | `flux2-klein-1i2i.json` | 1-Image Ref | Single reference image + Reference Latent | Strong character consistency from one photo |
33
- | `flux2-klein-2i2i.json` | 2-Image Ref | Dual reference images | Even stronger identity with two angles/expressions |
34
- | `flux2-klein-3i2i.json` | 3-Image Ref | Triple reference images + advanced conditioning | **Maximum character fidelity** (recommended for LoRA training) |
35
- | `qwen-t2i.json` | Text-to-Image | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
36
- | `qwen-aio-t2i.json` | Text-to-Image | Qwen All-in-One variant | Quick Qwen generations |
37
- | `qwen-aio-1i2i.json` | 1-Image Ref | Qwen image reference | Qwen-powered character consistency |
38
- | `qwen-aio-2i2i.json` | 2-Image Ref | Dual reference | Multi-ref Qwen |
39
- | `qwen-aio-3i2i.json` | 3-Image Ref | Triple reference | Maximum Qwen consistency |
40
- | `z-image-turbo-t2i.json` | Fast T2I | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
41
- | `seedvr2-i2i.json` | Upscaler | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2×–4Γ— upscaling & detail recovery |
42
- | `dataset-generator.json` | Dataset Tool | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
43
 
44
  ---
45
 
46
  ## πŸ› οΈ Installation & Setup
47
 
48
  ### 1. ComfyUI
49
- Recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
50
 
51
  ### 2. Required Custom Nodes
52
- Install via **ComfyUI Manager** (recommended):
53
 
54
- - **ComfyUI-nunchaku** β€” Accelerated Flux inference
55
- - **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx)
56
- - **Wizdroid Character Dataset Node** (WizdroidLoRADataset and related nodes)
57
 
58
- Restart ComfyUI after installing.
59
 
60
  ### 3. Models
61
- Place in standard ComfyUI folders:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
 
63
- - **Flux2-Klein**: `flux/2/flux2-klein-9B.safetensors` + VAE
64
- - **Qwen** models (as referenced in workflows)
65
- - **Z-Image-Turbo** + turbo LoRAs
66
- - **SeedVR2**: `seedvr2_ema_7b_sharp_fp16.safetensors` + VAE
 
 
 
 
 
67
 
68
- ### 4. Ollama (Dataset Generator)
69
  ```bash
 
70
  ollama pull moondream:latest
71
- ollama serve
72
  ```
73
 
 
 
74
  ---
75
 
76
  ## πŸš€ How to Use
77
 
78
- 1. Drag & drop any `.json` workflow onto ComfyUI.
79
- 2. Use the clean proxy widgets for prompt, seed, steps, LoRA toggle, and reference images.
80
- 3. For **character consistency**, load prompts from **[PROMPTS.md](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)** into the 1i2i/2i2i/3i2i workflows.
 
 
 
 
 
 
 
81
 
82
- **Recommended for LoRA training data:** `flux2-klein-3i2i.json` + 2–3 clean source references + the 40 reference prompts.
 
 
83
 
84
- Then run `dataset-generator.json` to auto-caption and structure everything with your trigger word.
 
 
 
 
 
 
 
 
 
85
 
86
  ---
87
 
88
- ## πŸ’‘ Full Guide: Mastering Consistent Characters
 
 
89
 
90
- For the complete step-by-step tutorial (problem β†’ solution β†’ pipeline with these workflows + PROMPTS.md + WizdroidLoRADataset β†’ pro tips), see the dedicated CivitAI article:
91
 
92
- **β†’ [Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/...)**
93
- *(Replace with the real link after publishing the article on CivitAI)*
 
 
 
 
94
 
95
- It covers why single-ref fails, how Reference Latent + the 40 square prompts solve identity drift, generating 40–100+ training images, auto-captioning with the custom node, and training best practices.
96
 
97
- This short README is the HF model card version. The full rich version is in the local `README.md`.
 
 
 
 
98
 
99
  ---
100
 
101
- ## πŸ“œ License
102
 
103
- MIT β€” use, modify, and share freely.
104
 
105
  ---
106
 
@@ -112,4 +165,7 @@ MIT β€” use, modify, and share freely.
112
 
113
  **Additional Resources**
114
  - [PROMPTS.md β€” 40 Consistent Character Reference Prompts](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)
115
- - Full workflows and updates in this repository
 
 
 
 
4
 
5
  # πŸš€ ComfyUI Workflows by wizdroid
6
 
7
+ [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
8
+ [![ComfyUI](https://img.shields.io/badge/ComfyUI-Workflows-blue)](https://github.com/comfyanonymous/ComfyUI)
9
+ [![Flux](https://img.shields.io/badge/Flux-Accelerated-orange)](https://blackforestlabs.ai/)
10
+ [![Nunchaku](https://img.shields.io/badge/Nunchaku-Fast%20Inference-purple)](https://github.com/nunchaku-tech)
11
+
12
  **High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
13
 
14
  These workflows power consistent character generation, multi-reference image-to-image pipelines, lightning-fast turbo inference, state-of-the-art upscaling, and intelligent dataset preparation.
 
31
 
32
  ## πŸ“ Workflows
33
 
34
+ | Workflow | Type | Size | Key Features | Best For |
35
+ |---------------------------|---------------|---------|---------------------------------------------------|----------|
36
+ | `flux2-klein-t2i.json` | Text-to-Image | ~23 MB | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
37
+ | `flux2-klein-1i2i.json` | 1-Image Ref | ~29 MB | Single reference image + Reference Latent | Strong character consistency from one photo |
38
+ | `flux2-klein-2i2i.json` | 2-Image Ref | ~35 MB | Dual reference images | Even stronger identity with two angles/expressions |
39
+ | `flux2-klein-3i2i.json` | 3-Image Ref | ~41 MB | Triple reference images + advanced conditioning | Maximum character fidelity (recommended for LoRA training) |
40
+ | `qwen-t2i.json` | Text-to-Image | ~14 MB | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
41
+ | `qwen-aio-t2i.json` | Text-to-Image | ~12 MB | Qwen All-in-One variant | Quick Qwen generations |
42
+ | `qwen-aio-1i2i.json` | 1-Image Ref | ~14 MB | Qwen image reference | Qwen-powered character consistency |
43
+ | `qwen-aio-2i2i.json` | 2-Image Ref | ~15 MB | Dual reference | Multi-ref Qwen |
44
+ | `qwen-aio-3i2i.json` | 3-Image Ref | ~16 MB | Triple reference | Maximum Qwen consistency |
45
+ | `z-image-turbo-t2i.json` | Fast T2I | ~18 MB | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
46
+ | `seedvr2-i2i.json` | Upscaler | ~13 MB | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2×–4Γ— upscaling & detail recovery |
47
+ | `dataset-generator.json` | Dataset Tool | ~3 MB | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
48
 
49
  ---
50
 
51
  ## πŸ› οΈ Installation & Setup
52
 
53
  ### 1. ComfyUI
54
+ Make sure you have a recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
55
 
56
  ### 2. Required Custom Nodes
57
+ Install these via **ComfyUI Manager** (recommended) or git clone into `custom_nodes/`:
58
 
59
+ - **ComfyUI-nunchaku** β€” For accelerated Flux inference
60
+ - **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx) β€” For the SeedVR2 upscaler workflow
61
+ - **Wizdroid Character Dataset Node** β€” The custom `WizdroidLoRADataset` node (included in this repo's ecosystem)
62
 
63
+ Restart ComfyUI after installing custom nodes.
64
 
65
  ### 3. Models
66
+ Place models in the standard ComfyUI folders (or update paths inside workflows):
67
+
68
+ **Flux2-Klein (main quality engine):**
69
+ - `flux/2/flux2-klein-9B.safetensors`
70
+ - `flux/2/vae.safetensors`
71
+
72
+ **Qwen:**
73
+ - `qwen/qwen-image-edit-sfw.safetensors`
74
+ - `qwen/qwen3-8B.safetensors` (or 4B variant)
75
+ - `qwen/qwen3-4B.safetensors`
76
+
77
+ **Z-Image Turbo:**
78
+ - `z-image/z-image-turbo.safetensors`
79
+ - `z-image/vae.safetensors`
80
+ - `z-image/turbo/4nup4m4.safetensors` (example turbo LoRA)
81
 
82
+ **SeedVR2:**
83
+ - `seedvr2_ema_7b_sharp_fp16.safetensors` (DiT)
84
+ - `ema_vae_fp16.safetensors` (VAE)
85
+
86
+ **CLIP / Other:**
87
+ - Various Qwen CLIP models as referenced in the workflows
88
+
89
+ ### 4. Ollama (for Dataset Generator)
90
+ The `dataset-generator.json` workflow uses a local vision model via Ollama:
91
 
 
92
  ```bash
93
+ # Install Ollama and pull a good vision model (Moondream recommended in the workflow)
94
  ollama pull moondream:latest
 
95
  ```
96
 
97
+ Start Ollama (`ollama serve`) before running the dataset workflow. You can change the model/URL inside the node.
98
+
99
  ---
100
 
101
  ## πŸš€ How to Use
102
 
103
+ 1. **Load a workflow**: Drag & drop any `.json` file directly onto your ComfyUI canvas, or use **Load** β†’ select the file.
104
+ 2. **Queue Prompt** as usual.
105
+ 3. Most workflows expose clean proxy widgets on the right for:
106
+ - Prompt / negative prompt
107
+ - Seed, steps, CFG, sampler
108
+ - Width / Height
109
+ - LoRA toggle + strength
110
+ - Reference images (for i2i workflows)
111
+
112
+ ### Character Consistency Workflow Recommendations
113
 
114
+ - Use **flux2-klein-3i2i.json** (or 2i2i) with 2–3 high-quality, varied reference photos of your character.
115
+ - Generate using the same character across many angles/expressions using the reference prompts collection.
116
+ - Feed the resulting images into `dataset-generator.json` to auto-caption and structure a ready-to-train dataset (with your character trigger tag).
117
 
118
+ ---
119
+
120
+ ## πŸ’‘ Tips for Best Results
121
+
122
+ - **Reference Images**: Clean, well-lit, minimal makeup/jewelry/background. Square 1:1 references work great.
123
+ - **Prompting**: Start simple ("Photo of a woman", "beautiful detailed face") and let the reference images do the heavy lifting for identity.
124
+ - **LoRAs**: The LoRA switch is disabled by default in many workflows. Enable it and point to character or style LoRAs.
125
+ - **Speed vs Quality**: Use `z-image-turbo-t2i.json` for rapid iteration, then switch to Flux2-Klein for final outputs.
126
+ - **Upscaling**: Always run important generations through `seedvr2-i2i.json` for that extra polish.
127
+ - **Dataset Quality**: Use the dataset generator + good reference images + Ollama captions, then manually review the `validation_report`.
128
 
129
  ---
130
 
131
+ ## οΏ½ Full Guide: Mastering Consistent Characters
132
+
133
+ For the **complete step-by-step tutorial** (problem β†’ solution β†’ exact pipeline using these workflows + PROMPTS.md + the WizdroidLoRADataset node β†’ pro tips + visual examples), see the dedicated CivitAI article:
134
 
135
+ **β†’ [Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/31442/mastering-consistent-characters-for-lora-training)**
136
 
137
+ The article covers:
138
+ - Why single-reference methods fail for modern models (Flux, SD3, Aurora, etc.)
139
+ - How Reference Latent injection + clean square 1:1 prompts solve identity drift
140
+ - Generating 40–100+ varied training images using the included PROMPTS.md
141
+ - Using the WizdroidLoRADataset node for perfect auto-captions, validation reports, and trigger word injection
142
+ - Training recommendations, best practices, and real-world results
143
 
144
+ This README is the technical reference. The CivitAI guide is the teaching + visual companion. Use both.
145
 
146
+ ---
147
+
148
+ ## οΏ½πŸ“œ License
149
+
150
+ MIT License β€” feel free to use, modify, and share these workflows.
151
 
152
  ---
153
 
154
+ ## 🀝 Contributing
155
 
156
+ Pull requests and workflow improvements are welcome! If you create amazing results with these, tag **@wizdroid** β€” I'd love to see what you build.
157
 
158
  ---
159
 
 
165
 
166
  **Additional Resources**
167
  - [PROMPTS.md β€” 40 Consistent Character Reference Prompts](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)
168
+ - [CivitAI Guide: Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/...) *(update this link after posting the article)*
169
+ - Full workflows and updates in this repository31442/mastering-consistent-characters-for-lora-training)
170
+
171
+ **For HF users:** The `HF_README_UPDATED.md` file in this folder is a clean, concise version you can copy directly into the repo root as `README.md` if you prefer a shorter model card. The current README is the rich version recommended for the repo.