Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,11 @@ license: mit
|
|
| 4 |
|
| 5 |
# π ComfyUI Workflows by wizdroid
|
| 6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
**High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
|
| 8 |
|
| 9 |
These workflows power consistent character generation, multi-reference image-to-image pipelines, lightning-fast turbo inference, state-of-the-art upscaling, and intelligent dataset preparation.
|
|
@@ -26,81 +31,129 @@ These workflows power consistent character generation, multi-reference image-to-
|
|
| 26 |
|
| 27 |
## π Workflows
|
| 28 |
|
| 29 |
-
| Workflow | Type | Key Features | Best For |
|
| 30 |
-
|---------------------------|---------------|---------------------------------------------------|----------|
|
| 31 |
-
| `flux2-klein-t2i.json` | Text-to-Image | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
|
| 32 |
-
| `flux2-klein-1i2i.json` | 1-Image Ref | Single reference image + Reference Latent | Strong character consistency from one photo |
|
| 33 |
-
| `flux2-klein-2i2i.json` | 2-Image Ref | Dual reference images | Even stronger identity with two angles/expressions |
|
| 34 |
-
| `flux2-klein-3i2i.json` | 3-Image Ref | Triple reference images + advanced conditioning |
|
| 35 |
-
| `qwen-t2i.json` | Text-to-Image | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
|
| 36 |
-
| `qwen-aio-t2i.json` | Text-to-Image | Qwen All-in-One variant | Quick Qwen generations |
|
| 37 |
-
| `qwen-aio-1i2i.json` | 1-Image Ref | Qwen image reference | Qwen-powered character consistency |
|
| 38 |
-
| `qwen-aio-2i2i.json` | 2-Image Ref | Dual reference | Multi-ref Qwen |
|
| 39 |
-
| `qwen-aio-3i2i.json` | 3-Image Ref | Triple reference | Maximum Qwen consistency |
|
| 40 |
-
| `z-image-turbo-t2i.json` | Fast T2I | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
|
| 41 |
-
| `seedvr2-i2i.json` | Upscaler | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2Γβ4Γ upscaling & detail recovery |
|
| 42 |
-
| `dataset-generator.json` | Dataset Tool | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
|
| 43 |
|
| 44 |
---
|
| 45 |
|
| 46 |
## π οΈ Installation & Setup
|
| 47 |
|
| 48 |
### 1. ComfyUI
|
| 49 |
-
|
| 50 |
|
| 51 |
### 2. Required Custom Nodes
|
| 52 |
-
Install via **ComfyUI Manager** (recommended):
|
| 53 |
|
| 54 |
-
- **ComfyUI-nunchaku** β
|
| 55 |
-
- **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx)
|
| 56 |
-
- **Wizdroid Character Dataset Node**
|
| 57 |
|
| 58 |
-
Restart ComfyUI after installing.
|
| 59 |
|
| 60 |
### 3. Models
|
| 61 |
-
Place in standard ComfyUI folders:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
-
|
| 64 |
-
-
|
| 65 |
-
-
|
| 66 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 67 |
|
| 68 |
-
### 4. Ollama (Dataset Generator)
|
| 69 |
```bash
|
|
|
|
| 70 |
ollama pull moondream:latest
|
| 71 |
-
ollama serve
|
| 72 |
```
|
| 73 |
|
|
|
|
|
|
|
| 74 |
---
|
| 75 |
|
| 76 |
## π How to Use
|
| 77 |
|
| 78 |
-
1. Drag & drop any `.json`
|
| 79 |
-
2.
|
| 80 |
-
3.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 81 |
|
| 82 |
-
|
|
|
|
|
|
|
| 83 |
|
| 84 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 85 |
|
| 86 |
---
|
| 87 |
|
| 88 |
-
##
|
|
|
|
|
|
|
| 89 |
|
| 90 |
-
|
| 91 |
|
| 92 |
-
|
| 93 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 94 |
|
| 95 |
-
|
| 96 |
|
| 97 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 98 |
|
| 99 |
---
|
| 100 |
|
| 101 |
-
##
|
| 102 |
|
| 103 |
-
|
| 104 |
|
| 105 |
---
|
| 106 |
|
|
@@ -112,4 +165,7 @@ MIT β use, modify, and share freely.
|
|
| 112 |
|
| 113 |
**Additional Resources**
|
| 114 |
- [PROMPTS.md β 40 Consistent Character Reference Prompts](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)
|
| 115 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
|
| 5 |
# π ComfyUI Workflows by wizdroid
|
| 6 |
|
| 7 |
+
[](https://opensource.org/licenses/MIT)
|
| 8 |
+
[](https://github.com/comfyanonymous/ComfyUI)
|
| 9 |
+
[](https://blackforestlabs.ai/)
|
| 10 |
+
[](https://github.com/nunchaku-tech)
|
| 11 |
+
|
| 12 |
**High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
|
| 13 |
|
| 14 |
These workflows power consistent character generation, multi-reference image-to-image pipelines, lightning-fast turbo inference, state-of-the-art upscaling, and intelligent dataset preparation.
|
|
|
|
| 31 |
|
| 32 |
## π Workflows
|
| 33 |
|
| 34 |
+
| Workflow | Type | Size | Key Features | Best For |
|
| 35 |
+
|---------------------------|---------------|---------|---------------------------------------------------|----------|
|
| 36 |
+
| `flux2-klein-t2i.json` | Text-to-Image | ~23 MB | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
|
| 37 |
+
| `flux2-klein-1i2i.json` | 1-Image Ref | ~29 MB | Single reference image + Reference Latent | Strong character consistency from one photo |
|
| 38 |
+
| `flux2-klein-2i2i.json` | 2-Image Ref | ~35 MB | Dual reference images | Even stronger identity with two angles/expressions |
|
| 39 |
+
| `flux2-klein-3i2i.json` | 3-Image Ref | ~41 MB | Triple reference images + advanced conditioning | Maximum character fidelity (recommended for LoRA training) |
|
| 40 |
+
| `qwen-t2i.json` | Text-to-Image | ~14 MB | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
|
| 41 |
+
| `qwen-aio-t2i.json` | Text-to-Image | ~12 MB | Qwen All-in-One variant | Quick Qwen generations |
|
| 42 |
+
| `qwen-aio-1i2i.json` | 1-Image Ref | ~14 MB | Qwen image reference | Qwen-powered character consistency |
|
| 43 |
+
| `qwen-aio-2i2i.json` | 2-Image Ref | ~15 MB | Dual reference | Multi-ref Qwen |
|
| 44 |
+
| `qwen-aio-3i2i.json` | 3-Image Ref | ~16 MB | Triple reference | Maximum Qwen consistency |
|
| 45 |
+
| `z-image-turbo-t2i.json` | Fast T2I | ~18 MB | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
|
| 46 |
+
| `seedvr2-i2i.json` | Upscaler | ~13 MB | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2Γβ4Γ upscaling & detail recovery |
|
| 47 |
+
| `dataset-generator.json` | Dataset Tool | ~3 MB | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
|
| 48 |
|
| 49 |
---
|
| 50 |
|
| 51 |
## π οΈ Installation & Setup
|
| 52 |
|
| 53 |
### 1. ComfyUI
|
| 54 |
+
Make sure you have a recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
|
| 55 |
|
| 56 |
### 2. Required Custom Nodes
|
| 57 |
+
Install these via **ComfyUI Manager** (recommended) or git clone into `custom_nodes/`:
|
| 58 |
|
| 59 |
+
- **ComfyUI-nunchaku** β For accelerated Flux inference
|
| 60 |
+
- **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx) β For the SeedVR2 upscaler workflow
|
| 61 |
+
- **Wizdroid Character Dataset Node** β The custom `WizdroidLoRADataset` node (included in this repo's ecosystem)
|
| 62 |
|
| 63 |
+
Restart ComfyUI after installing custom nodes.
|
| 64 |
|
| 65 |
### 3. Models
|
| 66 |
+
Place models in the standard ComfyUI folders (or update paths inside workflows):
|
| 67 |
+
|
| 68 |
+
**Flux2-Klein (main quality engine):**
|
| 69 |
+
- `flux/2/flux2-klein-9B.safetensors`
|
| 70 |
+
- `flux/2/vae.safetensors`
|
| 71 |
+
|
| 72 |
+
**Qwen:**
|
| 73 |
+
- `qwen/qwen-image-edit-sfw.safetensors`
|
| 74 |
+
- `qwen/qwen3-8B.safetensors` (or 4B variant)
|
| 75 |
+
- `qwen/qwen3-4B.safetensors`
|
| 76 |
+
|
| 77 |
+
**Z-Image Turbo:**
|
| 78 |
+
- `z-image/z-image-turbo.safetensors`
|
| 79 |
+
- `z-image/vae.safetensors`
|
| 80 |
+
- `z-image/turbo/4nup4m4.safetensors` (example turbo LoRA)
|
| 81 |
|
| 82 |
+
**SeedVR2:**
|
| 83 |
+
- `seedvr2_ema_7b_sharp_fp16.safetensors` (DiT)
|
| 84 |
+
- `ema_vae_fp16.safetensors` (VAE)
|
| 85 |
+
|
| 86 |
+
**CLIP / Other:**
|
| 87 |
+
- Various Qwen CLIP models as referenced in the workflows
|
| 88 |
+
|
| 89 |
+
### 4. Ollama (for Dataset Generator)
|
| 90 |
+
The `dataset-generator.json` workflow uses a local vision model via Ollama:
|
| 91 |
|
|
|
|
| 92 |
```bash
|
| 93 |
+
# Install Ollama and pull a good vision model (Moondream recommended in the workflow)
|
| 94 |
ollama pull moondream:latest
|
|
|
|
| 95 |
```
|
| 96 |
|
| 97 |
+
Start Ollama (`ollama serve`) before running the dataset workflow. You can change the model/URL inside the node.
|
| 98 |
+
|
| 99 |
---
|
| 100 |
|
| 101 |
## π How to Use
|
| 102 |
|
| 103 |
+
1. **Load a workflow**: Drag & drop any `.json` file directly onto your ComfyUI canvas, or use **Load** β select the file.
|
| 104 |
+
2. **Queue Prompt** as usual.
|
| 105 |
+
3. Most workflows expose clean proxy widgets on the right for:
|
| 106 |
+
- Prompt / negative prompt
|
| 107 |
+
- Seed, steps, CFG, sampler
|
| 108 |
+
- Width / Height
|
| 109 |
+
- LoRA toggle + strength
|
| 110 |
+
- Reference images (for i2i workflows)
|
| 111 |
+
|
| 112 |
+
### Character Consistency Workflow Recommendations
|
| 113 |
|
| 114 |
+
- Use **flux2-klein-3i2i.json** (or 2i2i) with 2β3 high-quality, varied reference photos of your character.
|
| 115 |
+
- Generate using the same character across many angles/expressions using the reference prompts collection.
|
| 116 |
+
- Feed the resulting images into `dataset-generator.json` to auto-caption and structure a ready-to-train dataset (with your character trigger tag).
|
| 117 |
|
| 118 |
+
---
|
| 119 |
+
|
| 120 |
+
## π‘ Tips for Best Results
|
| 121 |
+
|
| 122 |
+
- **Reference Images**: Clean, well-lit, minimal makeup/jewelry/background. Square 1:1 references work great.
|
| 123 |
+
- **Prompting**: Start simple ("Photo of a woman", "beautiful detailed face") and let the reference images do the heavy lifting for identity.
|
| 124 |
+
- **LoRAs**: The LoRA switch is disabled by default in many workflows. Enable it and point to character or style LoRAs.
|
| 125 |
+
- **Speed vs Quality**: Use `z-image-turbo-t2i.json` for rapid iteration, then switch to Flux2-Klein for final outputs.
|
| 126 |
+
- **Upscaling**: Always run important generations through `seedvr2-i2i.json` for that extra polish.
|
| 127 |
+
- **Dataset Quality**: Use the dataset generator + good reference images + Ollama captions, then manually review the `validation_report`.
|
| 128 |
|
| 129 |
---
|
| 130 |
|
| 131 |
+
## οΏ½ Full Guide: Mastering Consistent Characters
|
| 132 |
+
|
| 133 |
+
For the **complete step-by-step tutorial** (problem β solution β exact pipeline using these workflows + PROMPTS.md + the WizdroidLoRADataset node β pro tips + visual examples), see the dedicated CivitAI article:
|
| 134 |
|
| 135 |
+
**β [Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/31442/mastering-consistent-characters-for-lora-training)**
|
| 136 |
|
| 137 |
+
The article covers:
|
| 138 |
+
- Why single-reference methods fail for modern models (Flux, SD3, Aurora, etc.)
|
| 139 |
+
- How Reference Latent injection + clean square 1:1 prompts solve identity drift
|
| 140 |
+
- Generating 40β100+ varied training images using the included PROMPTS.md
|
| 141 |
+
- Using the WizdroidLoRADataset node for perfect auto-captions, validation reports, and trigger word injection
|
| 142 |
+
- Training recommendations, best practices, and real-world results
|
| 143 |
|
| 144 |
+
This README is the technical reference. The CivitAI guide is the teaching + visual companion. Use both.
|
| 145 |
|
| 146 |
+
---
|
| 147 |
+
|
| 148 |
+
## οΏ½π License
|
| 149 |
+
|
| 150 |
+
MIT License β feel free to use, modify, and share these workflows.
|
| 151 |
|
| 152 |
---
|
| 153 |
|
| 154 |
+
## π€ Contributing
|
| 155 |
|
| 156 |
+
Pull requests and workflow improvements are welcome! If you create amazing results with these, tag **@wizdroid** β I'd love to see what you build.
|
| 157 |
|
| 158 |
---
|
| 159 |
|
|
|
|
| 165 |
|
| 166 |
**Additional Resources**
|
| 167 |
- [PROMPTS.md β 40 Consistent Character Reference Prompts](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)
|
| 168 |
+
- [CivitAI Guide: Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/...) *(update this link after posting the article)*
|
| 169 |
+
- Full workflows and updates in this repository31442/mastering-consistent-characters-for-lora-training)
|
| 170 |
+
|
| 171 |
+
**For HF users:** The `HF_README_UPDATED.md` file in this folder is a clean, concise version you can copy directly into the repo root as `README.md` if you prefer a shorter model card. The current README is the rich version recommended for the repo.
|