Update README.md
Browse files
README.md
CHANGED
|
@@ -1,9 +1,8 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
| 2 |
|
| 3 |
-
|
| 4 |
-
[](https://github.com/comfyanonymous/ComfyUI)
|
| 5 |
-
[](https://blackforestlabs.ai/)
|
| 6 |
-
[](https://github.com/nunchaku-tech)
|
| 7 |
|
| 8 |
**High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
|
| 9 |
|
|
@@ -19,123 +18,98 @@ These workflows power consistent character generation, multi-reference image-to-
|
|
| 19 |
- **SeedVR2 Upscaler** β One of the best image upscalers available (DiT + VAE with advanced tiling & color correction)
|
| 20 |
- **WizdroidLoRADataset** β Custom node for automated vision-LLM captioning, dataset structuring, and validation β perfect companion for training consistent characters
|
| 21 |
- **LoRA-ready** β Built-in toggleable LoRA loading across most pipelines
|
| 22 |
-
- **Square 1:1 + Flexible Resolutions** β Optimized for character reference work
|
| 23 |
|
| 24 |
-
> **Pro Tip:** Pair these workflows with the [Consistent Character Reference Prompts](https://
|
| 25 |
|
| 26 |
---
|
| 27 |
|
| 28 |
## π Workflows
|
| 29 |
|
| 30 |
-
| Workflow | Type |
|
| 31 |
-
|---------------------------|---------------|---------
|
| 32 |
-
| `flux2-klein-t2i.json` | Text-to-Image |
|
| 33 |
-
| `flux2-klein-1i2i.json` | 1-Image Ref |
|
| 34 |
-
| `flux2-klein-2i2i.json` | 2-Image Ref |
|
| 35 |
-
| `flux2-klein-3i2i.json` | 3-Image Ref |
|
| 36 |
-
| `qwen-t2i.json` | Text-to-Image |
|
| 37 |
-
| `qwen-aio-t2i.json` | Text-to-Image |
|
| 38 |
-
| `qwen-aio-1i2i.json` | 1-Image Ref |
|
| 39 |
-
| `qwen-aio-2i2i.json` | 2-Image Ref |
|
| 40 |
-
| `qwen-aio-3i2i.json` | 3-Image Ref |
|
| 41 |
-
| `z-image-turbo-t2i.json` | Fast T2I |
|
| 42 |
-
| `seedvr2-i2i.json` | Upscaler |
|
| 43 |
-
| `dataset-generator.json` | Dataset Tool |
|
| 44 |
|
| 45 |
---
|
| 46 |
|
| 47 |
## π οΈ Installation & Setup
|
| 48 |
|
| 49 |
### 1. ComfyUI
|
| 50 |
-
|
| 51 |
|
| 52 |
### 2. Required Custom Nodes
|
| 53 |
-
Install
|
| 54 |
|
| 55 |
-
- **ComfyUI-nunchaku** β
|
| 56 |
-
- **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx)
|
| 57 |
-
- **Wizdroid Character Dataset Node**
|
| 58 |
|
| 59 |
-
Restart ComfyUI after installing
|
| 60 |
|
| 61 |
### 3. Models
|
| 62 |
-
Place
|
| 63 |
-
|
| 64 |
-
**Flux2-Klein (main quality engine):**
|
| 65 |
-
- `flux/2/flux2-klein-9B.safetensors`
|
| 66 |
-
- `flux/2/vae.safetensors`
|
| 67 |
-
|
| 68 |
-
**Qwen:**
|
| 69 |
-
- `qwen/qwen-image-edit-sfw.safetensors`
|
| 70 |
-
- `qwen/qwen3-8B.safetensors` (or 4B variant)
|
| 71 |
-
- `qwen/qwen3-4B.safetensors`
|
| 72 |
-
|
| 73 |
-
**Z-Image Turbo:**
|
| 74 |
-
- `z-image/z-image-turbo.safetensors`
|
| 75 |
-
- `z-image/vae.safetensors`
|
| 76 |
-
- `z-image/turbo/4nup4m4.safetensors` (example turbo LoRA)
|
| 77 |
-
|
| 78 |
-
**SeedVR2:**
|
| 79 |
-
- `seedvr2_ema_7b_sharp_fp16.safetensors` (DiT)
|
| 80 |
-
- `ema_vae_fp16.safetensors` (VAE)
|
| 81 |
|
| 82 |
-
**
|
| 83 |
-
-
|
| 84 |
-
|
| 85 |
-
|
| 86 |
-
The `dataset-generator.json` workflow uses a local vision model via Ollama:
|
| 87 |
|
|
|
|
| 88 |
```bash
|
| 89 |
-
# Install Ollama and pull a good vision model (Moondream recommended in the workflow)
|
| 90 |
ollama pull moondream:latest
|
|
|
|
| 91 |
```
|
| 92 |
|
| 93 |
-
Start Ollama (`ollama serve`) before running the dataset workflow. You can change the model/URL inside the node.
|
| 94 |
-
|
| 95 |
---
|
| 96 |
|
| 97 |
## π How to Use
|
| 98 |
|
| 99 |
-
1.
|
| 100 |
-
2.
|
| 101 |
-
3.
|
| 102 |
-
- Prompt / negative prompt
|
| 103 |
-
- Seed, steps, CFG, sampler
|
| 104 |
-
- Width / Height
|
| 105 |
-
- LoRA toggle + strength
|
| 106 |
-
- Reference images (for i2i workflows)
|
| 107 |
|
| 108 |
-
|
| 109 |
|
| 110 |
-
|
| 111 |
-
- Generate using the same character across many angles/expressions using the reference prompts collection.
|
| 112 |
-
- Feed the resulting images into `dataset-generator.json` to auto-caption and structure a ready-to-train dataset (with your character trigger tag).
|
| 113 |
|
| 114 |
---
|
| 115 |
|
| 116 |
-
## π‘
|
| 117 |
|
| 118 |
-
-
|
| 119 |
-
- **Prompting**: Start simple ("Photo of a woman", "beautiful detailed face") and let the reference images do the heavy lifting for identity.
|
| 120 |
-
- **LoRAs**: The LoRA switch is disabled by default in many workflows. Enable it and point to character or style LoRAs.
|
| 121 |
-
- **Speed vs Quality**: Use `z-image-turbo-t2i.json` for rapid iteration, then switch to Flux2-Klein for final outputs.
|
| 122 |
-
- **Upscaling**: Always run important generations through `seedvr2-i2i.json` for that extra polish.
|
| 123 |
-
- **Dataset Quality**: Use the dataset generator + good reference images + Ollama captions, then manually review the `validation_report`.
|
| 124 |
|
| 125 |
-
|
|
|
|
| 126 |
|
| 127 |
-
|
| 128 |
|
| 129 |
-
|
| 130 |
|
| 131 |
---
|
| 132 |
|
| 133 |
-
##
|
| 134 |
|
| 135 |
-
|
| 136 |
|
| 137 |
---
|
| 138 |
|
| 139 |
**Made with β€οΈ for the ComfyUI community by wizdroid**
|
| 140 |
|
| 141 |
*Consistent characters start with great references and great tools.*
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
|
| 5 |
+
# π ComfyUI Workflows by wizdroid
|
|
|
|
|
|
|
|
|
|
| 6 |
|
| 7 |
**High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
|
| 8 |
|
|
|
|
| 18 |
- **SeedVR2 Upscaler** β One of the best image upscalers available (DiT + VAE with advanced tiling & color correction)
|
| 19 |
- **WizdroidLoRADataset** β Custom node for automated vision-LLM captioning, dataset structuring, and validation β perfect companion for training consistent characters
|
| 20 |
- **LoRA-ready** β Built-in toggleable LoRA loading across most pipelines
|
| 21 |
+
- **Square 1:1 + Flexible Resolutions** β Optimized for character reference work
|
| 22 |
|
| 23 |
+
> **Pro Tip:** Pair these workflows with the **[Consistent Character Reference Prompts (PROMPTS.md)](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)** (40+ square 1:1 variations covering angles, expressions, beauty, upper/full body, and profiles) for unbeatable training data.
|
| 24 |
|
| 25 |
---
|
| 26 |
|
| 27 |
## π Workflows
|
| 28 |
|
| 29 |
+
| Workflow | Type | Key Features | Best For |
|
| 30 |
+
|---------------------------|---------------|---------------------------------------------------|----------|
|
| 31 |
+
| `flux2-klein-t2i.json` | Text-to-Image | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
|
| 32 |
+
| `flux2-klein-1i2i.json` | 1-Image Ref | Single reference image + Reference Latent | Strong character consistency from one photo |
|
| 33 |
+
| `flux2-klein-2i2i.json` | 2-Image Ref | Dual reference images | Even stronger identity with two angles/expressions |
|
| 34 |
+
| `flux2-klein-3i2i.json` | 3-Image Ref | Triple reference images + advanced conditioning | **Maximum character fidelity** (recommended for LoRA training) |
|
| 35 |
+
| `qwen-t2i.json` | Text-to-Image | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
|
| 36 |
+
| `qwen-aio-t2i.json` | Text-to-Image | Qwen All-in-One variant | Quick Qwen generations |
|
| 37 |
+
| `qwen-aio-1i2i.json` | 1-Image Ref | Qwen image reference | Qwen-powered character consistency |
|
| 38 |
+
| `qwen-aio-2i2i.json` | 2-Image Ref | Dual reference | Multi-ref Qwen |
|
| 39 |
+
| `qwen-aio-3i2i.json` | 3-Image Ref | Triple reference | Maximum Qwen consistency |
|
| 40 |
+
| `z-image-turbo-t2i.json` | Fast T2I | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
|
| 41 |
+
| `seedvr2-i2i.json` | Upscaler | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2Γβ4Γ upscaling & detail recovery |
|
| 42 |
+
| `dataset-generator.json` | Dataset Tool | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
|
| 43 |
|
| 44 |
---
|
| 45 |
|
| 46 |
## π οΈ Installation & Setup
|
| 47 |
|
| 48 |
### 1. ComfyUI
|
| 49 |
+
Recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
|
| 50 |
|
| 51 |
### 2. Required Custom Nodes
|
| 52 |
+
Install via **ComfyUI Manager** (recommended):
|
| 53 |
|
| 54 |
+
- **ComfyUI-nunchaku** β Accelerated Flux inference
|
| 55 |
+
- **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx)
|
| 56 |
+
- **Wizdroid Character Dataset Node** (WizdroidLoRADataset and related nodes)
|
| 57 |
|
| 58 |
+
Restart ComfyUI after installing.
|
| 59 |
|
| 60 |
### 3. Models
|
| 61 |
+
Place in standard ComfyUI folders:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
+
- **Flux2-Klein**: `flux/2/flux2-klein-9B.safetensors` + VAE
|
| 64 |
+
- **Qwen** models (as referenced in workflows)
|
| 65 |
+
- **Z-Image-Turbo** + turbo LoRAs
|
| 66 |
+
- **SeedVR2**: `seedvr2_ema_7b_sharp_fp16.safetensors` + VAE
|
|
|
|
| 67 |
|
| 68 |
+
### 4. Ollama (Dataset Generator)
|
| 69 |
```bash
|
|
|
|
| 70 |
ollama pull moondream:latest
|
| 71 |
+
ollama serve
|
| 72 |
```
|
| 73 |
|
|
|
|
|
|
|
| 74 |
---
|
| 75 |
|
| 76 |
## π How to Use
|
| 77 |
|
| 78 |
+
1. Drag & drop any `.json` workflow onto ComfyUI.
|
| 79 |
+
2. Use the clean proxy widgets for prompt, seed, steps, LoRA toggle, and reference images.
|
| 80 |
+
3. For **character consistency**, load prompts from **[PROMPTS.md](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)** into the 1i2i/2i2i/3i2i workflows.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 81 |
|
| 82 |
+
**Recommended for LoRA training data:** `flux2-klein-3i2i.json` + 2β3 clean source references + the 40 reference prompts.
|
| 83 |
|
| 84 |
+
Then run `dataset-generator.json` to auto-caption and structure everything with your trigger word.
|
|
|
|
|
|
|
| 85 |
|
| 86 |
---
|
| 87 |
|
| 88 |
+
## π‘ Full Guide: Mastering Consistent Characters
|
| 89 |
|
| 90 |
+
For the complete step-by-step tutorial (problem β solution β pipeline with these workflows + PROMPTS.md + WizdroidLoRADataset β pro tips), see the dedicated CivitAI article:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 91 |
|
| 92 |
+
**β [Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/...)**
|
| 93 |
+
*(Replace with the real link after publishing the article on CivitAI)*
|
| 94 |
|
| 95 |
+
It covers why single-ref fails, how Reference Latent + the 40 square prompts solve identity drift, generating 40β100+ training images, auto-captioning with the custom node, and training best practices.
|
| 96 |
|
| 97 |
+
This short README is the HF model card version. The full rich version is in the local `README.md`.
|
| 98 |
|
| 99 |
---
|
| 100 |
|
| 101 |
+
## π License
|
| 102 |
|
| 103 |
+
MIT β use, modify, and share freely.
|
| 104 |
|
| 105 |
---
|
| 106 |
|
| 107 |
**Made with β€οΈ for the ComfyUI community by wizdroid**
|
| 108 |
|
| 109 |
*Consistent characters start with great references and great tools.*
|
| 110 |
+
|
| 111 |
+
---
|
| 112 |
+
|
| 113 |
+
**Additional Resources**
|
| 114 |
+
- [PROMPTS.md β 40 Consistent Character Reference Prompts](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)
|
| 115 |
+
- Full workflows and updates in this repository
|