wizdroid commited on
Commit
86a0404
Β·
verified Β·
1 Parent(s): b80b316

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -78
README.md CHANGED
@@ -1,9 +1,8 @@
1
- # πŸš€ ComfyUI Workflows by wizdroid
 
 
2
 
3
- [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
4
- [![ComfyUI](https://img.shields.io/badge/ComfyUI-Workflows-blue)](https://github.com/comfyanonymous/ComfyUI)
5
- [![Flux](https://img.shields.io/badge/Flux-Accelerated-orange)](https://blackforestlabs.ai/)
6
- [![Nunchaku](https://img.shields.io/badge/Nunchaku-Fast%20Inference-purple)](https://github.com/nunchaku-tech)
7
 
8
  **High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
9
 
@@ -19,123 +18,98 @@ These workflows power consistent character generation, multi-reference image-to-
19
  - **SeedVR2 Upscaler** β€” One of the best image upscalers available (DiT + VAE with advanced tiling & color correction)
20
  - **WizdroidLoRADataset** β€” Custom node for automated vision-LLM captioning, dataset structuring, and validation β€” perfect companion for training consistent characters
21
  - **LoRA-ready** β€” Built-in toggleable LoRA loading across most pipelines
22
- - **Square 1:1 + Flexible Resolutions** β€” Optimized for character reference work and social media / print use cases
23
 
24
- > **Pro Tip:** Pair these workflows with the [Consistent Character Reference Prompts](https://github.com/wizdroid/comfyui-workflows) (40+ square 1:1 variations covering angles, expressions, beauty, upper/full body, and profiles) for unbeatable training data.
25
 
26
  ---
27
 
28
  ## πŸ“ Workflows
29
 
30
- | Workflow | Type | Size | Key Features | Best For |
31
- |---------------------------|---------------|---------|---------------------------------------------------|----------|
32
- | `flux2-klein-t2i.json` | Text-to-Image | ~23 MB | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
33
- | `flux2-klein-1i2i.json` | 1-Image Ref | ~29 MB | Single reference image + Reference Latent | Strong character consistency from one photo |
34
- | `flux2-klein-2i2i.json` | 2-Image Ref | ~35 MB | Dual reference images | Even stronger identity with two angles/expressions |
35
- | `flux2-klein-3i2i.json` | 3-Image Ref | ~41 MB | Triple reference images + advanced conditioning | Maximum character fidelity (recommended for LoRA training) |
36
- | `qwen-t2i.json` | Text-to-Image | ~14 MB | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
37
- | `qwen-aio-t2i.json` | Text-to-Image | ~12 MB | Qwen All-in-One variant | Quick Qwen generations |
38
- | `qwen-aio-1i2i.json` | 1-Image Ref | ~14 MB | Qwen image reference | Qwen-powered character consistency |
39
- | `qwen-aio-2i2i.json` | 2-Image Ref | ~15 MB | Dual reference | Multi-ref Qwen |
40
- | `qwen-aio-3i2i.json` | 3-Image Ref | ~16 MB | Triple reference | Maximum Qwen consistency |
41
- | `z-image-turbo-t2i.json` | Fast T2I | ~18 MB | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
42
- | `seedvr2-i2i.json` | Upscaler | ~13 MB | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2×–4Γ— upscaling & detail recovery |
43
- | `dataset-generator.json` | Dataset Tool | ~3 MB | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
44
 
45
  ---
46
 
47
  ## πŸ› οΈ Installation & Setup
48
 
49
  ### 1. ComfyUI
50
- Make sure you have a recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
51
 
52
  ### 2. Required Custom Nodes
53
- Install these via **ComfyUI Manager** (recommended) or git clone into `custom_nodes/`:
54
 
55
- - **ComfyUI-nunchaku** β€” For accelerated Flux inference
56
- - **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx) β€” For the SeedVR2 upscaler workflow
57
- - **Wizdroid Character Dataset Node** β€” The custom `WizdroidLoRADataset` node (included in this repo's ecosystem)
58
 
59
- Restart ComfyUI after installing custom nodes.
60
 
61
  ### 3. Models
62
- Place models in the standard ComfyUI folders (or update paths inside workflows):
63
-
64
- **Flux2-Klein (main quality engine):**
65
- - `flux/2/flux2-klein-9B.safetensors`
66
- - `flux/2/vae.safetensors`
67
-
68
- **Qwen:**
69
- - `qwen/qwen-image-edit-sfw.safetensors`
70
- - `qwen/qwen3-8B.safetensors` (or 4B variant)
71
- - `qwen/qwen3-4B.safetensors`
72
-
73
- **Z-Image Turbo:**
74
- - `z-image/z-image-turbo.safetensors`
75
- - `z-image/vae.safetensors`
76
- - `z-image/turbo/4nup4m4.safetensors` (example turbo LoRA)
77
-
78
- **SeedVR2:**
79
- - `seedvr2_ema_7b_sharp_fp16.safetensors` (DiT)
80
- - `ema_vae_fp16.safetensors` (VAE)
81
 
82
- **CLIP / Other:**
83
- - Various Qwen CLIP models as referenced in the workflows
84
-
85
- ### 4. Ollama (for Dataset Generator)
86
- The `dataset-generator.json` workflow uses a local vision model via Ollama:
87
 
 
88
  ```bash
89
- # Install Ollama and pull a good vision model (Moondream recommended in the workflow)
90
  ollama pull moondream:latest
 
91
  ```
92
 
93
- Start Ollama (`ollama serve`) before running the dataset workflow. You can change the model/URL inside the node.
94
-
95
  ---
96
 
97
  ## πŸš€ How to Use
98
 
99
- 1. **Load a workflow**: Drag & drop any `.json` file directly onto your ComfyUI canvas, or use **Load** β†’ select the file.
100
- 2. **Queue Prompt** as usual.
101
- 3. Most workflows expose clean proxy widgets on the right for:
102
- - Prompt / negative prompt
103
- - Seed, steps, CFG, sampler
104
- - Width / Height
105
- - LoRA toggle + strength
106
- - Reference images (for i2i workflows)
107
 
108
- ### Character Consistency Workflow Recommendations
109
 
110
- - Use **flux2-klein-3i2i.json** (or 2i2i) with 2–3 high-quality, varied reference photos of your character.
111
- - Generate using the same character across many angles/expressions using the reference prompts collection.
112
- - Feed the resulting images into `dataset-generator.json` to auto-caption and structure a ready-to-train dataset (with your character trigger tag).
113
 
114
  ---
115
 
116
- ## πŸ’‘ Tips for Best Results
117
 
118
- - **Reference Images**: Clean, well-lit, minimal makeup/jewelry/background. Square 1:1 references work great.
119
- - **Prompting**: Start simple ("Photo of a woman", "beautiful detailed face") and let the reference images do the heavy lifting for identity.
120
- - **LoRAs**: The LoRA switch is disabled by default in many workflows. Enable it and point to character or style LoRAs.
121
- - **Speed vs Quality**: Use `z-image-turbo-t2i.json` for rapid iteration, then switch to Flux2-Klein for final outputs.
122
- - **Upscaling**: Always run important generations through `seedvr2-i2i.json` for that extra polish.
123
- - **Dataset Quality**: Use the dataset generator + good reference images + Ollama captions, then manually review the `validation_report`.
124
 
125
- ---
 
126
 
127
- ## πŸ“œ License
128
 
129
- MIT License β€” feel free to use, modify, and share these workflows.
130
 
131
  ---
132
 
133
- ## 🀝 Contributing
134
 
135
- Pull requests and workflow improvements are welcome! If you create amazing results with these, tag **@wizdroid** β€” I'd love to see what you build.
136
 
137
  ---
138
 
139
  **Made with ❀️ for the ComfyUI community by wizdroid**
140
 
141
  *Consistent characters start with great references and great tools.*
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
 
5
+ # πŸš€ ComfyUI Workflows by wizdroid
 
 
 
6
 
7
  **High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
8
 
 
18
  - **SeedVR2 Upscaler** β€” One of the best image upscalers available (DiT + VAE with advanced tiling & color correction)
19
  - **WizdroidLoRADataset** β€” Custom node for automated vision-LLM captioning, dataset structuring, and validation β€” perfect companion for training consistent characters
20
  - **LoRA-ready** β€” Built-in toggleable LoRA loading across most pipelines
21
+ - **Square 1:1 + Flexible Resolutions** β€” Optimized for character reference work
22
 
23
+ > **Pro Tip:** Pair these workflows with the **[Consistent Character Reference Prompts (PROMPTS.md)](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)** (40+ square 1:1 variations covering angles, expressions, beauty, upper/full body, and profiles) for unbeatable training data.
24
 
25
  ---
26
 
27
  ## πŸ“ Workflows
28
 
29
+ | Workflow | Type | Key Features | Best For |
30
+ |---------------------------|---------------|---------------------------------------------------|----------|
31
+ | `flux2-klein-t2i.json` | Text-to-Image | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
32
+ | `flux2-klein-1i2i.json` | 1-Image Ref | Single reference image + Reference Latent | Strong character consistency from one photo |
33
+ | `flux2-klein-2i2i.json` | 2-Image Ref | Dual reference images | Even stronger identity with two angles/expressions |
34
+ | `flux2-klein-3i2i.json` | 3-Image Ref | Triple reference images + advanced conditioning | **Maximum character fidelity** (recommended for LoRA training) |
35
+ | `qwen-t2i.json` | Text-to-Image | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
36
+ | `qwen-aio-t2i.json` | Text-to-Image | Qwen All-in-One variant | Quick Qwen generations |
37
+ | `qwen-aio-1i2i.json` | 1-Image Ref | Qwen image reference | Qwen-powered character consistency |
38
+ | `qwen-aio-2i2i.json` | 2-Image Ref | Dual reference | Multi-ref Qwen |
39
+ | `qwen-aio-3i2i.json` | 3-Image Ref | Triple reference | Maximum Qwen consistency |
40
+ | `z-image-turbo-t2i.json` | Fast T2I | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
41
+ | `seedvr2-i2i.json` | Upscaler | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2×–4Γ— upscaling & detail recovery |
42
+ | `dataset-generator.json` | Dataset Tool | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
43
 
44
  ---
45
 
46
  ## πŸ› οΈ Installation & Setup
47
 
48
  ### 1. ComfyUI
49
+ Recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
50
 
51
  ### 2. Required Custom Nodes
52
+ Install via **ComfyUI Manager** (recommended):
53
 
54
+ - **ComfyUI-nunchaku** β€” Accelerated Flux inference
55
+ - **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx)
56
+ - **Wizdroid Character Dataset Node** (WizdroidLoRADataset and related nodes)
57
 
58
+ Restart ComfyUI after installing.
59
 
60
  ### 3. Models
61
+ Place in standard ComfyUI folders:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
 
63
+ - **Flux2-Klein**: `flux/2/flux2-klein-9B.safetensors` + VAE
64
+ - **Qwen** models (as referenced in workflows)
65
+ - **Z-Image-Turbo** + turbo LoRAs
66
+ - **SeedVR2**: `seedvr2_ema_7b_sharp_fp16.safetensors` + VAE
 
67
 
68
+ ### 4. Ollama (Dataset Generator)
69
  ```bash
 
70
  ollama pull moondream:latest
71
+ ollama serve
72
  ```
73
 
 
 
74
  ---
75
 
76
  ## πŸš€ How to Use
77
 
78
+ 1. Drag & drop any `.json` workflow onto ComfyUI.
79
+ 2. Use the clean proxy widgets for prompt, seed, steps, LoRA toggle, and reference images.
80
+ 3. For **character consistency**, load prompts from **[PROMPTS.md](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)** into the 1i2i/2i2i/3i2i workflows.
 
 
 
 
 
81
 
82
+ **Recommended for LoRA training data:** `flux2-klein-3i2i.json` + 2–3 clean source references + the 40 reference prompts.
83
 
84
+ Then run `dataset-generator.json` to auto-caption and structure everything with your trigger word.
 
 
85
 
86
  ---
87
 
88
+ ## πŸ’‘ Full Guide: Mastering Consistent Characters
89
 
90
+ For the complete step-by-step tutorial (problem β†’ solution β†’ pipeline with these workflows + PROMPTS.md + WizdroidLoRADataset β†’ pro tips), see the dedicated CivitAI article:
 
 
 
 
 
91
 
92
+ **β†’ [Mastering Consistent Characters for LoRA Training](https://civitai.com/articles/...)**
93
+ *(Replace with the real link after publishing the article on CivitAI)*
94
 
95
+ It covers why single-ref fails, how Reference Latent + the 40 square prompts solve identity drift, generating 40–100+ training images, auto-captioning with the custom node, and training best practices.
96
 
97
+ This short README is the HF model card version. The full rich version is in the local `README.md`.
98
 
99
  ---
100
 
101
+ ## πŸ“œ License
102
 
103
+ MIT β€” use, modify, and share freely.
104
 
105
  ---
106
 
107
  **Made with ❀️ for the ComfyUI community by wizdroid**
108
 
109
  *Consistent characters start with great references and great tools.*
110
+
111
+ ---
112
+
113
+ **Additional Resources**
114
+ - [PROMPTS.md β€” 40 Consistent Character Reference Prompts](https://huggingface.co/wizdroid/comfyui-workflows/blob/main/PROMPTS.md)
115
+ - Full workflows and updates in this repository