Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,141 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# π ComfyUI Workflows by wizdroid
|
| 2 |
+
|
| 3 |
+
[](https://opensource.org/licenses/MIT)
|
| 4 |
+
[](https://github.com/comfyanonymous/ComfyUI)
|
| 5 |
+
[](https://blackforestlabs.ai/)
|
| 6 |
+
[](https://github.com/nunchaku-tech)
|
| 7 |
+
|
| 8 |
+
**High-quality, production-ready ComfyUI workflows** focused on **character consistency**, fast generation, and automated dataset creation for LoRA training.
|
| 9 |
+
|
| 10 |
+
These workflows power consistent character generation, multi-reference image-to-image pipelines, lightning-fast turbo inference, state-of-the-art upscaling, and intelligent dataset preparation.
|
| 11 |
+
|
| 12 |
---
|
| 13 |
+
|
| 14 |
+
## β¨ Highlights
|
| 15 |
+
|
| 16 |
+
- **Flux2-Klein Series** β Premium quality with Nunchaku acceleration for blazing fast inference
|
| 17 |
+
- **Multi-Reference i2i (1/2/3 images)** β Industry-leading character identity preservation using Reference Latent injection
|
| 18 |
+
- **Qwen & Z-Image-Turbo** β Versatile text-to-image and fast generation options
|
| 19 |
+
- **SeedVR2 Upscaler** β One of the best image upscalers available (DiT + VAE with advanced tiling & color correction)
|
| 20 |
+
- **WizdroidLoRADataset** β Custom node for automated vision-LLM captioning, dataset structuring, and validation β perfect companion for training consistent characters
|
| 21 |
+
- **LoRA-ready** β Built-in toggleable LoRA loading across most pipelines
|
| 22 |
+
- **Square 1:1 + Flexible Resolutions** β Optimized for character reference work and social media / print use cases
|
| 23 |
+
|
| 24 |
+
> **Pro Tip:** Pair these workflows with the [Consistent Character Reference Prompts](https://github.com/wizdroid/comfyui-workflows) (40+ square 1:1 variations covering angles, expressions, beauty, upper/full body, and profiles) for unbeatable training data.
|
| 25 |
+
|
| 26 |
---
|
| 27 |
+
|
| 28 |
+
## π Workflows
|
| 29 |
+
|
| 30 |
+
| Workflow | Type | Size | Key Features | Best For |
|
| 31 |
+
|---------------------------|---------------|---------|---------------------------------------------------|----------|
|
| 32 |
+
| `flux2-klein-t2i.json` | Text-to-Image | ~23 MB | Nunchaku Flux2-Klein 9B, advanced Flux sampler, LoRA support | High-quality prompt-driven generation |
|
| 33 |
+
| `flux2-klein-1i2i.json` | 1-Image Ref | ~29 MB | Single reference image + Reference Latent | Strong character consistency from one photo |
|
| 34 |
+
| `flux2-klein-2i2i.json` | 2-Image Ref | ~35 MB | Dual reference images | Even stronger identity with two angles/expressions |
|
| 35 |
+
| `flux2-klein-3i2i.json` | 3-Image Ref | ~41 MB | Triple reference images + advanced conditioning | Maximum character fidelity (recommended for LoRA training) |
|
| 36 |
+
| `qwen-t2i.json` | Text-to-Image | ~14 MB | Qwen-based, flexible resolution, LoRA | Alternative aesthetic / artistic control |
|
| 37 |
+
| `qwen-aio-t2i.json` | Text-to-Image | ~12 MB | Qwen All-in-One variant | Quick Qwen generations |
|
| 38 |
+
| `qwen-aio-1i2i.json` | 1-Image Ref | ~14 MB | Qwen image reference | Qwen-powered character consistency |
|
| 39 |
+
| `qwen-aio-2i2i.json` | 2-Image Ref | ~15 MB | Dual reference | Multi-ref Qwen |
|
| 40 |
+
| `qwen-aio-3i2i.json` | 3-Image Ref | ~16 MB | Triple reference | Maximum Qwen consistency |
|
| 41 |
+
| `z-image-turbo-t2i.json` | Fast T2I | ~18 MB | Z-Image-Turbo (very few steps), Nunchaku | Lightning-fast prototyping & iteration |
|
| 42 |
+
| `seedvr2-i2i.json` | Upscaler | ~13 MB | SeedVR2 DiT + VAE upscaler, tiling, color correction | Best-in-class 2Γβ4Γ upscaling & detail recovery |
|
| 43 |
+
| `dataset-generator.json` | Dataset Tool | ~3 MB | WizdroidLoRADataset + Ollama vision (Moondream) | Automated LoRA training dataset creation with captions |
|
| 44 |
+
|
| 45 |
+
---
|
| 46 |
+
|
| 47 |
+
## π οΈ Installation & Setup
|
| 48 |
+
|
| 49 |
+
### 1. ComfyUI
|
| 50 |
+
Make sure you have a recent [ComfyUI](https://github.com/comfyanonymous/ComfyUI) installation.
|
| 51 |
+
|
| 52 |
+
### 2. Required Custom Nodes
|
| 53 |
+
Install these via **ComfyUI Manager** (recommended) or git clone into `custom_nodes/`:
|
| 54 |
+
|
| 55 |
+
- **ComfyUI-nunchaku** β For accelerated Flux inference
|
| 56 |
+
- **ComfyUI-SeedVR2_VideoUpscaler** (ainvfx) β For the SeedVR2 upscaler workflow
|
| 57 |
+
- **Wizdroid Character Dataset Node** β The custom `WizdroidLoRADataset` node (included in this repo's ecosystem)
|
| 58 |
+
|
| 59 |
+
Restart ComfyUI after installing custom nodes.
|
| 60 |
+
|
| 61 |
+
### 3. Models
|
| 62 |
+
Place models in the standard ComfyUI folders (or update paths inside workflows):
|
| 63 |
+
|
| 64 |
+
**Flux2-Klein (main quality engine):**
|
| 65 |
+
- `flux/2/flux2-klein-9B.safetensors`
|
| 66 |
+
- `flux/2/vae.safetensors`
|
| 67 |
+
|
| 68 |
+
**Qwen:**
|
| 69 |
+
- `qwen/qwen-image-edit-sfw.safetensors`
|
| 70 |
+
- `qwen/qwen3-8B.safetensors` (or 4B variant)
|
| 71 |
+
- `qwen/qwen3-4B.safetensors`
|
| 72 |
+
|
| 73 |
+
**Z-Image Turbo:**
|
| 74 |
+
- `z-image/z-image-turbo.safetensors`
|
| 75 |
+
- `z-image/vae.safetensors`
|
| 76 |
+
- `z-image/turbo/4nup4m4.safetensors` (example turbo LoRA)
|
| 77 |
+
|
| 78 |
+
**SeedVR2:**
|
| 79 |
+
- `seedvr2_ema_7b_sharp_fp16.safetensors` (DiT)
|
| 80 |
+
- `ema_vae_fp16.safetensors` (VAE)
|
| 81 |
+
|
| 82 |
+
**CLIP / Other:**
|
| 83 |
+
- Various Qwen CLIP models as referenced in the workflows
|
| 84 |
+
|
| 85 |
+
### 4. Ollama (for Dataset Generator)
|
| 86 |
+
The `dataset-generator.json` workflow uses a local vision model via Ollama:
|
| 87 |
+
|
| 88 |
+
```bash
|
| 89 |
+
# Install Ollama and pull a good vision model (Moondream recommended in the workflow)
|
| 90 |
+
ollama pull moondream:latest
|
| 91 |
+
```
|
| 92 |
+
|
| 93 |
+
Start Ollama (`ollama serve`) before running the dataset workflow. You can change the model/URL inside the node.
|
| 94 |
+
|
| 95 |
+
---
|
| 96 |
+
|
| 97 |
+
## π How to Use
|
| 98 |
+
|
| 99 |
+
1. **Load a workflow**: Drag & drop any `.json` file directly onto your ComfyUI canvas, or use **Load** β select the file.
|
| 100 |
+
2. **Queue Prompt** as usual.
|
| 101 |
+
3. Most workflows expose clean proxy widgets on the right for:
|
| 102 |
+
- Prompt / negative prompt
|
| 103 |
+
- Seed, steps, CFG, sampler
|
| 104 |
+
- Width / Height
|
| 105 |
+
- LoRA toggle + strength
|
| 106 |
+
- Reference images (for i2i workflows)
|
| 107 |
+
|
| 108 |
+
### Character Consistency Workflow Recommendations
|
| 109 |
+
|
| 110 |
+
- Use **flux2-klein-3i2i.json** (or 2i2i) with 2β3 high-quality, varied reference photos of your character.
|
| 111 |
+
- Generate using the same character across many angles/expressions using the reference prompts collection.
|
| 112 |
+
- Feed the resulting images into `dataset-generator.json` to auto-caption and structure a ready-to-train dataset (with your character trigger tag).
|
| 113 |
+
|
| 114 |
+
---
|
| 115 |
+
|
| 116 |
+
## π‘ Tips for Best Results
|
| 117 |
+
|
| 118 |
+
- **Reference Images**: Clean, well-lit, minimal makeup/jewelry/background. Square 1:1 references work great.
|
| 119 |
+
- **Prompting**: Start simple ("Photo of a woman", "beautiful detailed face") and let the reference images do the heavy lifting for identity.
|
| 120 |
+
- **LoRAs**: The LoRA switch is disabled by default in many workflows. Enable it and point to character or style LoRAs.
|
| 121 |
+
- **Speed vs Quality**: Use `z-image-turbo-t2i.json` for rapid iteration, then switch to Flux2-Klein for final outputs.
|
| 122 |
+
- **Upscaling**: Always run important generations through `seedvr2-i2i.json` for that extra polish.
|
| 123 |
+
- **Dataset Quality**: Use the dataset generator + good reference images + Ollama captions, then manually review the `validation_report`.
|
| 124 |
+
|
| 125 |
+
---
|
| 126 |
+
|
| 127 |
+
## π License
|
| 128 |
+
|
| 129 |
+
MIT License β feel free to use, modify, and share these workflows.
|
| 130 |
+
|
| 131 |
+
---
|
| 132 |
+
|
| 133 |
+
## π€ Contributing
|
| 134 |
+
|
| 135 |
+
Pull requests and workflow improvements are welcome! If you create amazing results with these, tag **@wizdroid** β I'd love to see what you build.
|
| 136 |
+
|
| 137 |
+
---
|
| 138 |
+
|
| 139 |
+
**Made with β€οΈ for the ComfyUI community by wizdroid**
|
| 140 |
+
|
| 141 |
+
*Consistent characters start with great references and great tools.*
|