| --- |
| library_name: diffusers |
| license: apache-2.0 |
| base_model: |
| - neta-art/Neta-Lumina |
| tags: |
| - diffusers, |
| - text-to-image |
| --- |
| |
| # Neta Lumina v1.0 for diffusers library |
|
|
| [**Neta Lumina Tech Report**](https://neta.art/blog/neta_lumina/) |
|
|
| ## 📽️ Flash Preview |
|
|
| <video controls autoplay loop muted playsinline style="max-width:100%; border-radius:8px;"> |
| <source src="https://pages-r2.neta.art/Neta_Lumina_Flash_PV.webm" type="video/webm" /> |
| Your browser does not support the video tag. |
| </video> |
|
|
| # Introduction |
|
|
| **Neta Lumina** is a high‑quality anime‑style image‑generation model developed by Neta.art Lab. |
| Building on the open‑source **Lumina‑Image‑2.0** released by the Alpha‑VLLM team at Shanghai AI Laboratory, we fine‑tuned the model with a vast corpus of high‑quality anime images and multilingual tag data. The preliminary result is a compelling model with powerful comprehension and interpretation abilities (thanks to Gemma text encoder), ideal for illustration, posters, storyboards, character design, and more. |
|
|
| ## Key Features |
|
|
| - Optimized for diverse creative scenarios such as Furry, Guofeng (traditional‑Chinese aesthetics), pets, etc. |
| - Wide coverage of characters and styles, from popular to niche concepts. (Still support danbooru tags!) |
| - Accurate natural‑language understanding with excellent adherence to complex prompts. |
| - Native multilingual support, with Chinese, English, and Japanese recommended first. |
|
|
| ## Model Versions |
|
|
| For models in alpha tests, requst access at https://huggingface.co/neta-art/NetaLumina_Alpha if you are interested. We will keep updating. |
| |
| ### neta-lumina-v1.0 |
| |
| - **Official Release**: overall best performance |
| |
| |
| ### neta-lumina-beta-0624-raw (archived) |
| |
| - **Primary Goal**: General knowledge and anime‑style optimization |
| - **Data Set**: >13 million anime‑style images |
| - **>46,000** A100 Hours |
| - Higher upper limit, suitable for pro users. Check [**Neta Lumina Prompt Book**](https://nieta-art.feishu.cn/wiki/RY3GwpT59icIQlkWXEfcCqIMnQd) for better results. |
| |
| ### neta-lumina-beta-0624-aes-experimental (archived) |
| |
| - First beta release candidate |
| - **Primary Goal**: Enhanced aesthetics, pose accuracy, and scene detail |
| - **Data Set**: Hundreds of thousands of handpicked high‑quality anime images (fine‑tuned on an older version of raw model) |
| - User-friendly, suitable for most people. |
| <br> |
| |
| # How to Use |
| |
| [Try it at Hugging Face playground](https://huggingface.co/spaces/neta-art/NetaLumina_T2I_Playground) |
| |
| ## Or use it with diffusers: |
| ```python |
| import torch |
| from diffusers import Lumina2Pipeline |
| |
| pipe = Lumina2Pipeline.from_pretrained("VirtualAddressExtension/Neta-Lumina-v1.0-diffusers", torch_dtype=torch.bfloat16) |
| pipe.enable_model_cpu_offload() #save some VRAM by offloading the model to CPU. Remove this if you have enough GPU power |
|
|
| prompt = "You are an assistant designed to generate anime images based on textual prompts. <Prompt Start> neta, @quasarcake, 1girl, solo, 1girl,solo,bangs,black hair,purple eyes,pink hair,purple hair,multicolored hair,virtual youtuber,hair bun,streaked hair,double bun, school uniform, white shirt, pleated skirt, gentle smile, looking at viewer, sitting, upper body, close-up, soft lighting, depth of field, cherry blossom background, warm lighting, best quality" |
| image = pipe( |
| prompt, |
| height=1024, |
| width=1024, |
| guidance_scale=4.0, |
| num_inference_steps=50, |
| cfg_trunc_ratio=0.25, |
| cfg_normalization=True, |
| generator=torch.Generator("cpu").manual_seed(0) |
| ).images[0] |
| image.save("lumina_demo.png") |
| ``` |
| |
| # Prompt Book |
|
|
| Detailed prompt guidelines: [**Neta Lumina Prompt Book**](https://neta.art/blog/neta_lumina_prompt_book/) |
| <br> |
|
|
| # Community |
|
|
| - Discord: https://discord.com/invite/TTTGccjbEa |
| - QQ group: 1039442542 |
| <br> |
|
|
| # Roadmap |
|
|
| ## Model |
|
|
| - Continous base‑model training to raise reasoning capability. |
| - Aesthetic‑dataset iteration to improve anatomy, background richness, and overall appealness. |
| - Smarter, more versatile tagging tools to lower the creative barrier. |
|
|
| ## Ecosystem |
|
|
| - LoRA training tutorials and components |
| - Experienced users may already fine‑tune via Lumina‑Image‑2.0’s open code. |
| - Development of advanced control / style‑consistency features (e.g., [Omini Control](https://arxiv.org/pdf/2411.15098)). [**Call for Collaboration!**](https://discord.com/invite/TTTGccjbEa) |
| <br> |
|
|
| # License & Disclaimer |
|
|
| - Neta Lumina is released under [**Apache License 2.0**](https://www.apache.org/licenses/LICENSE-2.0) |
| <br> |
|
|
| # Participants & Contributors |
|
|
| - Special thanks to the **Alpha‑VLLM** team for open‑sourcing **Lumina‑Image‑2.0** |
| - **Model development**: **Neta.art Lab (Civitai)** |
| - Core Trainer: **li_li** [Civitai](https://civitai.com/user/li_li) ・ [Hugging Face](https://huggingface.co/heziiiii) |
| <br> |
| - **Partners** |
| - **nebulae**: [Civitai](https://civitai.com/user/kitarz) ・ [Hugging Face](https://huggingface.co/NebulaeWis) |
| - **生姜**: [Hugging Face](https://huggingface.co/ssj0021) |
| - **孙一** |
| - [**narugo1992**](https://github.com/narugo1992) & [**deepghs**](https://huggingface.co/deepghs): open datasets, processing tools, and models |
| - [**Naifu**](https://github.com/Mikubill/naifu) trainer at [Mikubill](https://github.com/Mikubill) |
| <br> |
| |
| # Community Contributors |
| |
| - **Evaluators & developers**: [二小姐](https://huggingface.co/Second222), [spawner](https://github.com/spawner1145), [Rnglg2](https://civitai.com/user/Rnglg2) |
| - **Other contributors**: [沉迷摸鱼](https://www.pixiv.net/users/22433944), [poi](https://x.com/poi______1), AshenWitch, [十分无奈](https://www.pixiv.net/users/15750592), [GHOSTLX](https://civitai.com/user/ghostlxh), [wenaka](https://civitai.com/user/Wenaka_), [iiiiii](https://civitai.com/user/Blueberries_i), [年糕特工队](https://x.com/gaonian2331), [恩匹希](https://civitai.com/user/NPCde), 奶冻, [mumu](https://civitai.com/user/mumu520), [yizyin](https://civitai.com/user/yizyin), smile, Yang, 古神, 灵之药, [LyloGummy](https://civitai.com/user/LyloGummy), 雪时 |
| <br> |
| |
| # Appendix & Resources |
| |
| - **TeaCache**: https://github.com/spawner1145/CUI-Lumina2-TeaCache |
| - **Advanced samplers & TeaCache guide (by spawner)**: https://docs.qq.com/doc/DZEFKb1ZrZVZiUmxw?nlc=1 |
| - **Neta Lumina ComfyUI Manual (in Chinese)**: https://docs.qq.com/doc/DZEVQZFdtaERPdXVh |
| |
