Instructions to use 8BitStudio/Aniimage-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use 8BitStudio/Aniimage-1 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("8BitStudio/Aniimage-1", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Fixed typos and formatting issues, and corrected the parameter count.
Browse filesFixed some typos and corrected formatting, as well as fixed the parameter account to 443.3M, there were also two places with conflicting parameter numbers, both of which were incorrect
README.md
CHANGED
|
@@ -16,7 +16,7 @@ language:
|
|
| 16 |
# Aniimage-1
|
| 17 |
|
| 18 |
Aniimage-1 is the first latent diffusion model developed by 8BitStudio.
|
| 19 |
-
The model is a 256x256 anime image generation model trained from scratch using a UNet + VAE + CLIP architecture at
|
| 20 |
Aniimage-1 has been trained on 830,001 anime images from [Danbooru](https://danbooru.donmai.us/). It is not based on any existing models, the UNet is trained from scratch.
|
| 21 |
|
| 22 |
## Model Details
|
|
@@ -25,12 +25,12 @@ Aniimage-1 has been trained on 830,001 anime images from [Danbooru](https://danb
|
|
| 25 |
|---|---|
|
| 26 |
| **Resolution** | 256×256 |
|
| 27 |
| **Architecture** | Latent Diffusion (UNet + VAE + CLIP) |
|
| 28 |
-
| **Parameters** |
|
| 29 |
| **Training Steps** | 88,000 |
|
| 30 |
| **Batch Size** | 64 |
|
| 31 |
| **Dataset** | ~830K curated anime images from Danbooru |
|
| 32 |
| **GPU** | NVIDIA RTX 5060 Ti 16GB |
|
| 33 |
-
| **Scheduler** | DDIM or DPM
|
| 34 |
|
| 35 |
## Requirements
|
| 36 |
|
|
@@ -45,15 +45,15 @@ Aniimage-1 has been trained on 830,001 anime images from [Danbooru](https://danb
|
|
| 45 |
|
| 46 |
[](https://huggingface.co/8BitStudio/Aniimage-1/resolve/main/generate_hf.py)
|
| 47 |
|
| 48 |
-
|
| 49 |
|
| 50 |
```bash
|
| 51 |
pip install torch torchvision diffusers transformers safetensors pillow huggingface_hub
|
| 52 |
python generate_hf.py
|
| 53 |
```
|
| 54 |
|
| 55 |
-
|
| 56 |
-
|
| 57 |
text, signature, washed out, flat colors, manga panel, disfigured, poorly drawn, jpeg artifacts, cropped, out of frame"
|
| 58 |
|
| 59 |
## Prompting
|
|
@@ -78,7 +78,7 @@ Long prompts and enhanced prompts usually result in worse overall results. Try t
|
|
| 78 |
|
| 79 |
- 256×256 resolution — fine details like hands and small features can be rough
|
| 80 |
- Faces can sometimes look similar or 'melty' across different prompts
|
| 81 |
-
- Little to
|
| 82 |
- Does worse when generating men due to dataset bias
|
| 83 |
|
| 84 |
|
|
@@ -119,7 +119,7 @@ When using plain English text, you are much less likely to experience this issue
|
|
| 119 |
|
| 120 |
**[Aniimage-2](https://huggingface.co/8BitStudio/Aniimage-2) is complete!**
|
| 121 |
|
| 122 |
-
It features a native resolution of 512×512 and was trained on 1.2 million unique images, compared with the 830,
|
| 123 |
|
| 124 |
Aniimage-2 also switches from Aniimage-1’s epsilon-prediction objective to v-prediction and uses a zero-terminal signal-to-noise ratio.
|
| 125 |
It also uses uniform timestep sampling, while the upcoming Aniimage-3 will adopt logit-normal noise-level sampling as part of its flow-matching objective.
|
|
|
|
| 16 |
# Aniimage-1
|
| 17 |
|
| 18 |
Aniimage-1 is the first latent diffusion model developed by 8BitStudio.
|
| 19 |
+
The model is a 256x256 anime image generation model trained from scratch using a UNet + VAE + CLIP architecture at 433.37 million parameters.
|
| 20 |
Aniimage-1 has been trained on 830,001 anime images from [Danbooru](https://danbooru.donmai.us/). It is not based on any existing models, the UNet is trained from scratch.
|
| 21 |
|
| 22 |
## Model Details
|
|
|
|
| 25 |
|---|---|
|
| 26 |
| **Resolution** | 256×256 |
|
| 27 |
| **Architecture** | Latent Diffusion (UNet + VAE + CLIP) |
|
| 28 |
+
| **Parameters** | 433.37M |
|
| 29 |
| **Training Steps** | 88,000 |
|
| 30 |
| **Batch Size** | 64 |
|
| 31 |
| **Dataset** | ~830K curated anime images from Danbooru |
|
| 32 |
| **GPU** | NVIDIA RTX 5060 Ti 16GB |
|
| 33 |
+
| **Scheduler** | DDIM or DPM++ 2M |
|
| 34 |
|
| 35 |
## Requirements
|
| 36 |
|
|
|
|
| 45 |
|
| 46 |
[](https://huggingface.co/8BitStudio/Aniimage-1/resolve/main/generate_hf.py)
|
| 47 |
|
| 48 |
+
After downloading, install the dependencies.
|
| 49 |
|
| 50 |
```bash
|
| 51 |
pip install torch torchvision diffusers transformers safetensors pillow huggingface_hub
|
| 52 |
python generate_hf.py
|
| 53 |
```
|
| 54 |
|
| 55 |
+
Recommended settings: Scheduler on DPM++ 2M with 25 steps and a CFG of 7.5. If you are using Euler, 30 steps and 5 CFG works the best.
|
| 56 |
+
Recommended negative prompt: "low quality, ugly, blurry, distorted, deformed, bad anatomy, bad proportions, extra limbs, missing limbs, watermark,
|
| 57 |
text, signature, washed out, flat colors, manga panel, disfigured, poorly drawn, jpeg artifacts, cropped, out of frame"
|
| 58 |
|
| 59 |
## Prompting
|
|
|
|
| 78 |
|
| 79 |
- 256×256 resolution — fine details like hands and small features can be rough
|
| 80 |
- Faces can sometimes look similar or 'melty' across different prompts
|
| 81 |
+
- Little to no NSFW content — trained on mostly SFW dataset only
|
| 82 |
- Does worse when generating men due to dataset bias
|
| 83 |
|
| 84 |
|
|
|
|
| 119 |
|
| 120 |
**[Aniimage-2](https://huggingface.co/8BitStudio/Aniimage-2) is complete!**
|
| 121 |
|
| 122 |
+
It features a native resolution of 512×512 and was trained on 1.2 million unique images, compared with the 830,001 images used to train Aniimage-1.
|
| 123 |
|
| 124 |
Aniimage-2 also switches from Aniimage-1’s epsilon-prediction objective to v-prediction and uses a zero-terminal signal-to-noise ratio.
|
| 125 |
It also uses uniform timestep sampling, while the upcoming Aniimage-3 will adopt logit-normal noise-level sampling as part of its flow-matching objective.
|