Text-to-Image
Diffusers
Safetensors
StableDiffusionPipeline
stable-diffusion
stable-diffusion-diffusers
textual_inversion
diffusers-training
Instructions to use aiwithi/Story_Generation with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use aiwithi/Story_Generation with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stable-diffusion-v1-5/stable-diffusion-v1-5", dtype=torch.bfloat16, device_map="cuda") pipe.load_textual_inversion("aiwithi/Story_Generation") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
|
Download diffusers/docs/source/en/api/quantization.md from aiwithi/Story_Generation: direct link, hf CLI and curl.
- Browser
- Download file 1.49 kB
-
https://huggingface.co/aiwithi/Story_Generation/resolve/main/diffusers/docs/source/en/api/quantization.md
- Command line
-
hf download hf://aiwithi/Story_Generation/diffusers/docs/source/en/api/quantization.md
-
curl -L -o quantization.md https://huggingface.co/aiwithi/Story_Generation/resolve/main/diffusers/docs/source/en/api/quantization.md
1.49 kB
Quantization
Quantization techniques reduce memory and computational costs by representing weights and activations with lower-precision data types like 8-bit integers (int8). This enables loading larger models you normally wouldn't be able to fit into memory, and speeding up inference. Diffusers supports 8-bit and 4-bit quantization with bitsandbytes.
Quantization techniques that aren't supported in Transformers can be added with the [DiffusersQuantizer] class.
Learn how to quantize models in the Quantization guide.
BitsAndBytesConfig
[[autodoc]] BitsAndBytesConfig
GGUFQuantizationConfig
[[autodoc]] GGUFQuantizationConfig
QuantoConfig
[[autodoc]] QuantoConfig
TorchAoConfig
[[autodoc]] TorchAoConfig
DiffusersQuantizer
[[autodoc]] quantizers.base.DiffusersQuantizer