Instructions to use aiwithi/Story_Generation with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use aiwithi/Story_Generation with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stable-diffusion-v1-5/stable-diffusion-v1-5", dtype=torch.bfloat16, device_map="cuda") pipe.load_textual_inversion("aiwithi/Story_Generation") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Download diffusers/docs/source/en/quantization/overview.md from aiwithi/Story_Generation: direct link, hf CLI and curl.
- Browser
- Download file 2.18 kB
-
https://huggingface.co/aiwithi/Story_Generation/resolve/main/diffusers/docs/source/en/quantization/overview.md
- Command line
-
hf download hf://aiwithi/Story_Generation/diffusers/docs/source/en/quantization/overview.md
-
curl -L -o overview.md https://huggingface.co/aiwithi/Story_Generation/resolve/main/diffusers/docs/source/en/quantization/overview.md
Quantization
Quantization techniques focus on representing data with less information while also trying to not lose too much accuracy. This often means converting a data type to represent the same information with fewer bits. For example, if your model weights are stored as 32-bit floating points and they're quantized to 16-bit floating points, this halves the model size which makes it easier to store and reduces memory-usage. Lower precision can also speedup inference because it takes less time to perform calculations with fewer bits.
Interested in adding a new quantization method to Diffusers? Refer to the Contribute new quantization method guide to learn more about adding a new quantization method.
If you are new to the quantization field, we recommend you to check out these beginner-friendly courses about quantization in collaboration with DeepLearning.AI:
When to use what?
Diffusers currently supports the following quantization methods.
This resource provides a good overview of the pros and cons of different quantization techniques.