Instructions to use ruikangliu/FlatQuant with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ruikangliu/FlatQuant with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="ruikangliu/FlatQuant")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ruikangliu/FlatQuant", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Add pipeline tag and library name; include extended description from Github README (#1)
Verified signature- Add pipeline tag and library name; include extended description from Github README (39c26086b8387d0f871d7c2b0b19783414e6203d) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>cb4929b
-
Update README.md
ruikang liuVerified signature4133e63 -
Update README.md
ruikang liuVerified signature556dd7a -
Update README.md
ruikang liuVerified signaturefed6b67 -
Initial commit
bb08c6d -
initial commit
ruikang liuVerified signatureeb35c43