Instructions to use KumaTea/twitter-int8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KumaTea/twitter-int8 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="KumaTea/twitter-int8", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("KumaTea/twitter-int8", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Adding `safetensors` variant of this model (#1)
Verified signature- Adding `safetensors` variant of this model (f8774af256907585563091eb14011fd059b78602) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>a300435
-
sync from upstream
1136001
-
Add int8 model
693e7b1 -
initial commit
d46d0e4