Instructions to use tykiww/llama3-8b-quantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tykiww/llama3-8b-quantized with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("tykiww/llama3-8b-quantized", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Commit History
-
Update README.md
Verified signatureed713bb
-
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterba3a2d1 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster42d632e -
Upload README.md with huggingface_hub
Verified signature143b5e0 -
initial commit
Verified signatureb9df941