Instructions to use maderix/llama-65b-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use maderix/llama-65b-4bit with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("maderix/llama-65b-4bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
7b1be53 -
Update README.md
b97fdb6 -
Create README.md
6515d51
-
Added the Loicense bruv!
efd6696 -
Upload llama13b-4bit.pt with huggingface_hub
0ad2a33 -
Upload llama13b-4bit.pt with huggingface_hub
f6ac372 -
Upload llama13b-4bit.pt with huggingface_hub
0ecfecf -
Upload llama7b-4bit.pt with huggingface_hub
be1e150
-
Upload llama30b-4bit.pt with huggingface_hub
5fdb6e0 -
Upload llama65b-4bit.pt with huggingface_hub
e31fecc -
initial commit
0f10d79