Instructions to use TheBloke/LLaMa-30B-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/LLaMa-30B-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/LLaMa-30B-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Initial GGML model commit
a538032
-
Update README.md
8c7fb5f -
Update README.md
43f6801 -
Update README.md
1345d5a -
Upload new k-quant GGML quantised models.
c62c1d2 -
Upload new k-quant GGML quantised models.
22174c2 -
Upload new k-quant GGML quantised models.
1c4d547 -
Upload new k-quant GGML quantised models.
87c149d -
Upload new k-quant GGML quantised models.
6631538 -
Upload new k-quant GGML quantised models.
81fcfd8 -
Upload new k-quant GGML quantised models.
05b5e36 -
Upload new k-quant GGML quantised models.
9b24db9 -
Upload new k-quant GGML quantised models.
92e0f16 -
Upload new k-quant GGML quantised models.
f79eb01
-
Update README.md
aa8870b
-
Update README.md
ac0efb4 -
Update README.md
4ab8108 -
Update README.md
d634eba -
Create config.json (#1)
- Create config.json (3efdb3e44f1638eca285f6d7ee99dd92b3805b4b) Co-authored-by: Ravindra Marella <marella@users.noreply.huggingface.co>a7710cf
-
Updating model files
a6678a9
-
Remove old GGML file from main branch
acf3223 -
Remove old GGML file from main branch
84cbf04 -
Remove old GGML file from main branch
ef0227c -
Remove old GGML file from main branch
4aff4ab -
Remove old GGML file from main branch
b27cd90 -
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
2109477 -
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
a8f1a78 -
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
ae317b4 -
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
347faf7 -
New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48
fa0eddd
-
Latest GGML v2 format for LLaMa-30B
82d08ce -
initial commit
613c037