Instructions to use TheBloke/MPT-7B-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/MPT-7B-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/MPT-7B-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
b489780 -
Update README.md
fd0f507
-
Update README.md
fcedb10
-
Update README.md
a91c092 -
Update README.md
95cafa3 -
Create config.json (#3)
- Create config.json (a442f1ebdc854b084b7a42078367bef6e4c69a8b) Co-authored-by: Ravindra Marella <marella@users.noreply.huggingface.co>ce7dbce
-
Updating model files
4101beb
-
Update README.md
2ace5fe
-
Update README.md
fa8acce -
Update README.md
b8b648b -
Update README.md
41d2a48
-
Delete mpt-7b.ggmlv2.q8_0.bin
bde0031 -
Delete mpt-7b.ggmlv2.q5_1.bin
ee09313 -
Delete mpt-7b.ggmlv2.q5_0.bin
d4b9bb6 -
Delete mpt-7b.ggmlv2.q4_1.bin
7f66f07 -
Delete mpt-7b.ggmlv2.q4_0.bin
48d09d8 -
Delete mpt-7b.ggmlv2.fp16.bin
186f3b3 -
Update GGML models for latest ggml commit with ggml version included.
00e9583 -
Update GGML models for latest ggml commit with ggml version included.
811a243 -
Update GGML models for latest ggml commit with ggml version included.
8e3088d -
Update GGML models for latest ggml commit with ggml version included.
5896792 -
Update GGML models for latest ggml commit with ggml version included.
4e5e098 -
Update GGML models for latest ggml commit with ggml version included.
72275fc -
Update GGML models for latest ggml commit with ggml version included.
76c9977 -
Update GGML models for latest ggml commit with ggml version included.
667ea0e
-
Update README.md
111dfc1
-
Update README.md
e4f226b -
Update README.md
1bb5f0c -
Rename mpt7b.ggmlv2.q8_0.bin to mpt-7b.ggmlv2.q8_0.bin
6f4762b -
Rename mpt7b.ggmlv2.q5_1.bin to mpt-7b.ggmlv2.q5_1.bin
1c4d2ae -
Rename mpt7b.ggmlv2.q5_0.bin to mpt-7b.ggmlv2.q5_0.bin
401eb80 -
Rename mpt7b.ggmlv2.q4_1.bin to mpt-7b.ggmlv2.q4_1.bin
e1729ea -
Rename mpt7b.ggmlv2.q4_0.bin to mpt-7b.ggmlv2.q4_0.bin
b08ad02 -
Rename mpt7b.ggmlv2.fp16.bin to mpt-7b.ggmlv2.fp16.bin
74d1234 -
Update README.md
fda6023 -
Update README.md
476fe08 -
Update README.md
2c3ec09 -
Update README.md
0175b94 -
First commit of MPT7B GGML model files
16f282c -
First commit of MPT7B GGML model files
7ef74c3 -
First commit of MPT7B GGML model files
c015951 -
First commit of MPT7B GGML model files
7000f9a -
First commit of MPT7B GGML model files
77e2f59 -
First commit of MPT7B GGML model files
9872d6c -
First commit of MPT7B GGML model files
5bb48d3 -
initial commit
95eb981