Instructions to use TheBloke/MPT-7B-Instruct-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/MPT-7B-Instruct-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/MPT-7B-Instruct-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Create config.json
By adding this, it will simplify the usage of this model in ctransformers: ```py from ctransformers import AutoModelForCausalLM llm = AutoModelForCausalLM.from_pretrained("TheBloke/MPT-7B-Instruct-GGML") ```e2d9272
-
Updating model files
5f0a3a1
-
Update README.md
b608023
-
Update README.md
137892d -
Update README.md
e27f6f4 -
Update README.md
fd1bf0d
-
Delete mpt-7b-instruct.ggmlv2.q5_1.bin
778bf79 -
Delete mpt-7b-instruct.ggmlv2.q5_0.bin
449845a -
Delete mpt-7b-instruct.ggmlv2.q4_1.bin
9835888 -
Delete mpt-7b-instruct.ggmlv2.fp16.bin
2cfc227 -
Delete mpt-7b-instruct.ggmlv2.q4_0.bin
2aff40a -
Delete mpt-7b-instruct.ggmlv2.q8_0.bin
e1abf31 -
Update GGML models for latest ggml commit with ggml version included.
07631bb -
Update GGML models for latest ggml commit with ggml version included.
1d8993a -
Update GGML models for latest ggml commit with ggml version included.
7661240 -
Update GGML models for latest ggml commit with ggml version included.
1e7e151 -
Update GGML models for latest ggml commit with ggml version included.
71f6a8d -
Update GGML models for latest ggml commit with ggml version included.
fc49814 -
Update GGML models for latest ggml commit with ggml version included.
cd6f055
-
Update README.md
15d85f7
-
Update README.md
156fcc6 -
Update README.md
eb1b380 -
Rename mpt7b-instruct.ggmlv2.q8_0.bin to mpt-7b-instruct.ggmlv2.q8_0.bin
91bae1d -
Rename mpt7b-instruct.ggmlv2.q5_1.bin to mpt-7b-instruct.ggmlv2.q5_1.bin
a7f4789 -
Rename mpt7b-instruct.ggmlv2.q5_0.bin to mpt-7b-instruct.ggmlv2.q5_0.bin
3846520 -
Rename mpt7b-instruct.ggmlv2.q4_1.bin to mpt-7b-instruct.ggmlv2.q4_1.bin
2a83442 -
Rename mpt7b-instruct.ggmlv2.q4_0.bin to mpt-7b-instruct.ggmlv2.q4_0.bin
9ed3764 -
Rename mpt7b-instruct.ggmlv2.fp16.bin to mpt-7b-instruct.ggmlv2.fp16.bin
e199da9 -
Update README.md
72fdf6c -
Update README.md
73f00d0 -
Update README.md
9f6adfa -
Update README.md
846c988 -
First GGML model commit.
992655b -
First GGML model commit.
2643fef -
First commit of MPT7B-Instruct GGML model files
fa09f8c -
First GGML model commit.
291d35c -
First GGML model commit.
a71d41e -
First GGML model commit.
8c7e635 -
First GGML model commit.
6c6462d -
initial commit
4c33490