Instructions to use ravisv73/mistral_7b-qa-knowthyself with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ravisv73/mistral_7b-qa-knowthyself with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1") model = PeftModel.from_pretrained(base_model, "ravisv73/mistral_7b-qa-knowthyself") - Notebooks
- Google Colab
- Kaggle
Update config.json
Browse files- config.json +3 -1
config.json
CHANGED
|
@@ -21,5 +21,7 @@
|
|
| 21 |
"torch_dtype": "float32",
|
| 22 |
"transformers_version": "4.35.0",
|
| 23 |
"use_cache": true,
|
|
|
|
|
|
|
| 24 |
"vocab_size": 32000
|
| 25 |
-
}
|
|
|
|
| 21 |
"torch_dtype": "float32",
|
| 22 |
"transformers_version": "4.35.0",
|
| 23 |
"use_cache": true,
|
| 24 |
+
"return_full_text": false,
|
| 25 |
+
"truncate" : 1000,
|
| 26 |
"vocab_size": 32000
|
| 27 |
+
}
|