Instructions to use AswanthVR/lora_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AswanthVR/lora_model with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AswanthVR/lora_model", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Create config.json
Browse files- config.json +7 -0
config.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_type": "llama",
|
| 3 |
+
"pipeline_tag": "text-generation",
|
| 4 |
+
"base_model_name_or_path": "unsloth/llama-3-8b-bnb-4bit",
|
| 5 |
+
"peft_type": "LORA",
|
| 6 |
+
"task_type": "CAUSAL_LM"
|
| 7 |
+
}
|