Instructions to use mskov/falcon-7b-completion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use mskov/falcon-7b-completion with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("ybelkada/falcon-7b-sharded-bf16") model = PeftModel.from_pretrained(base_model, "mskov/falcon-7b-completion") - Notebooks
- Google Colab
- Kaggle
Upload config.json
Browse files
results/checkpoint-100/config.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{'lora_alpha': 16, 'lora_dropout': 0.1, 'r': 64, 'bias': 'none', 'task_type': 'CAUSAL_LM', 'target_modules': ['query_key_value', 'dense', 'dense_h_to_4h', 'dense_4h_to_h']}
|