Instructions to use Infernaught/loratest with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Infernaught/loratest with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-hf") model = PeftModel.from_pretrained(base_model, "Infernaught/loratest") - Notebooks
- Google Colab
- Kaggle
| { | |
| "auto_mapping": null, | |
| "base_model_name_or_path": "meta-llama/Llama-2-7b-hf", | |
| "inference_mode": true, | |
| "peft_type": "LORA", | |
| "revision": null, | |
| "task_type": "CAUSAL_LM" | |
| } |