Instructions to use TorpilleAlpha/scanpy-llama with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use TorpilleAlpha/scanpy-llama with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-chat-hf") model = PeftModel.from_pretrained(base_model, "TorpilleAlpha/scanpy-llama") - Notebooks
- Google Colab
- Kaggle
Commit ·
239e4ae
1
Parent(s): 0de6672
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,8 +1,19 @@
|
|
| 1 |
---
|
| 2 |
library_name: peft
|
| 3 |
-
pipeline_tag: text-generation
|
| 4 |
---
|
| 5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
## Training procedure
|
| 7 |
|
| 8 |
|
|
@@ -20,14 +31,4 @@ The following `bitsandbytes` quantization config was used during training:
|
|
| 20 |
### Framework versions
|
| 21 |
|
| 22 |
|
| 23 |
-
- PEFT 0.5.0
|
| 24 |
-
|
| 25 |
-
To use the checkpoint:
|
| 26 |
-
```
|
| 27 |
-
from peft import PeftModel, PeftConfig
|
| 28 |
-
from transformers import AutoModelForCausalLM
|
| 29 |
-
|
| 30 |
-
config = PeftConfig.from_pretrained("TorpilleAlpha/scanpy-llama")
|
| 31 |
-
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-chat-hf")# or use your local llama-2-7B-chat ckpts
|
| 32 |
-
model = PeftModel.from_pretrained(model, "TorpilleAlpha/scanpy-llama")
|
| 33 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
library_name: peft
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
+
For demonstration, please refer to demo.jpynb in the files.
|
| 6 |
+
|
| 7 |
+
To use the checkpoint:
|
| 8 |
+
```
|
| 9 |
+
from peft import PeftModel, PeftConfig
|
| 10 |
+
from transformers import AutoModelForCausalLM
|
| 11 |
+
|
| 12 |
+
config = PeftConfig.from_pretrained("TorpilleAlpha/scanpy-llama")
|
| 13 |
+
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-chat-hf")# or use your local llama-2-7B-chat shards
|
| 14 |
+
model = PeftModel.from_pretrained(model, "TorpilleAlpha/scanpy-llama")
|
| 15 |
+
```
|
| 16 |
+
|
| 17 |
## Training procedure
|
| 18 |
|
| 19 |
|
|
|
|
| 31 |
### Framework versions
|
| 32 |
|
| 33 |
|
| 34 |
+
- PEFT 0.5.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|