Instructions to use chchen/Llama3-OpenBioLLM-8B-PsyCourse-info-fold4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use chchen/Llama3-OpenBioLLM-8B-PsyCourse-info-fold4 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("aaditya/Llama3-OpenBioLLM-8B") model = PeftModel.from_pretrained(base_model, "chchen/Llama3-OpenBioLLM-8B-PsyCourse-info-fold4") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 60
Browse files- adapter_model.safetensors +1 -1
- trainer_log.jsonl +11 -0
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 83945296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81a1a34da9f4157a2935dd7421c483bf223158cb574f39e1a4558ae12cd00e1c
|
| 3 |
size 83945296
|
trainer_log.jsonl
CHANGED
|
@@ -53,3 +53,14 @@
|
|
| 53 |
{"current_steps": 49, "total_steps": 125, "loss": 0.1784, "lr": 7.660160382576683e-05, "epoch": 1.9358024691358025, "percentage": 39.2, "elapsed_time": "0:21:55", "remaining_time": "0:33:59"}
|
| 54 |
{"current_steps": 50, "total_steps": 125, "loss": 0.1466, "lr": 7.540376726232648e-05, "epoch": 1.9753086419753085, "percentage": 40.0, "elapsed_time": "0:22:17", "remaining_time": "0:33:25"}
|
| 55 |
{"current_steps": 50, "total_steps": 125, "eval_loss": 0.16728538274765015, "epoch": 1.9753086419753085, "percentage": 40.0, "elapsed_time": "0:22:37", "remaining_time": "0:33:56"}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
{"current_steps": 49, "total_steps": 125, "loss": 0.1784, "lr": 7.660160382576683e-05, "epoch": 1.9358024691358025, "percentage": 39.2, "elapsed_time": "0:21:55", "remaining_time": "0:33:59"}
|
| 54 |
{"current_steps": 50, "total_steps": 125, "loss": 0.1466, "lr": 7.540376726232648e-05, "epoch": 1.9753086419753085, "percentage": 40.0, "elapsed_time": "0:22:17", "remaining_time": "0:33:25"}
|
| 55 |
{"current_steps": 50, "total_steps": 125, "eval_loss": 0.16728538274765015, "epoch": 1.9753086419753085, "percentage": 40.0, "elapsed_time": "0:22:37", "remaining_time": "0:33:56"}
|
| 56 |
+
{"current_steps": 51, "total_steps": 125, "loss": 0.3706, "lr": 7.4185944355262e-05, "epoch": 2.0148148148148146, "percentage": 40.8, "elapsed_time": "0:23:07", "remaining_time": "0:33:33"}
|
| 57 |
+
{"current_steps": 52, "total_steps": 125, "loss": 0.1317, "lr": 7.294909322337689e-05, "epoch": 2.054320987654321, "percentage": 41.6, "elapsed_time": "0:23:33", "remaining_time": "0:33:03"}
|
| 58 |
+
{"current_steps": 53, "total_steps": 125, "loss": 0.1212, "lr": 7.169418695587791e-05, "epoch": 2.093827160493827, "percentage": 42.4, "elapsed_time": "0:23:59", "remaining_time": "0:32:35"}
|
| 59 |
+
{"current_steps": 54, "total_steps": 125, "loss": 0.0873, "lr": 7.042221284679982e-05, "epoch": 2.1333333333333333, "percentage": 43.2, "elapsed_time": "0:24:22", "remaining_time": "0:32:03"}
|
| 60 |
+
{"current_steps": 55, "total_steps": 125, "loss": 0.1257, "lr": 6.91341716182545e-05, "epoch": 2.1728395061728394, "percentage": 44.0, "elapsed_time": "0:24:48", "remaining_time": "0:31:34"}
|
| 61 |
+
{"current_steps": 56, "total_steps": 125, "loss": 0.1247, "lr": 6.783107663311565e-05, "epoch": 2.212345679012346, "percentage": 44.8, "elapsed_time": "0:25:15", "remaining_time": "0:31:07"}
|
| 62 |
+
{"current_steps": 57, "total_steps": 125, "loss": 0.1553, "lr": 6.651395309775837e-05, "epoch": 2.251851851851852, "percentage": 45.6, "elapsed_time": "0:25:43", "remaining_time": "0:30:41"}
|
| 63 |
+
{"current_steps": 58, "total_steps": 125, "loss": 0.153, "lr": 6.518383725548074e-05, "epoch": 2.291358024691358, "percentage": 46.4, "elapsed_time": "0:26:10", "remaining_time": "0:30:14"}
|
| 64 |
+
{"current_steps": 59, "total_steps": 125, "loss": 0.1269, "lr": 6.384177557124247e-05, "epoch": 2.330864197530864, "percentage": 47.2, "elapsed_time": "0:26:33", "remaining_time": "0:29:42"}
|
| 65 |
+
{"current_steps": 60, "total_steps": 125, "loss": 0.0851, "lr": 6.248882390836135e-05, "epoch": 2.3703703703703702, "percentage": 48.0, "elapsed_time": "0:26:57", "remaining_time": "0:29:12"}
|
| 66 |
+
{"current_steps": 60, "total_steps": 125, "eval_loss": 0.1626947969198227, "epoch": 2.3703703703703702, "percentage": 48.0, "elapsed_time": "0:27:17", "remaining_time": "0:29:34"}
|