Instructions to use chchen/Llama-3.1-8B-Instruct-PsyCourse-doc-fold5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use chchen/Llama-3.1-8B-Instruct-PsyCourse-doc-fold5 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "chchen/Llama-3.1-8B-Instruct-PsyCourse-doc-fold5") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 100
Browse files- adapter_model.safetensors +1 -1
- trainer_log.jsonl +11 -0
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 83945296
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cc720e97eb0540f59f247f2a02059db8a96201ccc6d849a8bf5fbe5fc8dd66ce
|
| 3 |
size 83945296
|
trainer_log.jsonl
CHANGED
|
@@ -97,3 +97,14 @@
|
|
| 97 |
{"current_steps": 89, "total_steps": 125, "loss": 0.0869, "lr": 2.3398396174233178e-05, "epoch": 3.5160493827160493, "percentage": 71.2, "elapsed_time": "0:43:00", "remaining_time": "0:17:23"}
|
| 98 |
{"current_steps": 90, "total_steps": 125, "loss": 0.065, "lr": 2.2221488349019903e-05, "epoch": 3.5555555555555554, "percentage": 72.0, "elapsed_time": "0:43:24", "remaining_time": "0:16:52"}
|
| 99 |
{"current_steps": 90, "total_steps": 125, "eval_loss": 0.07846130430698395, "epoch": 3.5555555555555554, "percentage": 72.0, "elapsed_time": "0:43:47", "remaining_time": "0:17:01"}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 97 |
{"current_steps": 89, "total_steps": 125, "loss": 0.0869, "lr": 2.3398396174233178e-05, "epoch": 3.5160493827160493, "percentage": 71.2, "elapsed_time": "0:43:00", "remaining_time": "0:17:23"}
|
| 98 |
{"current_steps": 90, "total_steps": 125, "loss": 0.065, "lr": 2.2221488349019903e-05, "epoch": 3.5555555555555554, "percentage": 72.0, "elapsed_time": "0:43:24", "remaining_time": "0:16:52"}
|
| 99 |
{"current_steps": 90, "total_steps": 125, "eval_loss": 0.07846130430698395, "epoch": 3.5555555555555554, "percentage": 72.0, "elapsed_time": "0:43:47", "remaining_time": "0:17:01"}
|
| 100 |
+
{"current_steps": 91, "total_steps": 125, "loss": 0.0394, "lr": 2.1066435191009715e-05, "epoch": 3.595061728395062, "percentage": 72.8, "elapsed_time": "0:44:19", "remaining_time": "0:16:33"}
|
| 101 |
+
{"current_steps": 92, "total_steps": 125, "loss": 0.0656, "lr": 1.9934145435079702e-05, "epoch": 3.634567901234568, "percentage": 73.6, "elapsed_time": "0:44:46", "remaining_time": "0:16:03"}
|
| 102 |
+
{"current_steps": 93, "total_steps": 125, "loss": 0.0652, "lr": 1.8825509907063327e-05, "epoch": 3.674074074074074, "percentage": 74.4, "elapsed_time": "0:45:14", "remaining_time": "0:15:33"}
|
| 103 |
+
{"current_steps": 94, "total_steps": 125, "loss": 0.0656, "lr": 1.774140082289563e-05, "epoch": 3.71358024691358, "percentage": 75.2, "elapsed_time": "0:45:41", "remaining_time": "0:15:04"}
|
| 104 |
+
{"current_steps": 95, "total_steps": 125, "loss": 0.0571, "lr": 1.6682671102399805e-05, "epoch": 3.753086419753086, "percentage": 76.0, "elapsed_time": "0:46:05", "remaining_time": "0:14:33"}
|
| 105 |
+
{"current_steps": 96, "total_steps": 125, "loss": 0.1089, "lr": 1.5650153698254916e-05, "epoch": 3.7925925925925927, "percentage": 76.8, "elapsed_time": "0:46:31", "remaining_time": "0:14:03"}
|
| 106 |
+
{"current_steps": 97, "total_steps": 125, "loss": 0.0838, "lr": 1.4644660940672627e-05, "epoch": 3.832098765432099, "percentage": 77.6, "elapsed_time": "0:46:58", "remaining_time": "0:13:33"}
|
| 107 |
+
{"current_steps": 98, "total_steps": 125, "loss": 0.1232, "lr": 1.3666983898298657e-05, "epoch": 3.871604938271605, "percentage": 78.4, "elapsed_time": "0:47:24", "remaining_time": "0:13:03"}
|
| 108 |
+
{"current_steps": 99, "total_steps": 125, "loss": 0.0984, "lr": 1.2717891755841722e-05, "epoch": 3.911111111111111, "percentage": 79.2, "elapsed_time": "0:47:50", "remaining_time": "0:12:33"}
|
| 109 |
+
{"current_steps": 100, "total_steps": 125, "loss": 0.0224, "lr": 1.1798131208919627e-05, "epoch": 3.950617283950617, "percentage": 80.0, "elapsed_time": "0:48:16", "remaining_time": "0:12:04"}
|
| 110 |
+
{"current_steps": 100, "total_steps": 125, "eval_loss": 0.07832258939743042, "epoch": 3.950617283950617, "percentage": 80.0, "elapsed_time": "0:48:38", "remaining_time": "0:12:09"}
|