dandankim commited on
Commit
bc7bc76
·
verified ·
1 Parent(s): 8125747

dandankim/token_classifier2

Browse files
README.md CHANGED
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.0372
25
- - Precision: 0.9224
26
- - Recall: 0.9528
27
- - F1: 0.9374
28
- - Accuracy: 0.9874
29
 
30
  ## Model description
31
 
@@ -44,28 +44,32 @@ More information needed
44
  ### Training hyperparameters
45
 
46
  The following hyperparameters were used during training:
47
- - learning_rate: 5e-05
48
- - train_batch_size: 4
49
- - eval_batch_size: 4
50
  - seed: 42
51
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
  - lr_scheduler_type: linear
53
- - num_epochs: 5
 
54
 
55
  ### Training results
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
58
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
59
- | 0.043 | 1.0 | 258 | 0.0412 | 0.9165 | 0.9536 | 0.9347 | 0.9861 |
60
- | 0.0419 | 2.0 | 516 | 0.0384 | 0.9150 | 0.9536 | 0.9339 | 0.9864 |
61
- | 0.0371 | 3.0 | 774 | 0.0381 | 0.9237 | 0.9494 | 0.9364 | 0.9869 |
62
- | 0.0499 | 4.0 | 1032 | 0.0379 | 0.9151 | 0.9545 | 0.9344 | 0.9868 |
63
- | 0.0195 | 5.0 | 1290 | 0.0372 | 0.9224 | 0.9528 | 0.9374 | 0.9874 |
 
 
 
64
 
65
 
66
  ### Framework versions
67
 
68
  - Transformers 4.48.3
69
  - Pytorch 2.5.1+cu124
70
- - Datasets 3.3.1
71
  - Tokenizers 0.21.0
 
21
 
22
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 0.0738
25
+ - Precision: 0.9657
26
+ - Recall: 0.9761
27
+ - F1: 0.9709
28
+ - Accuracy: 0.9845
29
 
30
  ## Model description
31
 
 
44
  ### Training hyperparameters
45
 
46
  The following hyperparameters were used during training:
47
+ - learning_rate: 2e-05
48
+ - train_batch_size: 16
49
+ - eval_batch_size: 16
50
  - seed: 42
51
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
  - lr_scheduler_type: linear
53
+ - lr_scheduler_warmup_ratio: 0.1
54
+ - num_epochs: 10
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
60
+ | 0.898 | 1.0 | 149 | 0.1613 | 0.8995 | 0.8729 | 0.8860 | 0.9637 |
61
+ | 0.1161 | 2.0 | 298 | 0.0749 | 0.9682 | 0.9501 | 0.9591 | 0.9790 |
62
+ | 0.0717 | 3.0 | 447 | 0.0762 | 0.9723 | 0.9630 | 0.9676 | 0.9814 |
63
+ | 0.0412 | 4.0 | 596 | 0.0661 | 0.9699 | 0.9694 | 0.9697 | 0.9845 |
64
+ | 0.0295 | 5.0 | 745 | 0.0630 | 0.9596 | 0.9739 | 0.9667 | 0.9835 |
65
+ | 0.0262 | 6.0 | 894 | 0.0658 | 0.9696 | 0.9732 | 0.9714 | 0.9851 |
66
+ | 0.0191 | 7.0 | 1043 | 0.0695 | 0.9696 | 0.9707 | 0.9702 | 0.9846 |
67
+ | 0.0165 | 8.0 | 1192 | 0.0738 | 0.9657 | 0.9761 | 0.9709 | 0.9845 |
68
 
69
 
70
  ### Framework versions
71
 
72
  - Transformers 4.48.3
73
  - Pytorch 2.5.1+cu124
74
+ - Datasets 3.3.2
75
  - Tokenizers 0.21.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72d5503cfa37941e78149413e7a61317e7eab539bff0ce58fad602526c81d135
3
  size 265516156
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b21e75c082fe70716c9e78e7ac9075627dd6dcc9c27b08c05ece728bd4287d78
3
  size 265516156
runs/Feb27_12-28-58_a77c74cb9061/events.out.tfevents.1740659341.a77c74cb9061.868.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:504d8f8b54c845418ecc4cd908468d939e3904ee3c1f9a4d1562b68aa2322f55
3
+ size 91863
runs/Feb27_12-28-58_a77c74cb9061/events.out.tfevents.1740659486.a77c74cb9061.868.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d60779ff20c358352ea09f99c49254601f0d45453dfb2456913a2df7820ea8b
3
+ size 560
runs/Feb27_12-34-56_a77c74cb9061/events.out.tfevents.1740659697.a77c74cb9061.868.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95fd0536193efd03eec176f247744729d248330ed5bbd85477a3c2c6ea63b0e9
3
+ size 33629
runs/Feb27_12-36-18_a77c74cb9061/events.out.tfevents.1740659779.a77c74cb9061.868.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:062cab65e53ef8d6dc54276c2062e9d1a8a39b18839d5251073370f943947639
3
+ size 7973
runs/Feb27_12-36-51_a77c74cb9061/events.out.tfevents.1740659812.a77c74cb9061.868.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c837a4cbc0f94a8962d6b85c1e6009a2c55ec9557b8f3f3041d8b8fd172b2b2
3
+ size 12713
runs/Feb27_12-37-48_a77c74cb9061/events.out.tfevents.1740659868.a77c74cb9061.868.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fa6b573e8b90eeab015c68d8fc4d5bd12e7b44bf4de7131c4226cdde8d3f917
3
+ size 5855
runs/Feb27_12-38-06_a77c74cb9061/events.out.tfevents.1740659886.a77c74cb9061.868.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d603c96f7f44b3b2ed34f592c0bf84c56cd4faace013b28494a1897892949a9
3
+ size 28415
runs/Feb27_12-44-26_a77c74cb9061/events.out.tfevents.1740660266.a77c74cb9061.868.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9db4508729d19d1f98953ec44a0a63c0592221553eac15b293eb11ee6f0928bd
3
+ size 10688
runs/Feb27_12-45-41_a77c74cb9061/events.out.tfevents.1740660341.a77c74cb9061.868.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dc50c91ea37b814fecc597a2ea3911095e8e7ff98fd85f55fb81684e53be967
3
+ size 14829
runs/Feb27_13-03-02_a77c74cb9061/events.out.tfevents.1740661383.a77c74cb9061.868.12 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f19e7db9d8cce5660439d19145c28542250d72abc2173c84719460038f416a8
3
+ size 7162
runs/Feb27_13-03-35_a77c74cb9061/events.out.tfevents.1740661415.a77c74cb9061.868.13 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95cd5fbbf4e40ced25db1912e53bc49c8c425457a2477cf97c1ac6f7f948675a
3
+ size 14829
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ab0dc395f253f4d9d9eec86094e7678a2b6c8f2b8d7288e512c948c3e88d9d39
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7787e2f7d843089369530f9da3cbba46eb271f002f6deb2d26ddbced101d2372
3
  size 5368