Hugging Face's logo

8688chris
/
Helldivers2ASR_V3

Safetensors
wav2vec2
Generated from Trainer
Model card Files
xet
 Community
8688chris commited on
Commit
ca5fd39
·
verified ·
1 Parent(s): 48d51bd

Model save

Browse files
Files changed (3) hide show
  1. README.md +39 -73
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -18,9 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [facebook/wav2vec2-base-960h](https://huggingface.co/facebook/wav2vec2-base-960h) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 98.4633
22
- - Wer: 0.0746
23
- - Cer: 0.0409
24
 
25
  ## Model description
26
 
@@ -39,82 +38,49 @@ More information needed
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - learning_rate: 6e-05
43
- - train_batch_size: 16
44
- - eval_batch_size: 16
45
  - seed: 42
46
- - gradient_accumulation_steps: 2
47
- - total_train_batch_size: 32
48
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
49
- - lr_scheduler_type: linear
50
- - lr_scheduler_warmup_ratio: 0.1
51
- - num_epochs: 60
52
  - mixed_precision_training: Native AMP
53
 
54
  ### Training results
55
 
56
- | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
57
- |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
58
- | 1102.0105 | 1.0 | 123 | 764.0731 | 0.5942 | 0.3439 |
59
- | 845.1668 | 2.0 | 246 | 631.7163 | 0.5262 | 0.2790 |
60
- | 720.3244 | 3.0 | 369 | 538.9935 | 0.4643 | 0.2420 |
61
- | 625.3279 | 4.0 | 492 | 472.9683 | 0.4083 | 0.2119 |
62
- | 550.1799 | 5.0 | 615 | 407.5638 | 0.3724 | 0.1928 |
63
- | 506.0926 | 6.0 | 738 | 379.2057 | 0.3249 | 0.1710 |
64
- | 448.6325 | 7.0 | 861 | 327.9303 | 0.2995 | 0.1560 |
65
- | 409.9422 | 8.0 | 984 | 300.3032 | 0.2654 | 0.1356 |
66
- | 371.3904 | 9.0 | 1107 | 275.1522 | 0.2418 | 0.1294 |
67
- | 353.4468 | 10.0 | 1230 | 272.3355 | 0.2246 | 0.1176 |
68
- | 327.2814 | 11.0 | 1353 | 243.3581 | 0.2154 | 0.1111 |
69
- | 311.8162 | 12.0 | 1476 | 236.9698 | 0.2006 | 0.1028 |
70
- | 276.1846 | 13.0 | 1599 | 219.8148 | 0.1908 | 0.0985 |
71
- | 274.653 | 14.0 | 1722 | 207.2803 | 0.1725 | 0.0907 |
72
- | 253.358 | 15.0 | 1845 | 187.1657 | 0.1690 | 0.0864 |
73
- | 241.8021 | 16.0 | 1968 | 184.4199 | 0.1528 | 0.0829 |
74
- | 240.5054 | 17.0 | 2091 | 180.1833 | 0.1549 | 0.0811 |
75
- | 225.2392 | 18.0 | 2214 | 161.8178 | 0.1366 | 0.0727 |
76
- | 216.8659 | 19.0 | 2337 | 160.3206 | 0.1320 | 0.0712 |
77
- | 208.1761 | 20.0 | 2460 | 169.2859 | 0.1334 | 0.0745 |
78
- | 196.0393 | 21.0 | 2583 | 144.7776 | 0.1235 | 0.0649 |
79
- | 197.4559 | 22.0 | 2706 | 147.5746 | 0.1225 | 0.0633 |
80
- | 179.2833 | 23.0 | 2829 | 133.9649 | 0.1165 | 0.0612 |
81
- | 176.9879 | 24.0 | 2952 | 139.7775 | 0.1211 | 0.0633 |
82
- | 176.4448 | 25.0 | 3075 | 136.1829 | 0.1133 | 0.0594 |
83
- | 172.5668 | 26.0 | 3198 | 128.8669 | 0.1063 | 0.0570 |
84
- | 154.1313 | 27.0 | 3321 | 124.3007 | 0.1049 | 0.0545 |
85
- | 156.6865 | 28.0 | 3444 | 129.8724 | 0.1077 | 0.0570 |
86
- | 153.0158 | 29.0 | 3567 | 135.5396 | 0.1045 | 0.0565 |
87
- | 152.5358 | 30.0 | 3690 | 111.3333 | 0.0950 | 0.0505 |
88
- | 148.5502 | 31.0 | 3813 | 124.0713 | 0.0926 | 0.0499 |
89
- | 136.9701 | 32.0 | 3936 | 116.2750 | 0.0986 | 0.0519 |
90
- | 138.8884 | 33.0 | 4059 | 110.3018 | 0.0887 | 0.0479 |
91
- | 122.6163 | 34.0 | 4182 | 122.7260 | 0.0947 | 0.0498 |
92
- | 126.8015 | 35.0 | 4305 | 107.7905 | 0.0862 | 0.0460 |
93
- | 129.6638 | 36.0 | 4428 | 114.4832 | 0.0873 | 0.0460 |
94
- | 125.2895 | 37.0 | 4551 | 99.8014 | 0.0803 | 0.0431 |
95
- | 117.5162 | 38.0 | 4674 | 110.9648 | 0.0831 | 0.0444 |
96
- | 115.6095 | 39.0 | 4797 | 98.0705 | 0.0774 | 0.0422 |
97
- | 117.3834 | 40.0 | 4920 | 117.6684 | 0.0838 | 0.0475 |
98
- | 119.96 | 41.0 | 5043 | 106.7347 | 0.0788 | 0.0438 |
99
- | 115.3641 | 42.0 | 5166 | 112.9413 | 0.0855 | 0.0453 |
100
- | 115.6358 | 43.0 | 5289 | 103.1007 | 0.0757 | 0.0416 |
101
- | 117.6069 | 44.0 | 5412 | 99.9336 | 0.0778 | 0.0436 |
102
- | 118.4094 | 45.0 | 5535 | 98.2989 | 0.0767 | 0.0409 |
103
- | 101.0323 | 46.0 | 5658 | 99.2075 | 0.0732 | 0.0394 |
104
- | 123.5747 | 47.0 | 5781 | 99.5794 | 0.0746 | 0.0401 |
105
- | 101.4861 | 48.0 | 5904 | 96.3588 | 0.0704 | 0.0374 |
106
- | 91.275 | 49.0 | 6027 | 93.8525 | 0.0718 | 0.0373 |
107
- | 107.3693 | 50.0 | 6150 | 98.8149 | 0.0760 | 0.0387 |
108
- | 98.0919 | 51.0 | 6273 | 96.5958 | 0.0715 | 0.0397 |
109
- | 104.5664 | 52.0 | 6396 | 96.5725 | 0.0757 | 0.0394 |
110
- | 97.5255 | 53.0 | 6519 | 92.6131 | 0.0725 | 0.0397 |
111
- | 102.0815 | 54.0 | 6642 | 86.7850 | 0.0679 | 0.0359 |
112
- | 103.8752 | 55.0 | 6765 | 88.7518 | 0.0700 | 0.0369 |
113
- | 94.6423 | 56.0 | 6888 | 88.3360 | 0.0693 | 0.0364 |
114
- | 99.469 | 57.0 | 7011 | 88.3835 | 0.0669 | 0.0358 |
115
- | 91.7693 | 58.0 | 7134 | 84.8417 | 0.0679 | 0.0368 |
116
- | 92.684 | 59.0 | 7257 | 92.9632 | 0.0707 | 0.0386 |
117
- | 99.5245 | 60.0 | 7380 | 98.4633 | 0.0746 | 0.0409 |
118
 
119
 
120
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [facebook/wav2vec2-base-960h](https://huggingface.co/facebook/wav2vec2-base-960h) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 46.4982
22
+ - Wer: 0.0197
 
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 7e-05
42
+ - train_batch_size: 32
43
+ - eval_batch_size: 32
44
  - seed: 42
 
 
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
+ - lr_scheduler_type: constant
47
+ - num_epochs: 30
 
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
53
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
54
+ | 1568.7385 | 1.0 | 164 | 771.7803 | 0.3712 |
55
+ | 1068.8207 | 2.0 | 328 | 590.2993 | 0.2698 |
56
+ | 860.8321 | 3.0 | 492 | 448.1273 | 0.2125 |
57
+ | 747.6548 | 4.0 | 656 | 366.1845 | 0.1805 |
58
+ | 631.9949 | 5.0 | 820 | 274.8642 | 0.1421 |
59
+ | 571.2026 | 6.0 | 984 | 241.3273 | 0.1242 |
60
+ | 509.5936 | 7.0 | 1148 | 216.0463 | 0.1093 |
61
+ | 435.6571 | 8.0 | 1312 | 176.9057 | 0.0875 |
62
+ | 411.174 | 9.0 | 1476 | 165.9831 | 0.0833 |
63
+ | 364.6828 | 10.0 | 1640 | 138.6788 | 0.0712 |
64
+ | 345.6405 | 11.0 | 1804 | 136.7265 | 0.0675 |
65
+ | 315.1662 | 12.0 | 1968 | 114.3673 | 0.0570 |
66
+ | 284.2125 | 13.0 | 2132 | 98.1911 | 0.0520 |
67
+ | 278.4242 | 14.0 | 2296 | 94.5904 | 0.0457 |
68
+ | 238.8668 | 15.0 | 2460 | 86.1799 | 0.0465 |
69
+ | 235.9656 | 16.0 | 2624 | 79.9327 | 0.0444 |
70
+ | 224.2061 | 17.0 | 2788 | 66.6601 | 0.0331 |
71
+ | 209.7441 | 18.0 | 2952 | 61.5226 | 0.0307 |
72
+ | 197.9857 | 19.0 | 3116 | 59.2185 | 0.0286 |
73
+ | 189.3057 | 20.0 | 3280 | 55.8568 | 0.0278 |
74
+ | 201.0874 | 21.0 | 3444 | 58.7346 | 0.0268 |
75
+ | 152.8864 | 22.0 | 3608 | 60.1501 | 0.0226 |
76
+ | 161.5389 | 23.0 | 3772 | 61.3434 | 0.0273 |
77
+ | 151.5226 | 24.0 | 3936 | 46.0442 | 0.0208 |
78
+ | 154.1182 | 25.0 | 4100 | 49.2783 | 0.0200 |
79
+ | 157.7021 | 26.0 | 4264 | 39.4705 | 0.0202 |
80
+ | 143.6331 | 27.0 | 4428 | 44.7556 | 0.0234 |
81
+ | 136.6361 | 28.0 | 4592 | 39.5889 | 0.0192 |
82
+ | 133.5365 | 29.0 | 4756 | 42.7637 | 0.0173 |
83
+ | 117.5687 | 30.0 | 4920 | 46.4982 | 0.0197 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
84
 
85
 
86
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:159df1feeadbb63c3cce943020109d773ced8f3d3a955209f09c64fcd97af63f
3
  size 377611120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50f75135f3205e071dffd7a5c9092a6319d6153256e8171dd3951b85377acaa1
3
  size 377611120
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77cff4b711d027c8d6ef9fedab9f335fa8fe684c7724213fc090b80528ea8d26
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb8d8ecf665cf5a646bf6c6c5ea1422b8f2ac7fd9a95644e4e45fa189a41e155
3
  size 5432