Gayuru's picture
session end at step 7142/13164
9e89bb4 verified
|
Raw History Blame Contribute Delete
2.77 kB
---
library_name: peft
license: apache-2.0
base_model: openai/whisper-medium
tags:
- base_model:adapter:openai/whisper-medium
- lora
- transformers
- unsloth
metrics:
- wer
model-index:
- name: whisper-medium-si-ta-en-split1
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# whisper-medium-si-ta-en-split1
This model is a fine-tuned version of [openai/whisper-medium](https://huggingface.co/openai/whisper-medium) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2412
- Wer Si: 34.6399
- Cer Si: 7.4300
- Wer Ta: 27.6527
- Cer Ta: 7.6979
- Wer En: 5.0041
- Cer En: 3.1183
- Wer: 22.4322
- Cer: 6.0821
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 4
- eval_batch_size: 8
- seed: 3407
- gradient_accumulation_steps: 4
- total_train_batch_size: 16
- optimizer: Use OptimizerNames.ADAMW_8BIT with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 200
- num_epochs: 3
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Cer | Cer En | Cer Si | Cer Ta | Validation Loss | Wer | Wer En | Wer Si | Wer Ta |
|:-------------:|:------:|:----:|:------:|:------:|:-------:|:------:|:---------------:|:-------:|:------:|:-------:|:-------:|
| 0.246 | 0.2279 | 1000 | 8.4308 | 3.2317 | 12.1226 | 9.9381 | 0.2259 | 31.5085 | 5.1075 | 53.7830 | 35.6348 |
| 0.2012 | 0.4558 | 2000 | 7.3432 | 3.0479 | 9.9484 | 9.0333 | 0.2043 | 27.2708 | 4.8801 | 44.7584 | 32.1738 |
| 0.1664 | 0.6837 | 3000 | 6.6231 | 2.9148 | 8.3529 | 8.6015 | 0.1906 | 24.9899 | 4.7146 | 38.6509 | 31.6043 |
| 1.0048 | 0.9116 | 4000 | 0.2638 | 47.1285| 10.4020 | 31.2451| 8.7173 | 4.9835 | 3.0479 | 27.7857 | 7.3890 |
| 0.7362 | 1.1397 | 5000 | 0.2519 | 39.1978| 8.2277 | 29.7380| 8.4446 | 4.9628 | 3.0831 | 24.6329 | 6.5851 |
| 0.7605 | 1.3676 | 6000 | 0.2638 | 35.6427| 7.8680 | 28.4851| 7.9633 | 4.9214 | 3.0987 | 23.0164 | 6.3100 |
| 0.6403 | 1.5955 | 7000 | 0.2412 | 34.6399| 7.4300 | 27.6527| 7.6979 | 5.0041 | 3.1183 | 22.4322 | 6.0821 |
### Framework versions
- PEFT 0.20.0
- Transformers 4.56.2
- Pytorch 2.11.0+cu128
- Datasets 3.6.0
- Tokenizers 0.22.2