Finetuned facebook/mms-1b-all on 1502 Puno Quechua training audio samples from cmflnuzw781hfx067jwv4pt9x.
This model was created from the Mozilla.ai Blueprint: speech-to-text-finetune.
Evaluation results on 562 audio samples of Puno Quechua:
Baseline model (before finetuning) on Puno Quechua
- Word Error Rate (Normalized): 146.227
- Word Error Rate (Orthographic): 100.0
- Character Error Rate (Normalized): 332.297
- Character Error Rate (Orthographic): 344.813
- Loss: 23.528
Finetuned model (after finetuning) on Puno Quechua
- Word Error Rate (Normalized): 19.5
- Word Error Rate (Orthographic): 32.432
- Character Error Rate (Normalized): 2.718
- Character Error Rate (Orthographic): 4.452
- Loss: 0.163
- Downloads last month
- 18
Model tree for robertp408/mms-1b-all-qxp
Base model
facebook/mms-1b-allEvaluation results
- wer on Common Voice (Puno Quechua)self-reported19.500