Instructions to use BuzzASR/mongolian with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BuzzASR/mongolian with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="BuzzASR/mongolian")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("BuzzASR/mongolian") model = AutoModelForSpeechSeq2Seq.from_pretrained("BuzzASR/mongolian", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Fix generation config (persistable prompt) + CV25 dataset reference
Browse files- README.md +10 -9
- generation_config.json +10 -14
README.md
CHANGED
|
@@ -5,7 +5,7 @@ library_name: transformers
|
|
| 5 |
pipeline_tag: automatic-speech-recognition
|
| 6 |
base_model: openai/whisper-large-v3
|
| 7 |
tags: [automatic-speech-recognition, whisper, mongolian, buzzasr]
|
| 8 |
-
datasets: [google/fleurs
|
| 9 |
metrics: [cer, wer]
|
| 10 |
---
|
| 11 |
|
|
@@ -15,18 +15,18 @@ A monolingual automatic speech recognition model for **Mongolian**, fine-tuned f
|
|
| 15 |
[openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3). Part of **BuzzASR**,
|
| 16 |
a suite of 102 language-specialized ASR models (Findings of EMNLP 2026).
|
| 17 |
|
| 18 |
-
This model uses **full fine-tuning** (native per-language tokenizer replacement + text multitask fine-tuning)
|
| 19 |
-
|
| 20 |
|
| 21 |
## Results (normalized CER / WER, %)
|
| 22 |
|
| 23 |
| Test set | CER | WER | Whisper-large-v3 (zero-shot) CER |
|
| 24 |
|---|---|---|---|
|
| 25 |
| FLEURS | 9.15 | 24.69 | 34.42 |
|
| 26 |
-
|
|
| 27 |
| **Combined** | **5.21** | **13.34** | **38.23** |
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
## Usage
|
| 32 |
|
|
@@ -42,13 +42,14 @@ feats = proc(wav[0], sampling_rate=16000, return_tensors="pt").input_features.to
|
|
| 42 |
ids = model.generate(feats, num_beams=1, no_repeat_ngram_size=3, repetition_penalty=1.2)
|
| 43 |
print(proc.batch_decode(ids, skip_special_tokens=True)[0])
|
| 44 |
```
|
| 45 |
-
The language/task prompt is baked into the
|
| 46 |
|
| 47 |
## Training data
|
| 48 |
-
FLEURS
|
|
|
|
| 49 |
|
| 50 |
## Limitations
|
| 51 |
-
Monolingual
|
| 52 |
|
| 53 |
## Citation
|
| 54 |
-
|
|
|
|
| 5 |
pipeline_tag: automatic-speech-recognition
|
| 6 |
base_model: openai/whisper-large-v3
|
| 7 |
tags: [automatic-speech-recognition, whisper, mongolian, buzzasr]
|
| 8 |
+
datasets: [google/fleurs]
|
| 9 |
metrics: [cer, wer]
|
| 10 |
---
|
| 11 |
|
|
|
|
| 15 |
[openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3). Part of **BuzzASR**,
|
| 16 |
a suite of 102 language-specialized ASR models (Findings of EMNLP 2026).
|
| 17 |
|
| 18 |
+
This model uses **full fine-tuning** (native per-language tokenizer replacement + text multitask fine-tuning),
|
| 19 |
+
and reaches **state-of-the-art CER among open-source systems** on Mongolian.
|
| 20 |
|
| 21 |
## Results (normalized CER / WER, %)
|
| 22 |
|
| 23 |
| Test set | CER | WER | Whisper-large-v3 (zero-shot) CER |
|
| 24 |
|---|---|---|---|
|
| 25 |
| FLEURS | 9.15 | 24.69 | 34.42 |
|
| 26 |
+
| Common Voice 25 | 1.00 | 2.14 | 40.14 |
|
| 27 |
| **Combined** | **5.21** | **13.34** | **38.23** |
|
| 28 |
|
| 29 |
+
~7.3x CER reduction over Whisper zero-shot on the combined test set.
|
| 30 |
|
| 31 |
## Usage
|
| 32 |
|
|
|
|
| 42 |
ids = model.generate(feats, num_beams=1, no_repeat_ngram_size=3, repetition_penalty=1.2)
|
| 43 |
print(proc.batch_decode(ids, skip_special_tokens=True)[0])
|
| 44 |
```
|
| 45 |
+
The language/task prompt is baked into the generation config, so no `language=` argument is needed.
|
| 46 |
|
| 47 |
## Training data
|
| 48 |
+
[FLEURS](https://huggingface.co/datasets/google/fleurs) + **Common Voice Corpus 25.0** (Mozilla, March 2025;
|
| 49 |
+
https://commonvoice.mozilla.org/en/datasets), capped per the paper. Text-only data from the fish-food corpus.
|
| 50 |
|
| 51 |
## Limitations
|
| 52 |
+
Monolingual (Mongolian only). Evaluated on FLEURS / Common Voice test splits; other domains or dialects may differ.
|
| 53 |
|
| 54 |
## Citation
|
| 55 |
+
Project page: https://lemn-lab.github.io/buzzasr-docs/
|
generation_config.json
CHANGED
|
@@ -7,22 +7,18 @@
|
|
| 7 |
"bos_token_id": 47472,
|
| 8 |
"decoder_start_token_id": 47473,
|
| 9 |
"eos_token_id": 47472,
|
| 10 |
-
"
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
],
|
| 15 |
-
[
|
| 16 |
-
2,
|
| 17 |
-
47575
|
| 18 |
-
],
|
| 19 |
-
[
|
| 20 |
-
3,
|
| 21 |
-
47579
|
| 22 |
-
]
|
| 23 |
-
],
|
| 24 |
"max_length": 448,
|
|
|
|
| 25 |
"pad_token_id": 47472,
|
| 26 |
"suppress_tokens": [],
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
"transformers_version": "4.57.6"
|
| 28 |
}
|
|
|
|
| 7 |
"bos_token_id": 47472,
|
| 8 |
"decoder_start_token_id": 47473,
|
| 9 |
"eos_token_id": 47472,
|
| 10 |
+
"lang_to_id": {
|
| 11 |
+
"<|mn|>": 47529
|
| 12 |
+
},
|
| 13 |
+
"language": "mn",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
"max_length": 448,
|
| 15 |
+
"no_timestamps_token_id": 47579,
|
| 16 |
"pad_token_id": 47472,
|
| 17 |
"suppress_tokens": [],
|
| 18 |
+
"task": "transcribe",
|
| 19 |
+
"task_to_id": {
|
| 20 |
+
"transcribe": 47575,
|
| 21 |
+
"translate": 47574
|
| 22 |
+
},
|
| 23 |
"transformers_version": "4.57.6"
|
| 24 |
}
|