vamsin07 commited on
Commit
131be6f
·
verified ·
1 Parent(s): 0387c8e

Fix generation config (persistable prompt) + CV25 dataset reference

Browse files
Files changed (2) hide show
  1. README.md +10 -9
  2. generation_config.json +10 -14
README.md CHANGED
@@ -5,7 +5,7 @@ library_name: transformers
5
  pipeline_tag: automatic-speech-recognition
6
  base_model: openai/whisper-large-v3
7
  tags: [automatic-speech-recognition, whisper, mongolian, buzzasr]
8
- datasets: [google/fleurs, mozilla-foundation/common_voice_17_0]
9
  metrics: [cer, wer]
10
  ---
11
 
@@ -15,18 +15,18 @@ A monolingual automatic speech recognition model for **Mongolian**, fine-tuned f
15
  [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3). Part of **BuzzASR**,
16
  a suite of 102 language-specialized ASR models (Findings of EMNLP 2026).
17
 
18
- This model uses **full fine-tuning** (native per-language tokenizer replacement + text multitask fine-tuning).
19
- It reaches **state-of-the-art CER among open-source systems** on Mongolian.
20
 
21
  ## Results (normalized CER / WER, %)
22
 
23
  | Test set | CER | WER | Whisper-large-v3 (zero-shot) CER |
24
  |---|---|---|---|
25
  | FLEURS | 9.15 | 24.69 | 34.42 |
26
- | CommonVoice v25 | 1.00 | 2.14 | 40.14 |
27
  | **Combined** | **5.21** | **13.34** | **38.23** |
28
 
29
- That is a **~7.3× CER reduction** over Whisper zero-shot on the combined test set.
30
 
31
  ## Usage
32
 
@@ -42,13 +42,14 @@ feats = proc(wav[0], sampling_rate=16000, return_tensors="pt").input_features.to
42
  ids = model.generate(feats, num_beams=1, no_repeat_ngram_size=3, repetition_penalty=1.2)
43
  print(proc.batch_decode(ids, skip_special_tokens=True)[0])
44
  ```
45
- The language/task prompt is baked into the model's generation config, so no `language=` argument is needed.
46
 
47
  ## Training data
48
- FLEURS + CommonVoice v25 (Mongolian), capped per the paper. Text-only data from the fish-food corpus.
 
49
 
50
  ## Limitations
51
- Monolingual — intended for Mongolian only. Evaluated on FLEURS/CommonVoice test splits; other domains/dialects may differ.
52
 
53
  ## Citation
54
- See the project page: https://lemn-lab.github.io/buzzasr-docs/
 
5
  pipeline_tag: automatic-speech-recognition
6
  base_model: openai/whisper-large-v3
7
  tags: [automatic-speech-recognition, whisper, mongolian, buzzasr]
8
+ datasets: [google/fleurs]
9
  metrics: [cer, wer]
10
  ---
11
 
 
15
  [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3). Part of **BuzzASR**,
16
  a suite of 102 language-specialized ASR models (Findings of EMNLP 2026).
17
 
18
+ This model uses **full fine-tuning** (native per-language tokenizer replacement + text multitask fine-tuning),
19
+ and reaches **state-of-the-art CER among open-source systems** on Mongolian.
20
 
21
  ## Results (normalized CER / WER, %)
22
 
23
  | Test set | CER | WER | Whisper-large-v3 (zero-shot) CER |
24
  |---|---|---|---|
25
  | FLEURS | 9.15 | 24.69 | 34.42 |
26
+ | Common Voice 25 | 1.00 | 2.14 | 40.14 |
27
  | **Combined** | **5.21** | **13.34** | **38.23** |
28
 
29
+ ~7.3x CER reduction over Whisper zero-shot on the combined test set.
30
 
31
  ## Usage
32
 
 
42
  ids = model.generate(feats, num_beams=1, no_repeat_ngram_size=3, repetition_penalty=1.2)
43
  print(proc.batch_decode(ids, skip_special_tokens=True)[0])
44
  ```
45
+ The language/task prompt is baked into the generation config, so no `language=` argument is needed.
46
 
47
  ## Training data
48
+ [FLEURS](https://huggingface.co/datasets/google/fleurs) + **Common Voice Corpus 25.0** (Mozilla, March 2025;
49
+ https://commonvoice.mozilla.org/en/datasets), capped per the paper. Text-only data from the fish-food corpus.
50
 
51
  ## Limitations
52
+ Monolingual (Mongolian only). Evaluated on FLEURS / Common Voice test splits; other domains or dialects may differ.
53
 
54
  ## Citation
55
+ Project page: https://lemn-lab.github.io/buzzasr-docs/
generation_config.json CHANGED
@@ -7,22 +7,18 @@
7
  "bos_token_id": 47472,
8
  "decoder_start_token_id": 47473,
9
  "eos_token_id": 47472,
10
- "forced_decoder_ids": [
11
- [
12
- 1,
13
- 47529
14
- ],
15
- [
16
- 2,
17
- 47575
18
- ],
19
- [
20
- 3,
21
- 47579
22
- ]
23
- ],
24
  "max_length": 448,
 
25
  "pad_token_id": 47472,
26
  "suppress_tokens": [],
 
 
 
 
 
27
  "transformers_version": "4.57.6"
28
  }
 
7
  "bos_token_id": 47472,
8
  "decoder_start_token_id": 47473,
9
  "eos_token_id": 47472,
10
+ "lang_to_id": {
11
+ "<|mn|>": 47529
12
+ },
13
+ "language": "mn",
 
 
 
 
 
 
 
 
 
 
14
  "max_length": 448,
15
+ "no_timestamps_token_id": 47579,
16
  "pad_token_id": 47472,
17
  "suppress_tokens": [],
18
+ "task": "transcribe",
19
+ "task_to_id": {
20
+ "transcribe": 47575,
21
+ "translate": 47574
22
+ },
23
  "transformers_version": "4.57.6"
24
  }