melhum commited on
Commit
3d0f20c
·
verified ·
1 Parent(s): 2f6e6b5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +25 -18
README.md CHANGED
@@ -22,11 +22,11 @@ model-index:
22
  type: automatic-speech-recognition
23
  metrics:
24
  - type: wer
25
- value: 46.52
26
- name: WER
27
  - type: cer
28
- value: 12.03
29
- name: CER
30
  ---
31
 
32
  # Badini Kurdish ASR (Wav2Vec2-BERT)
@@ -38,17 +38,24 @@ with a CTC head.
38
 
39
  ## Results
40
 
41
- Evaluated on a held-out test set of **2,038** samples:
 
 
 
42
 
43
- | Metric | Score |
44
- |--------|--------|
45
- | WER | 46.52% |
46
- | CER | 12.03% |
 
 
 
 
47
 
48
  ## Input requirements
49
 
50
  - Audio must be **16 kHz, mono**.
51
- - Resample any other sample rate to 16 kHz before running inference.
52
 
53
  ## Usage
54
 
@@ -70,14 +77,14 @@ print(processor.batch_decode(pred_ids)[0])
70
 
71
  ## Important: text normalization
72
 
73
- This repository contains **only the acoustic model**. The raw output is plain CTC
74
- decoding. A separate normalization pipeline — punctuation restoration,
75
- number-to-word expansion (with Badini-specific remapping), character
76
- normalization, and word-variant correction — is applied in the downstream
77
- application and is **not** included here. Output straight from this model will
78
- not match the fully normalized transcripts.
79
 
80
  ## Intended use
81
 
82
- Speech transcription for Badini Kurdish. Given the WER, best used with
83
- downstream normalization/post-processing rather than as raw final text.
 
22
  type: automatic-speech-recognition
23
  metrics:
24
  - type: wer
25
+ value: 26.53
26
+ name: WER (normalized, word-level)
27
  - type: cer
28
+ value: 11.32
29
+ name: CER (normalized, word-level)
30
  ---
31
 
32
  # Badini Kurdish ASR (Wav2Vec2-BERT)
 
38
 
39
  ## Results
40
 
41
+ The raw model output (greedy CTC, no post-processing) and the output after the
42
+ project's text-normalization pipeline are reported separately, because word error
43
+ rate is highly sensitive to punctuation, digit spelling, and character variants
44
+ that the normalizer resolves.
45
 
46
+ | Evaluation | WER | CER |
47
+ |------------|-----|-----|
48
+ | Raw greedy CTC (no normalization) | 46.5% | 12.0% |
49
+ | Normalized, punctuation stripped (word-level) | **26.5%** | 11.3% |
50
+ | Normalized, punctuation kept | 32.4% | 14.2% |
51
+
52
+ Normalized results are on a 1,123-sample test set; the raw figure is from the
53
+ training-time evaluation on 2,038 samples.
54
 
55
  ## Input requirements
56
 
57
  - Audio must be **16 kHz, mono**.
58
+ - Resample any other sample rate to 16 kHz before inference.
59
 
60
  ## Usage
61
 
 
77
 
78
  ## Important: text normalization
79
 
80
+ This repository contains **only the acoustic model**. Raw output is plain CTC
81
+ decoding. The normalization pipeline that produces the 26.5% WER — punctuation
82
+ handling, number-to-word expansion (Badini-specific), character normalization,
83
+ and word-variant correction — is applied downstream and is **not** included here.
84
+ Output straight from this model will match the "raw" row above, not the normalized
85
+ rows.
86
 
87
  ## Intended use
88
 
89
+ Speech transcription for Badini Kurdish, best used together with the downstream
90
+ normalization/post-processing described above.