Corpus progress
Annotator scorecards
worst gold DER first — this table exists to route attention
| annotator | status | subs | audio min | min/hr | listen | edit rate | gold DER | text edit | gold CER | gold WER | rejected | flags |
|---|
gold DER — speaker-turn error against adjudicated truth. gold CER / WER — transcript error against the same. CER leads because Bengali word spacing varies between annotators, so WER punishes a character-perfect transcript for choices nobody agrees on. edit rate / text edit — how much of the machine draft they changed; near zero means it was accepted without listening. listen — fraction of audio actually played. min/hr — audio minutes finished per hour worked. Dashes mean the annotator has done no work of that type.
Inter-annotator agreement
the ceiling on every model score you will ever report
Review queue
| recording | chunk | mode | annotator | turns | listen | edit | gold DER | text | gold CER | flags |
|---|