danielrosehill commited on
Commit
67ea1bc
Β·
verified Β·
1 Parent(s): 361a5f5

Card: standalone, no gate (public)

Browse files
Files changed (1) hide show
  1. README.md +4 -100
README.md CHANGED
@@ -18,62 +18,19 @@ tags:
18
  datasets:
19
  - danielrosehill/Read-Aloud-Voice-Sentences
20
  - openslr/librispeech_asr
21
- extra_gated_prompt: "Access to this model is by request and is governed by the Hebrish terms of use (https://hebrish.app/terms). Non-commercial use is free; commercial use needs a commercial licence from access@hebrish.app."
22
- extra_gated_fields:
23
- Name: text
24
- Organisation: text
25
- Intended use: text
26
- "I agree to use this model under the Hebrish terms of use (non-commercial unless I hold a commercial licence)": checkbox
27
  ---
28
 
29
  # Fritter v1.0: Parakeet TDT 0.6B v2 for English dictation, no code-switching
30
 
31
- A personal speech-recognition fine-tune for **English dictation without code-switching**: tech vocabulary (model and product names, CLI and cloud terms), brand names, acronyms, numbers and currency in digits, Irish-English phrasing, fast and slow speech, whispering, and everyday email and message dictation, all in one speaker's voice. It is the successor of Boxty v1.0 (`Hebrish/Parakeet-TDT-0.6B-v2-Tech-And-Accent`), retrained from stock on more than twice the data.
32
 
33
- **Name.** Each fine-tune line has a food code name. **Fritter** (formerly Boxty, renamed 2026-10-22) is the no-code-switching line; the training run id is `r11-general`.
34
 
35
  A full fine-tune of [`nvidia/parakeet-tdt-0.6b-v2`](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2) on one
36
  speaker's read-aloud phone recordings (an Irish English speaker living in Israel), run `r11-general`, trained
37
  2026-10-27. Output keeps v2's casing and punctuation; numbers are written in digits.
38
 
39
- Sibling models from the same data revision: [Sabich, kitchen sink, everything](https://huggingface.co/Hebrish/Sabich) Β· [Jachnun, English-Hebrew code-switching](https://huggingface.co/Hebrish/Jachnun).
40
-
41
- **Access and terms of use.** Governed by the [Hebrish terms of use](https://hebrish.app/terms); access is by
42
- request (button on this page, or [access@hebrish.app](mailto:access@hebrish.app)). Non-commercial
43
- use is free; commercial use needs a commercial licence.
44
-
45
- <!-- hebrish-listen:begin -->
46
- ## Listen: what Hebrish is and how it's made
47
-
48
- A spoken introduction to the project by the person who makes it: why Hebrish exists, why stock
49
- speech-to-text gets Hebrew words wrong, how the fine-tunes are trained, the model lines (Sabich,
50
- Jachnun, Shakshuka, Meorav), how the training data is recorded, and the plans for the apps.
51
-
52
- | | |
53
- | --- | --- |
54
- | Listen | [hebrish.app/updates](https://hebrish.app/updates): player, chapters, edited transcript, MP3 download |
55
- | Author | Daniel Rosehill |
56
- | Recorded | 2026-10-22 |
57
- | Runtime | 1:07:03 |
58
-
59
- Chapters (each opens the player at that point):
60
- [0:00](https://hebrish.app/updates#t=0) Why this voice note Β·
61
- [1:36](https://hebrish.app/updates#t=96) Coming to speech to text Β·
62
- [6:36](https://hebrish.app/updates#t=396) Why Hebrew words go wrong Β·
63
- [9:23](https://hebrish.app/updates#t=563) How the fine-tune works Β·
64
- [12:27](https://hebrish.app/updates#t=747) Why Parakeet, and the model plan Β·
65
- [17:44](https://hebrish.app/updates#t=1064) Disfluencies, shekels, paragraphs Β·
66
- [25:40](https://hebrish.app/updates#t=1540) Tech vocabulary and Meorav Β·
67
- [29:07](https://hebrish.app/updates#t=1747) The kitchen sink: Sabich and Jachnun Β·
68
- [33:35](https://hebrish.app/updates#t=2015) Licensing, accents, noisy recordings Β·
69
- [39:10](https://hebrish.app/updates#t=2350) One recorder for ASR and TTS Β·
70
- [41:04](https://hebrish.app/updates#t=2464) Desktop shortcuts and the macro pad Β·
71
- [43:34](https://hebrish.app/updates#t=2614) Android: Bluetooth and one button Β·
72
- [45:35](https://hebrish.app/updates#t=2735) Streaming and Shakshuka Β·
73
- [50:28](https://hebrish.app/updates#t=3028) Long-form transcription Β·
74
- [56:00](https://hebrish.app/updates#t=3360) Output modes Β·
75
- [63:01](https://hebrish.app/updates#t=3781) Report a word, and more voices
76
- <!-- hebrish-listen:end -->
77
 
78
  ## Results
79
 
@@ -96,58 +53,6 @@ Source: [`danielrosehill/Read-Aloud-Voice-Sentences`](https://huggingface.co/dat
96
  plus 35.6 min of LibriSpeech-PC replay (cased, punctuated; CC-BY-4.0) = 391.0 min, 3,848 clips.
97
  - Validation: 1 in 16 of the speaker's train takes by id hash, used only to pick the checkpoint.
98
 
99
- <!-- training-categories:begin -->
100
- ## Data categories
101
-
102
- Every category in the training data, what it is for, one real prompt, and which model line trains on it (Sabich = everything blend, Jachnun = code-switching, Fritter = everything except code-switching, formerly Boxty). Generated by `scripts/build_training_categories.py` in the training repo.
103
-
104
- | Category | What it trains | Example (said β†’ written) | Sabich | Jachnun | Fritter |
105
- |---|---|---|---|---|---|
106
- | Code-switching | Hebrew words inside English sentences, written in the canonical romanization (the core objective). | β€œDo you want amba on your sabich or just tahini?” | βœ“ | βœ“ | – |
107
- | Israeli names and places | Israeli and Jewish first names, surnames and place names. | β€œHi Omri, the tiyul to Ein Gedi is still on for Saturday morning if you want to join us.” | βœ“ | βœ“ | – |
108
- | Yiddish | Yiddish words in English; always also code-switching. | β€œThese rugelach are fresh and absolutely delicious.” | βœ“ | βœ“ | – |
109
- | Jewish religious terms | Jewish religious and observance vocabulary; always also code-switching. | β€œWhere exactly did the Beis Hamikdash stand relative to the Old City walls?” | βœ“ | βœ“ | – |
110
- | Plain English | Everyday English, kept so the model does not forget ordinary speech. | β€œDo we have any rice left, or should I make pasta for dinner tonight instead?” | βœ“ | βœ“ (English share) | βœ“ |
111
- | Dictated email | Email register: greetings, requests, sign-offs. | β€œHi Dana, just following up on my email from last week, did you get a chance to look at it?” | βœ“ | βœ“ (English share) | βœ“ |
112
- | Messages and notes | WhatsApp messages and notes to self. | β€œHey, did the money for the cinema tickets ever come through? No rush, just checking because I have to pay them back.” | βœ“ | βœ“ (English share) | βœ“ |
113
- | Homophones | Sentences whose context settles a homophone (their / there, steak / stake). | β€œCould we hire a van for Saturday instead of borrowing Pete's?” | βœ“ | βœ“ (English share) | βœ“ |
114
- | Numbers in digits | Numbers written in digits, not words (DeepSeek 4.1, 45 seconds). | β€œThe battery dropped from 80% to 15% in under three hours.” | βœ“ | βœ“ (English share) | βœ“ |
115
- | Personal vocabulary | Daniel's own names, companies and project names. | β€œDaniel Rosehill writes the prompts, and Corn and Herman turn them into an episode.” | βœ“ | βœ“ (English share) | βœ“ |
116
- | Tech vocabulary | AI and software terms, product names, commands. | β€œA GitHub Gist is still the fastest way to share a one-off shell script with someone.” | βœ“ | βœ“ (English share) | βœ“ |
117
- | Talking to AI tools | Prompts and instructions dictated to AI assistants. | β€œTurn on flash attention so the long recordings fit in memory.” | βœ“ | βœ“ (English share) | βœ“ |
118
- | Linux admin | Linux commands, tools and system administration. | β€œRun a traceroute to the VPS from the home server and see where the latency jumps.” | βœ“ | βœ“ (English share) | βœ“ |
119
- | Smart home | Home Assistant and smart-home devices and commands. | β€œSmartThings was my very first hub, before I found Home Assistant.” | βœ“ | βœ“ (English share) | βœ“ |
120
- | Long dictation | Paragraph-length dictation, 50 to 110 words in one take. | β€œQuick update on the server situation. The WhatsApp bot stopped replying last night because uvicorn crashed after I updated Ubuntu. …” | βœ“ | βœ“ (English share) | βœ“ |
121
- | Field corrections | Free speech the stock model got wrong, corrected by hand (Correct mode). | | βœ“ | βœ“ (English share) | βœ“ |
122
- | Currency | Spoken amounts written as typed: fifty shekels becomes 50 NIS, twenty dollars $20. | The license is 99 dollars once, no subscription. β†’ β€œThe license is $99 once, no subscription.” | βœ“ | βœ“ (English share) | βœ“ |
123
- | Numbers (not money) | Temperatures, decimals, percentages, units, times, dates and ordinals in digits. | It was minus two degrees Celsius in Berlin this morning. β†’ β€œIt was -2 degrees Celsius in Berlin this morning.” | βœ“ | – | βœ“ |
124
- | Web addresses | Addresses said aloud (dot, slash, colon) written as typed. | The meeting notes are at example dot com slash notes slash october dash twenty. β†’ β€œThe meeting notes are at example.com/notes/october-20.” | βœ“ | – | βœ“ |
125
- | Spelling out | Letters spelled aloud written as the word they spell. | My surname is B R E N N A N. β†’ β€œMy surname is Brennan.” | βœ“ | – | βœ“ |
126
- | Acronyms | Letter-by-letter acronyms (API, SSH) and word acronyms (NASA, JSON) in their standard form. | β€œThe ROI on that campaign was higher than anyone expected.” | βœ“ | – | βœ“ |
127
- | Expanded acronyms | Chat and business shorthand said as letters, written out (EOD becomes end of day). | The documentation is the weakest part of the project, IMO. β†’ β€œThe documentation is the weakest part of the project, in my opinion.” | βœ“ | – | βœ“ |
128
- | Brand and product names | Company, product, AI model and open-source names in their official spelling. | β€œI asked Claude to review the pull request, and it caught a typo in the config.” | βœ“ | – | βœ“ |
129
- | Procurement | Incoterms, POs, RFQs, lead times and payment terms. | β€œAsk them if they'll lower the MOQ for the first order and treat it as a trial.” | βœ“ | – | βœ“ |
130
- | Idioms | Idioms ASR tends to spell as a sound-alike (free rein, toe the line). | β€œWe gave the contractor free rein on the kitchen layout, and honestly it turned out better than my plan.” | βœ“ | – | βœ“ |
131
- | Latin phrases | Latin phrases used in English (de facto, ad hominem, de minimis) in their standard spelling: lowercase, no hyphen. | β€œWe ended up with a de facto ban on parking outside the school after the council's new notice.” | βœ“ | – | βœ“ |
132
- | Short fragments | One- to six-word replies, notes, list items and headings (Parakeet v2 is weakest on incomplete sentences). | | βœ“ | – | βœ“ |
133
- | Names and figures | Sentences packed with names, amounts, percentages and dates, numbers in digits (Earnings-22 style). | | βœ“ | – | βœ“ |
134
- | Spoken punctuation | Dictated comma, full stop, question mark and colon written as the mark; controls keep the words. | | βœ“ | – | βœ“ |
135
- | Hard sentences | Harvard sentences, tongue twisters, homographs, garden paths, rare words. | β€œThe birch canoe slid on the smooth planks.” | βœ“ | – | βœ“ |
136
- | Irish English | Irish English words, grammar and Irish-language names with fadas. | β€œThe new lad at work is deadly, he sorted out the printer in 5 minutes.” | βœ“ | – | βœ“ |
137
- | Disfluency reduction *(experimental)* | Read with uh, um and eh; the transcript stays clean. | Read with hesitations: uh, um, eh. β†’ β€œLosing your grandad must be so hard, I'm really sorry, if you want to talk or just sit together for a bit, I'm around all week.” | βœ“ | – | βœ“ |
138
- | Repeated words *(experimental)* | Words repeated the way people restart; the transcript stays clean. | Read repeating a word now and then (the the report). β†’ β€œHonestly, I never properly thanked her for helping us last week, and it's bugging me now.” | βœ“ | – | βœ“ |
139
- | False starts *(experimental)* | Abandoned starts and doubled words; the transcript drops them. | It's not that I β€” I just don't think we have time for it this week. β†’ β€œI just don't think we have time for it this week.” | βœ“ | – | βœ“ |
140
- | Self-corrections *(experimental)* | A spoken correction (Tuesday, no, Wednesday); the transcript keeps only the corrected version. | Leave the box by the front door, no, by the back door, please. β†’ β€œLeave the box by the back door, please.” | βœ“ | – | βœ“ |
141
- | Asides *(experimental)* | A remark to someone else in the room mid-dictation; it stays out of the transcript. | We need to buy a new washing machine β€” Ezra, not now, sweetie β€” before the old one breaks down completely, ideally under $600. β†’ β€œWe need to buy a new washing machine before the old one breaks down completely, ideally under $600.” | βœ“ | – | βœ“ |
142
- | Paragraphs *(experimental)* | Whole passages in one take, for the separate paragraph model; never in Hebrish training. | β€œThings to sort out with the internet this week. The router keeps dropping the connection for a minute or so in the evenings. …” | – | – | – |
143
- | Whispered *(experimental)* | Whispered speech (robustness). | Whispered. β†’ β€œHonestly I thought the flat looked lovely but the kitchen was tiny, do you think we could live with that?” | βœ“ | – | βœ“ |
144
- | Singing *(experimental)* | Sung sentences (robustness). | Sung, any tune. β†’ β€œDid your cousin ever send you the recipe for that lamb stew or do I need to ask her again?” | βœ“ | – | βœ“ |
145
- | Weird voices *(experimental)* | Put-on voices: deep, squeaky, robot, accents (robustness). | Read in a put-on voice. β†’ β€œDo I need to take the parcel back to the post office or can they collect it from the door?” | – | – | – |
146
- | Name cipher (PII test) *(experimental)* | Experiment: real names read, swapped by rule in the transcript (Hannah becomes Sarah). | Can you tell Daniel the meeting moved to 3 PM? β†’ β€œCan you tell Dave the meeting moved to 3 PM?” | – | – | – |
147
-
148
- βœ“ = in the training recipe. β€œEnglish share” = competes for Jachnun's 30% monolingual-English share. Experimental sets are recorded but off in the capture app by default. This is the current recipe; a published run's exact composition is in its blend file.
149
- <!-- training-categories:end -->
150
-
151
  ## Training
152
 
153
  NeMo 2.7.3 on one L40S (Modal), bf16. AdamW, lr 3e-05 (cosine, 10% warmup), 20 epochs,
@@ -173,9 +78,8 @@ Q4_K_M and F16.
173
  - The test sets are small (Hebrew-free English is 319 clips), so differences under about
174
  one WER point are within noise.
175
  - Not trained on English-Hebrew code-switching: romanized Hebrew words come out as stock v2 writes them.
176
- - Not benchmarked at release.
177
  - Disfluent takes were trained on with clean targets, so the model may drop some fillers and repeated words.
178
 
179
  ## Licence
180
 
181
- CC-BY-4.0, from the base model's licence, with use governed by the Hebrish terms above. Base model by NVIDIA.
 
18
  datasets:
19
  - danielrosehill/Read-Aloud-Voice-Sentences
20
  - openslr/librispeech_asr
 
 
 
 
 
 
21
  ---
22
 
23
  # Fritter v1.0: Parakeet TDT 0.6B v2 for English dictation, no code-switching
24
 
25
+ A personal speech-recognition fine-tune for **English dictation without code-switching**: tech vocabulary (model and product names, CLI and cloud terms), brand names, acronyms, numbers and currency in digits, Irish-English phrasing, fast and slow speech, whispering, and everyday email and message dictation, all in one speaker's voice.
26
 
27
+ **Name.** Fritter is the code name of this model line; later retrains keep it and bump the version. The training run id is `r11-general`.
28
 
29
  A full fine-tune of [`nvidia/parakeet-tdt-0.6b-v2`](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2) on one
30
  speaker's read-aloud phone recordings (an Irish English speaker living in Israel), run `r11-general`, trained
31
  2026-10-27. Output keeps v2's casing and punctuation; numbers are written in digits.
32
 
33
+ **Licence and access.** Public, CC-BY-NC-4.0 (non-commercial). A personal project by Daniel Rosehill; not affiliated with NVIDIA.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
 
35
  ## Results
36
 
 
53
  plus 35.6 min of LibriSpeech-PC replay (cased, punctuated; CC-BY-4.0) = 391.0 min, 3,848 clips.
54
  - Validation: 1 in 16 of the speaker's train takes by id hash, used only to pick the checkpoint.
55
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
  ## Training
57
 
58
  NeMo 2.7.3 on one L40S (Modal), bf16. AdamW, lr 3e-05 (cosine, 10% warmup), 20 epochs,
 
78
  - The test sets are small (Hebrew-free English is 319 clips), so differences under about
79
  one WER point are within noise.
80
  - Not trained on English-Hebrew code-switching: romanized Hebrew words come out as stock v2 writes them.
 
81
  - Disfluent takes were trained on with clean targets, so the model may drop some fillers and repeated words.
82
 
83
  ## Licence
84
 
85
+ CC-BY-NC-4.0. The base model, `nvidia/parakeet-tdt-0.6b-v2`, is CC-BY-4.0, by NVIDIA.