Automatic Speech Recognition
NeMo
ONNX
GGUF
English
parakeet
tdt
speaker-adaptation
english
tech-vocabulary
irish-english
dictation
fritter
Instructions to use danielrosehill/Fritter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use danielrosehill/Fritter with NeMo:
import nemo.collections.asr as nemo_asr asr_model = nemo_asr.models.ASRModel.from_pretrained("danielrosehill/Fritter") transcriptions = asr_model.transcribe(["file.wav"]) - Notebooks
- Google Colab
- Kaggle
Card: standalone, no gate (public)
Browse files
README.md
CHANGED
|
@@ -18,62 +18,19 @@ tags:
|
|
| 18 |
datasets:
|
| 19 |
- danielrosehill/Read-Aloud-Voice-Sentences
|
| 20 |
- openslr/librispeech_asr
|
| 21 |
-
extra_gated_prompt: "Access to this model is by request and is governed by the Hebrish terms of use (https://hebrish.app/terms). Non-commercial use is free; commercial use needs a commercial licence from access@hebrish.app."
|
| 22 |
-
extra_gated_fields:
|
| 23 |
-
Name: text
|
| 24 |
-
Organisation: text
|
| 25 |
-
Intended use: text
|
| 26 |
-
"I agree to use this model under the Hebrish terms of use (non-commercial unless I hold a commercial licence)": checkbox
|
| 27 |
---
|
| 28 |
|
| 29 |
# Fritter v1.0: Parakeet TDT 0.6B v2 for English dictation, no code-switching
|
| 30 |
|
| 31 |
-
A personal speech-recognition fine-tune for **English dictation without code-switching**: tech vocabulary (model and product names, CLI and cloud terms), brand names, acronyms, numbers and currency in digits, Irish-English phrasing, fast and slow speech, whispering, and everyday email and message dictation, all in one speaker's voice.
|
| 32 |
|
| 33 |
-
**Name.**
|
| 34 |
|
| 35 |
A full fine-tune of [`nvidia/parakeet-tdt-0.6b-v2`](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2) on one
|
| 36 |
speaker's read-aloud phone recordings (an Irish English speaker living in Israel), run `r11-general`, trained
|
| 37 |
2026-10-27. Output keeps v2's casing and punctuation; numbers are written in digits.
|
| 38 |
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
**Access and terms of use.** Governed by the [Hebrish terms of use](https://hebrish.app/terms); access is by
|
| 42 |
-
request (button on this page, or [access@hebrish.app](mailto:access@hebrish.app)). Non-commercial
|
| 43 |
-
use is free; commercial use needs a commercial licence.
|
| 44 |
-
|
| 45 |
-
<!-- hebrish-listen:begin -->
|
| 46 |
-
## Listen: what Hebrish is and how it's made
|
| 47 |
-
|
| 48 |
-
A spoken introduction to the project by the person who makes it: why Hebrish exists, why stock
|
| 49 |
-
speech-to-text gets Hebrew words wrong, how the fine-tunes are trained, the model lines (Sabich,
|
| 50 |
-
Jachnun, Shakshuka, Meorav), how the training data is recorded, and the plans for the apps.
|
| 51 |
-
|
| 52 |
-
| | |
|
| 53 |
-
| --- | --- |
|
| 54 |
-
| Listen | [hebrish.app/updates](https://hebrish.app/updates): player, chapters, edited transcript, MP3 download |
|
| 55 |
-
| Author | Daniel Rosehill |
|
| 56 |
-
| Recorded | 2026-10-22 |
|
| 57 |
-
| Runtime | 1:07:03 |
|
| 58 |
-
|
| 59 |
-
Chapters (each opens the player at that point):
|
| 60 |
-
[0:00](https://hebrish.app/updates#t=0) Why this voice note Β·
|
| 61 |
-
[1:36](https://hebrish.app/updates#t=96) Coming to speech to text Β·
|
| 62 |
-
[6:36](https://hebrish.app/updates#t=396) Why Hebrew words go wrong Β·
|
| 63 |
-
[9:23](https://hebrish.app/updates#t=563) How the fine-tune works Β·
|
| 64 |
-
[12:27](https://hebrish.app/updates#t=747) Why Parakeet, and the model plan Β·
|
| 65 |
-
[17:44](https://hebrish.app/updates#t=1064) Disfluencies, shekels, paragraphs Β·
|
| 66 |
-
[25:40](https://hebrish.app/updates#t=1540) Tech vocabulary and Meorav Β·
|
| 67 |
-
[29:07](https://hebrish.app/updates#t=1747) The kitchen sink: Sabich and Jachnun Β·
|
| 68 |
-
[33:35](https://hebrish.app/updates#t=2015) Licensing, accents, noisy recordings Β·
|
| 69 |
-
[39:10](https://hebrish.app/updates#t=2350) One recorder for ASR and TTS Β·
|
| 70 |
-
[41:04](https://hebrish.app/updates#t=2464) Desktop shortcuts and the macro pad Β·
|
| 71 |
-
[43:34](https://hebrish.app/updates#t=2614) Android: Bluetooth and one button Β·
|
| 72 |
-
[45:35](https://hebrish.app/updates#t=2735) Streaming and Shakshuka Β·
|
| 73 |
-
[50:28](https://hebrish.app/updates#t=3028) Long-form transcription Β·
|
| 74 |
-
[56:00](https://hebrish.app/updates#t=3360) Output modes Β·
|
| 75 |
-
[63:01](https://hebrish.app/updates#t=3781) Report a word, and more voices
|
| 76 |
-
<!-- hebrish-listen:end -->
|
| 77 |
|
| 78 |
## Results
|
| 79 |
|
|
@@ -96,58 +53,6 @@ Source: [`danielrosehill/Read-Aloud-Voice-Sentences`](https://huggingface.co/dat
|
|
| 96 |
plus 35.6 min of LibriSpeech-PC replay (cased, punctuated; CC-BY-4.0) = 391.0 min, 3,848 clips.
|
| 97 |
- Validation: 1 in 16 of the speaker's train takes by id hash, used only to pick the checkpoint.
|
| 98 |
|
| 99 |
-
<!-- training-categories:begin -->
|
| 100 |
-
## Data categories
|
| 101 |
-
|
| 102 |
-
Every category in the training data, what it is for, one real prompt, and which model line trains on it (Sabich = everything blend, Jachnun = code-switching, Fritter = everything except code-switching, formerly Boxty). Generated by `scripts/build_training_categories.py` in the training repo.
|
| 103 |
-
|
| 104 |
-
| Category | What it trains | Example (said β written) | Sabich | Jachnun | Fritter |
|
| 105 |
-
|---|---|---|---|---|---|
|
| 106 |
-
| Code-switching | Hebrew words inside English sentences, written in the canonical romanization (the core objective). | βDo you want amba on your sabich or just tahini?β | β | β | β |
|
| 107 |
-
| Israeli names and places | Israeli and Jewish first names, surnames and place names. | βHi Omri, the tiyul to Ein Gedi is still on for Saturday morning if you want to join us.β | β | β | β |
|
| 108 |
-
| Yiddish | Yiddish words in English; always also code-switching. | βThese rugelach are fresh and absolutely delicious.β | β | β | β |
|
| 109 |
-
| Jewish religious terms | Jewish religious and observance vocabulary; always also code-switching. | βWhere exactly did the Beis Hamikdash stand relative to the Old City walls?β | β | β | β |
|
| 110 |
-
| Plain English | Everyday English, kept so the model does not forget ordinary speech. | βDo we have any rice left, or should I make pasta for dinner tonight instead?β | β | β (English share) | β |
|
| 111 |
-
| Dictated email | Email register: greetings, requests, sign-offs. | βHi Dana, just following up on my email from last week, did you get a chance to look at it?β | β | β (English share) | β |
|
| 112 |
-
| Messages and notes | WhatsApp messages and notes to self. | βHey, did the money for the cinema tickets ever come through? No rush, just checking because I have to pay them back.β | β | β (English share) | β |
|
| 113 |
-
| Homophones | Sentences whose context settles a homophone (their / there, steak / stake). | βCould we hire a van for Saturday instead of borrowing Pete's?β | β | β (English share) | β |
|
| 114 |
-
| Numbers in digits | Numbers written in digits, not words (DeepSeek 4.1, 45 seconds). | βThe battery dropped from 80% to 15% in under three hours.β | β | β (English share) | β |
|
| 115 |
-
| Personal vocabulary | Daniel's own names, companies and project names. | βDaniel Rosehill writes the prompts, and Corn and Herman turn them into an episode.β | β | β (English share) | β |
|
| 116 |
-
| Tech vocabulary | AI and software terms, product names, commands. | βA GitHub Gist is still the fastest way to share a one-off shell script with someone.β | β | β (English share) | β |
|
| 117 |
-
| Talking to AI tools | Prompts and instructions dictated to AI assistants. | βTurn on flash attention so the long recordings fit in memory.β | β | β (English share) | β |
|
| 118 |
-
| Linux admin | Linux commands, tools and system administration. | βRun a traceroute to the VPS from the home server and see where the latency jumps.β | β | β (English share) | β |
|
| 119 |
-
| Smart home | Home Assistant and smart-home devices and commands. | βSmartThings was my very first hub, before I found Home Assistant.β | β | β (English share) | β |
|
| 120 |
-
| Long dictation | Paragraph-length dictation, 50 to 110 words in one take. | βQuick update on the server situation. The WhatsApp bot stopped replying last night because uvicorn crashed after I updated Ubuntu. β¦β | β | β (English share) | β |
|
| 121 |
-
| Field corrections | Free speech the stock model got wrong, corrected by hand (Correct mode). | | β | β (English share) | β |
|
| 122 |
-
| Currency | Spoken amounts written as typed: fifty shekels becomes 50 NIS, twenty dollars $20. | The license is 99 dollars once, no subscription. β βThe license is $99 once, no subscription.β | β | β (English share) | β |
|
| 123 |
-
| Numbers (not money) | Temperatures, decimals, percentages, units, times, dates and ordinals in digits. | It was minus two degrees Celsius in Berlin this morning. β βIt was -2 degrees Celsius in Berlin this morning.β | β | β | β |
|
| 124 |
-
| Web addresses | Addresses said aloud (dot, slash, colon) written as typed. | The meeting notes are at example dot com slash notes slash october dash twenty. β βThe meeting notes are at example.com/notes/october-20.β | β | β | β |
|
| 125 |
-
| Spelling out | Letters spelled aloud written as the word they spell. | My surname is B R E N N A N. β βMy surname is Brennan.β | β | β | β |
|
| 126 |
-
| Acronyms | Letter-by-letter acronyms (API, SSH) and word acronyms (NASA, JSON) in their standard form. | βThe ROI on that campaign was higher than anyone expected.β | β | β | β |
|
| 127 |
-
| Expanded acronyms | Chat and business shorthand said as letters, written out (EOD becomes end of day). | The documentation is the weakest part of the project, IMO. β βThe documentation is the weakest part of the project, in my opinion.β | β | β | β |
|
| 128 |
-
| Brand and product names | Company, product, AI model and open-source names in their official spelling. | βI asked Claude to review the pull request, and it caught a typo in the config.β | β | β | β |
|
| 129 |
-
| Procurement | Incoterms, POs, RFQs, lead times and payment terms. | βAsk them if they'll lower the MOQ for the first order and treat it as a trial.β | β | β | β |
|
| 130 |
-
| Idioms | Idioms ASR tends to spell as a sound-alike (free rein, toe the line). | βWe gave the contractor free rein on the kitchen layout, and honestly it turned out better than my plan.β | β | β | β |
|
| 131 |
-
| Latin phrases | Latin phrases used in English (de facto, ad hominem, de minimis) in their standard spelling: lowercase, no hyphen. | βWe ended up with a de facto ban on parking outside the school after the council's new notice.β | β | β | β |
|
| 132 |
-
| Short fragments | One- to six-word replies, notes, list items and headings (Parakeet v2 is weakest on incomplete sentences). | | β | β | β |
|
| 133 |
-
| Names and figures | Sentences packed with names, amounts, percentages and dates, numbers in digits (Earnings-22 style). | | β | β | β |
|
| 134 |
-
| Spoken punctuation | Dictated comma, full stop, question mark and colon written as the mark; controls keep the words. | | β | β | β |
|
| 135 |
-
| Hard sentences | Harvard sentences, tongue twisters, homographs, garden paths, rare words. | βThe birch canoe slid on the smooth planks.β | β | β | β |
|
| 136 |
-
| Irish English | Irish English words, grammar and Irish-language names with fadas. | βThe new lad at work is deadly, he sorted out the printer in 5 minutes.β | β | β | β |
|
| 137 |
-
| Disfluency reduction *(experimental)* | Read with uh, um and eh; the transcript stays clean. | Read with hesitations: uh, um, eh. β βLosing your grandad must be so hard, I'm really sorry, if you want to talk or just sit together for a bit, I'm around all week.β | β | β | β |
|
| 138 |
-
| Repeated words *(experimental)* | Words repeated the way people restart; the transcript stays clean. | Read repeating a word now and then (the the report). β βHonestly, I never properly thanked her for helping us last week, and it's bugging me now.β | β | β | β |
|
| 139 |
-
| False starts *(experimental)* | Abandoned starts and doubled words; the transcript drops them. | It's not that I β I just don't think we have time for it this week. β βI just don't think we have time for it this week.β | β | β | β |
|
| 140 |
-
| Self-corrections *(experimental)* | A spoken correction (Tuesday, no, Wednesday); the transcript keeps only the corrected version. | Leave the box by the front door, no, by the back door, please. β βLeave the box by the back door, please.β | β | β | β |
|
| 141 |
-
| Asides *(experimental)* | A remark to someone else in the room mid-dictation; it stays out of the transcript. | We need to buy a new washing machine β Ezra, not now, sweetie β before the old one breaks down completely, ideally under $600. β βWe need to buy a new washing machine before the old one breaks down completely, ideally under $600.β | β | β | β |
|
| 142 |
-
| Paragraphs *(experimental)* | Whole passages in one take, for the separate paragraph model; never in Hebrish training. | βThings to sort out with the internet this week. The router keeps dropping the connection for a minute or so in the evenings. β¦β | β | β | β |
|
| 143 |
-
| Whispered *(experimental)* | Whispered speech (robustness). | Whispered. β βHonestly I thought the flat looked lovely but the kitchen was tiny, do you think we could live with that?β | β | β | β |
|
| 144 |
-
| Singing *(experimental)* | Sung sentences (robustness). | Sung, any tune. β βDid your cousin ever send you the recipe for that lamb stew or do I need to ask her again?β | β | β | β |
|
| 145 |
-
| Weird voices *(experimental)* | Put-on voices: deep, squeaky, robot, accents (robustness). | Read in a put-on voice. β βDo I need to take the parcel back to the post office or can they collect it from the door?β | β | β | β |
|
| 146 |
-
| Name cipher (PII test) *(experimental)* | Experiment: real names read, swapped by rule in the transcript (Hannah becomes Sarah). | Can you tell Daniel the meeting moved to 3 PM? β βCan you tell Dave the meeting moved to 3 PM?β | β | β | β |
|
| 147 |
-
|
| 148 |
-
β = in the training recipe. βEnglish shareβ = competes for Jachnun's 30% monolingual-English share. Experimental sets are recorded but off in the capture app by default. This is the current recipe; a published run's exact composition is in its blend file.
|
| 149 |
-
<!-- training-categories:end -->
|
| 150 |
-
|
| 151 |
## Training
|
| 152 |
|
| 153 |
NeMo 2.7.3 on one L40S (Modal), bf16. AdamW, lr 3e-05 (cosine, 10% warmup), 20 epochs,
|
|
@@ -173,9 +78,8 @@ Q4_K_M and F16.
|
|
| 173 |
- The test sets are small (Hebrew-free English is 319 clips), so differences under about
|
| 174 |
one WER point are within noise.
|
| 175 |
- Not trained on English-Hebrew code-switching: romanized Hebrew words come out as stock v2 writes them.
|
| 176 |
-
- Not benchmarked at release.
|
| 177 |
- Disfluent takes were trained on with clean targets, so the model may drop some fillers and repeated words.
|
| 178 |
|
| 179 |
## Licence
|
| 180 |
|
| 181 |
-
CC-BY-4.0
|
|
|
|
| 18 |
datasets:
|
| 19 |
- danielrosehill/Read-Aloud-Voice-Sentences
|
| 20 |
- openslr/librispeech_asr
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
---
|
| 22 |
|
| 23 |
# Fritter v1.0: Parakeet TDT 0.6B v2 for English dictation, no code-switching
|
| 24 |
|
| 25 |
+
A personal speech-recognition fine-tune for **English dictation without code-switching**: tech vocabulary (model and product names, CLI and cloud terms), brand names, acronyms, numbers and currency in digits, Irish-English phrasing, fast and slow speech, whispering, and everyday email and message dictation, all in one speaker's voice.
|
| 26 |
|
| 27 |
+
**Name.** Fritter is the code name of this model line; later retrains keep it and bump the version. The training run id is `r11-general`.
|
| 28 |
|
| 29 |
A full fine-tune of [`nvidia/parakeet-tdt-0.6b-v2`](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2) on one
|
| 30 |
speaker's read-aloud phone recordings (an Irish English speaker living in Israel), run `r11-general`, trained
|
| 31 |
2026-10-27. Output keeps v2's casing and punctuation; numbers are written in digits.
|
| 32 |
|
| 33 |
+
**Licence and access.** Public, CC-BY-NC-4.0 (non-commercial). A personal project by Daniel Rosehill; not affiliated with NVIDIA.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
## Results
|
| 36 |
|
|
|
|
| 53 |
plus 35.6 min of LibriSpeech-PC replay (cased, punctuated; CC-BY-4.0) = 391.0 min, 3,848 clips.
|
| 54 |
- Validation: 1 in 16 of the speaker's train takes by id hash, used only to pick the checkpoint.
|
| 55 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
## Training
|
| 57 |
|
| 58 |
NeMo 2.7.3 on one L40S (Modal), bf16. AdamW, lr 3e-05 (cosine, 10% warmup), 20 epochs,
|
|
|
|
| 78 |
- The test sets are small (Hebrew-free English is 319 clips), so differences under about
|
| 79 |
one WER point are within noise.
|
| 80 |
- Not trained on English-Hebrew code-switching: romanized Hebrew words come out as stock v2 writes them.
|
|
|
|
| 81 |
- Disfluent takes were trained on with clean targets, so the model may drop some fillers and repeated words.
|
| 82 |
|
| 83 |
## Licence
|
| 84 |
|
| 85 |
+
CC-BY-NC-4.0. The base model, `nvidia/parakeet-tdt-0.6b-v2`, is CC-BY-4.0, by NVIDIA.
|