Jev Decision Index
🔬
240
Benchmarks and news on various repros of TypeSafe's Jev
🏗️ Building on HF
Madalin Tatarciuc
cetusian
AI & ML interests
instinctively gravitating toward the frontier where intelligence meets constraints.
Recent Activity
liked a Space about 12 hours ago
multimodalart/jev-decision-index liked a Space about 17 hours ago
lerobot/visualize_dataset posted an update about 19 hours ago
Surogate Speech is out 🐇 small open speech models for agents, the speech side of Surogate.
First language shipped is Romanian, and the numbers came out better than I expected: 5.69% WER on FLEURS with a 116M model. Canary 1B gets 5.95% on the same clips, Whisper large-v3 8.42%. Leaderboard runner, one RTX 5090.
What's in it:
🎧 jackrabbit-110m-ro: speech recognition, 2,500× real time on one GPU
⚡ jackrabbit-110m-ro-streaming: live, final text about 0.7 s after you stop talking
🗣️ amami-357m-ro: TTS with three voices, runs on a CPU
Serving is one line with our engine: surogate serve --stt surogate/jackrabbit-110m-ro
Transcripts for every clip are public if you want to rescore it.
https://huggingface.co/collections/surogate/surogate-speech-6ab680eb84c7ff75fb73ad5a
https://github.com/invergent-ai/surogate-speechOrganizations
liked a
Space about 12 hours ago
liked a
Space about 17 hours ago
posted an update about 19 hours ago
Post
66
Surogate Speech is out 🐇 small open speech models for agents, the speech side of Surogate.
First language shipped is Romanian, and the numbers came out better than I expected: 5.69% WER on FLEURS with a 116M model. Canary 1B gets 5.95% on the same clips, Whisper large-v3 8.42%. Leaderboard runner, one RTX 5090.
What's in it:
🎧 jackrabbit-110m-ro: speech recognition, 2,500× real time on one GPU
⚡ jackrabbit-110m-ro-streaming: live, final text about 0.7 s after you stop talking
🗣️ amami-357m-ro: TTS with three voices, runs on a CPU
Serving is one line with our engine: surogate serve --stt surogate/jackrabbit-110m-ro
Transcripts for every clip are public if you want to rescore it.
surogate/surogate-speech-6ab680eb84c7ff75fb73ad5a
https://github.com/invergent-ai/surogate-speech
First language shipped is Romanian, and the numbers came out better than I expected: 5.69% WER on FLEURS with a 116M model. Canary 1B gets 5.95% on the same clips, Whisper large-v3 8.42%. Leaderboard runner, one RTX 5090.
What's in it:
🎧 jackrabbit-110m-ro: speech recognition, 2,500× real time on one GPU
⚡ jackrabbit-110m-ro-streaming: live, final text about 0.7 s after you stop talking
🗣️ amami-357m-ro: TTS with three voices, runs on a CPU
Serving is one line with our engine: surogate serve --stt surogate/jackrabbit-110m-ro
Transcripts for every clip are public if you want to rescore it.
surogate/surogate-speech-6ab680eb84c7ff75fb73ad5a
https://github.com/invergent-ai/surogate-speech
published an article about 19 hours ago
Article
Amami, the voice of Surogate Speech 🗣️
cetusian
• published an article about 19 hours ago
Article
Jackrabbit, the ears of Surogate Speech 🎧
cetusian
• published an article about 19 hours ago
Article
Surogate Speech: small open speech models for agents 🐇
cetusian
• published a
dataset about 19 hours ago
published 3
models about 19 hours ago
updated a
collection about 19 hours ago
updated a
dataset about 20 hours ago
updated a
collection about 20 hours ago
updated a
model about 20 hours ago
updated a
collection about 20 hours ago
liked a
Space about 21 hours ago
updated a
model about 23 hours ago