Article
Small CPU text-to-speech models compared: Piper, Kokoro, pocket-tts and Linnet on one core
VoxRT
• • 1
Marat
maratos
AI & ML interests
None yet
Recent Activity
updated a Space 4 days ago
VoxRT/linnet-tts updated a model 4 days ago
VoxRT/linnet-en-35m repliedto their post 8 days ago
LinnetTTS: a 41 M-parameter English text-to-speech model with voice prompts that streams from the first 80 ms and runs in real time on one phone CPU core. Code Apache-2.0; weights under the Linnet Weights License (free to use in your own products, commercial included).
Same machine, same three texts, each model through its own Python package. Speed only, quality not measured:
- Linnet 41 M: RTF 10.6 % on one core (3.4 % on four), first audio 87 ms, 187 MB RSS, voice prompts, streams every 80 ms
- pocket-tts 100 M: 23.8 % on two cores, 968 MB, voice prompts, streams every 80 ms
- Kokoro-82M: 51.7 %, 1.2 GB, whole utterance per call, 8 languages
- Piper medium 16 M: 5.8 %, 503 MB, no voice prompts, per-sentence chunks
On phones: iPhone 13 Pro Max 5.5 ms per 80 ms step, iPhone 11 7 ms, Snapdragon 662 14 ms on four cores.
🎧 Hear the same sentence from all four, side by side: the "Compare" tab of the demo Space https://huggingface.co/spaces/VoxRT/linnet-tts (type your own text for Linnet there too)
📦 Weights and model card: https://huggingface.co/VoxRT/linnet-en-35m
🦀 Code, Rust runtime, bindings for Linux C, Python (pip install linnet-tts), Android and iOS, and the benchmark script: https://github.com/VoxRT/LinnetTTS
📊 Method: https://github.com/VoxRT/LinnetTTS/blob/main/docs/benchmarks.md
📝 Write-up with the trade-offs and the samples: https://huggingface.co/blog/VoxRT/small-cpu-text-to-speech-models-compared-piper-kok
📚 Collection of small CPU TTS models and their demos: https://huggingface.co/collections/VoxRT/on-device-tts-small-models-that-run-on-a-cpu-6aec390f2f84a4407d227cf4
English only for now; no text normalisation, so write numbers as words. If it is useful to you, a like on the model or the Space helps other people find it. Questions welcome.
Organizations
published an article 9 days ago