Instructions to use SadikNawazAI/kitten-tts-2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SadikNawazAI/kitten-tts-2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf SadikNawazAI/kitten-tts-2 # Run inference directly in the terminal: llama cli -hf SadikNawazAI/kitten-tts-2
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf SadikNawazAI/kitten-tts-2 # Run inference directly in the terminal: llama cli -hf SadikNawazAI/kitten-tts-2
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf SadikNawazAI/kitten-tts-2 # Run inference directly in the terminal: ./build/bin/llama cli -hf SadikNawazAI/kitten-tts-2
Use Docker
docker model run hf.co/SadikNawazAI/kitten-tts-2
- Llama new
- LM Studio
- Jan
- Ollama
How to use SadikNawazAI/kitten-tts-2 with Ollama:
ollama run hf.co/SadikNawazAI/kitten-tts-2
- Unsloth Desktop
- Docker Model Runner
How to use SadikNawazAI/kitten-tts-2 with Docker Model Runner:
docker model run hf.co/SadikNawazAI/kitten-tts-2
- Lemonade
How to use SadikNawazAI/kitten-tts-2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SadikNawazAI/kitten-tts-2
Run and chat with the model
lemonade run user.kitten-tts-2-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
KittenTTS 2 β GGUF (TQ2_1 ternary)
GGUF language-model component of KittenML/kitten-tts-2, a 1.7B speech language model with in-context voice cloning. The model reads text and writes S3 codec tokens, which a vocoder turns into 24 kHz audio.
This is an exact mirror (identical SHA-256) of cpp/model-tq2_1.gguf from the upstream repo,
republished here as the GGUF that Ollama pulls for hf.co/KittenML/kitten-tts-2:latest.
Note: this repository contains only the ternary GGUF language model. A complete TTS pipeline also needs the decoder/vocoder and voice references from the upstream repository. For the full Python pipeline use
pip install kittenmlwithKittenTTS("KittenML/kitten-tts-2").
Model details
| Property | Value |
|---|---|
| Base model | KittenTTS 2 (Stellon Labs) |
| Architecture | qwen3 |
| Parameters | 1.73B |
| Quantization | TQ2_1 (1.58-bit ternary body, full-precision scales) |
| File size | 0.96 GiB (1.03 GB) |
| Context length | 40,960 tokens |
| Embedding dim | 2,048 |
| Layers | 28 |
| Vocabulary | 158,241 |
| Languages | 16 named voices: Arabic, Chinese, Dutch, English, French, German, Hindi, Indonesian, Italian, Japanese, Korean, Polish, Portuguese, Russian, Spanish, Turkish |
The ternary packing is lossless relative to the bf16 weights for the transformer body β
each value is exactly one of {-scale, 0, +scale} within 128-wide groups.
Files
| File | SHA-256 |
|---|---|
model-tq2_1.gguf |
c6ad7ee1dbda3fd7a2b3dc3b8b1689f4687f761b7bd6509569b5592f543548f7 |
Usage
Ollama
ollama run hf.co/SadikNawazAI/kitten-tts-2
Python (full upstream pipeline)
pip install kittenml
from kittenml import KittenTTS
import soundfile as sf
m = KittenTTS("KittenML/kitten-tts-2")
audio = m.generate("Hi! How are you today?", voice="WeatherPresenterCheerful")
sf.write("output.wav", audio, m.sample_rate)
Download the standalone GGUF:
hf download SadikNawazAI/kitten-tts-2 model-tq2_1.gguf --local-dir .
License
Stellon Labs Community License β see LICENSE.md and the
upstream license.
Review the terms for research, non-commercial, and commercial use before deploying.
- Downloads last month
- -
We're not able to determine the quantization variants.
Model tree for SadikNawazAI/kitten-tts-2
Base model
KittenML/kitten-tts-2