Instructions to use BricksDisplay/Chatterbox-Multilingual-TTS-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Chatterbox
How to use BricksDisplay/Chatterbox-Multilingual-TTS-GGUF with Chatterbox:
# pip install chatterbox-tts import torchaudio as ta from chatterbox.tts import ChatterboxTTS model = ChatterboxTTS.from_pretrained(device="cuda") text = "Ezreal and Jinx teamed up with Ahri, Yasuo, and Teemo to take down the enemy's Nexus in an epic late-game pentakill." wav = model.generate(text) ta.save("test-1.wav", wav, model.sr) # If you want to synthesize with a different voice, specify the audio prompt AUDIO_PROMPT_PATH="YOUR_FILE.wav" wav = model.generate(text, audio_prompt_path=AUDIO_PROMPT_PATH) ta.save("test-2.wav", wav, model.sr) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use BricksDisplay/Chatterbox-Multilingual-TTS-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
Use Docker
docker model run hf.co/BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use BricksDisplay/Chatterbox-Multilingual-TTS-GGUF with Ollama:
ollama run hf.co/BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use BricksDisplay/Chatterbox-Multilingual-TTS-GGUF with Docker Model Runner:
docker model run hf.co/BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
- Lemonade
How to use BricksDisplay/Chatterbox-Multilingual-TTS-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull BricksDisplay/Chatterbox-Multilingual-TTS-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Chatterbox-Multilingual-TTS-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
To use with llama.cpp
It says: “Runs in stock llama.cpp with embeddings=true.”
Could you please provide the command-line syntax for running it? I just can't seem to get it to work.
And how do I then get the WAV file or access it via HTTP?
Oh... The announce is written by Claude Code, the README is not precise enough.
Actually we built a codec.cpp which is served for LLM backbone (llama.cpp) + audio tokenizer (a seperated graph for audio enc-decoder model) structure.
For Chatterbox you can run it in llama.cpp without patch, but you will got uninterpretable outputs. You need codec.cpp to decode it.
Have you tried this version in a language other than English?
For example, ru:
./tts-cli synthesize --backbone chatterbox-mtl-t3-q4_k_s.gguf --model chatterbox-mtl-codec-q4_k_m.gguf --text "[ru] Привет! Это проверка на русском" --output out_ru.wav
It produces something incomprehensible.
Français - better, but "ç" - is like "c".
--text "[fr] Salut ! C'est un test en français."
if trying, as described in the card
text = "[ru]" + unicodedata.normalize("NFKD", "Привет! Это проверка на русском.lower())
text = "[fr]" + unicodedata.normalize("NFKD", "Salut ! C'est un test en français.".lower())
makes no difference
Thanks for the report! codec.cpp's Chatterbox tokenizer turned all non-ASCII letters (Cyrillic, "ç", etc.) into [UNK]. We had only tested English and Chinese, and both happen to avoid the bug. It's fixed in 67a30d3. Just pull and rebuild; you don't need new GGUFs.