jin9581 commited on
Commit
ea9eb32
·
verified ·
1 Parent(s): e49b712

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -19
README.md CHANGED
@@ -10,12 +10,21 @@ tags:
10
  - block-diffusion
11
  - speech-synthesis
12
  ---
 
13
 
14
- # Chatterbox-Flash
15
 
16
- Chatterbox-Flash is a **block-diffusion zero-shot TTS model** that extends
17
- the [Chatterbox-TTS](https://github.com/resemble-ai/chatterbox) pipeline
18
- with a parallel masked decoder while preserving streaming generation.
 
 
 
 
 
 
 
 
19
 
20
  The released weights cover the four checkpoints needed at inference time:
21
 
@@ -26,16 +35,13 @@ The released weights cover the four checkpoints needed at inference time:
26
  | `ve.safetensors` | GE2E voice encoder (taken verbatim from `ResembleAI/chatterbox`). |
27
  | `tokenizer.json` | English BPE tokenizer (taken verbatim from `ResembleAI/chatterbox`).|
28
 
29
- ## Quick start
30
-
31
  ```bash
32
  pip install chatterbox-flash
33
  ```
34
-
35
  ```python
36
  import torchaudio as ta
37
  from chatterbox_flash import ChatterboxFlashTTS
38
-
39
  tts = ChatterboxFlashTTS.from_pretrained("ResembleAI/chatterbox-flash", device="cuda")
40
  wav = tts.generate(
41
  "Hello, world.",
@@ -44,15 +50,13 @@ wav = tts.generate(
44
  ta.save("out.wav", wav.unsqueeze(0).cpu(), tts.sr)
45
  ```
46
 
47
- ## Inference defaults (paper configuration)
48
-
49
- * Block size `D = 16`
50
- * Maximum `K = 10` denoising steps per block
51
- * Sampling temperature `0.6`
52
- * `shift` outlier schedule with `tau = 0.1`
53
- * Zero-text-batch CFG with `w = 1.5`, `pmi_cfg` combination, `zero_all` null prefix
54
- * FlashInfer paged KV cache + CUDA graph capture
55
-
56
- ## License
57
 
58
- MIT — see `LICENSE` in the source repository.
 
 
10
  - block-diffusion
11
  - speech-synthesis
12
  ---
13
+ <img width="800" alt="Resemble_AI_Chatterbox_Flash" src="https://cdn-uploads.huggingface.co/production/uploads/68af35bc5928acf3617150db/lCegiC8uo_eA3RHOVC6go.png" />
14
 
15
+ <h1 style="font-size: 32px">Chatterbox-Flash</h1>
16
 
17
+ <div style="display: flex; align-items: center; gap: 12px">
18
+ <a href="https://huggingface.co/ResembleAI/chatterbox-flash">
19
+ <img src="https://huggingface.co/datasets/huggingface/badges/resolve/main/open-in-hf-spaces-sm.svg" alt="Open in HF" />
20
+ </a>
21
+ </div>
22
+ <div style="display: flex; align-items: center; gap: 8px;">
23
+ <span style="font-style: italic;white-space: pre-wrap">Made with ❤️ by</span>
24
+ <img width="100" alt="resemble-logo-horizontal" src="https://github.com/user-attachments/assets/35cf756b-3506-4943-9c72-c05ddfa4e525" />
25
+ </div>
26
+
27
+ Chatterbox-Flash is a **block-diffusion zero-shot TTS model** that extends the [Chatterbox-TTS](https://github.com/resemble-ai/chatterbox) pipeline with a parallel masked decoder while preserving streaming generation.
28
 
29
  The released weights cover the four checkpoints needed at inference time:
30
 
 
35
  | `ve.safetensors` | GE2E voice encoder (taken verbatim from `ResembleAI/chatterbox`). |
36
  | `tokenizer.json` | English BPE tokenizer (taken verbatim from `ResembleAI/chatterbox`).|
37
 
38
+ # Quick start
 
39
  ```bash
40
  pip install chatterbox-flash
41
  ```
 
42
  ```python
43
  import torchaudio as ta
44
  from chatterbox_flash import ChatterboxFlashTTS
 
45
  tts = ChatterboxFlashTTS.from_pretrained("ResembleAI/chatterbox-flash", device="cuda")
46
  wav = tts.generate(
47
  "Hello, world.",
 
50
  ta.save("out.wav", wav.unsqueeze(0).cpu(), tts.sr)
51
  ```
52
 
53
+ # Inference defaults (paper configuration)
54
+ - Block size `D = 16`
55
+ - Maximum `K = 10` denoising steps per block
56
+ - Sampling temperature `0.2`
57
+ - `shift` outlier schedule with `tau = 0.5`
58
+ - CFG with `w = 1.0`, `pmi_cfg` combination
59
+ - FlashInfer paged KV cache + CUDA graph capture
 
 
 
60
 
61
+ # License
62
+ MIT — see `LICENSE` in the source repository.