walln commited on
Commit
5d5bd90
·
verified ·
1 Parent(s): 7b6f332

Expand model card

Browse files
Files changed (1) hide show
  1. README.md +40 -14
README.md CHANGED
@@ -6,27 +6,53 @@ tags:
6
  - speech
7
  - gemma-4
8
  - csm
 
9
  ---
10
 
11
  # Parley
12
 
13
- A full-duplex speech model: Gemma 4 12B listens while it talks and decides every 80 ms
14
- whether to speak, keep speaking, or listen. CSM-1B speaks its words.
 
15
 
16
- This repository contains the LoRA adapter and processor for the `e498` checkpoint
17
- (`talker-v6`, seed 43), the live model used through a noise gate.
18
 
19
- ## Usage
 
 
 
 
 
20
 
21
- ```bash
22
- pip/uv install from https://github.com/walln/parley
23
- uv run parley download walln/parley --out checkpoints/parley
24
- uv run parley serve --checkpoint checkpoints/parley --prompt "You are a helpful assistant."
25
- ```
26
 
27
- ## License
28
 
29
- Weights: research-only (CC-BY-NC 4.0). Code: Apache-2.0.
 
 
30
 
31
- Base components: Gemma 4 12B (Apache 2.0), CSM-1B (Apache 2.0, Llama 3.2
32
- Community License), Mimi (CC-BY 4.0).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - speech
7
  - gemma-4
8
  - csm
9
+ - lora
10
  ---
11
 
12
  # Parley
13
 
14
+ Parley is a full-duplex speech model. It listens while it talks and decides every 80 ms
15
+ whether to speak, keep speaking, or listen. There is no turn detector: the model itself
16
+ makes every timing decision, frame by frame.
17
 
18
+ ## What it is
 
19
 
20
+ - **Thinker:** Gemma 4 12B (audio-native, no speech encoder). It hears 16 kHz audio in
21
+ 40 ms slices and writes text or control tokens on an 80 ms clock: `SIL` while listening,
22
+ `EPS` while still speaking, or words when it has them.
23
+ - **Talker:** CSM-1B (Sesame) speaks the words Gemma writes, in chunks, through a playout
24
+ queue that handles interruption and yielding.
25
+ - **Codec:** Mimi (Kyutai) provides the audio codes CSM renders.
26
 
27
+ Gemma never predicts audio. The thinker/talker split keeps recall high and avoids the
28
+ acoustic glitches of a single model generating its own codes.
 
 
 
29
 
30
+ ## Intended use
31
 
32
+ Research, experimentation, and demos of full-duplex voice interaction. Not a production
33
+ voice agent. See the project repo for the live demo and code:
34
+ https://github.com/walln/parley
35
 
36
+ ## Limitations
37
+
38
+ - Trained on synthetic voices only; recorded human speech is weaker.
39
+ - One voice (the CSM reference clip).
40
+ - Gemma gets one text token per frame, so long text/tool calls do not fit.
41
+ - Research-only weights.
42
+
43
+ ## Components and licenses
44
+
45
+ - Gemma 4 12B (`google/gemma-4-12B-it`) — Apache 2.0.
46
+ - CSM-1B (`sesame/csm-1b`) — Apache 2.0, built on Llama 3.2 (Llama Community License).
47
+ - Mimi (`kyutai/mimi`) — CC-BY 4.0.
48
+
49
+ ## Weights license
50
+
51
+ Research-only (CC-BY-NC 4.0). Commercial use requires a separate agreement.
52
+
53
+ ## Citation
54
+
55
+ Blog post: "Inside Frankenstein's lab: a full-duplex model at home"
56
+ (https://nickwall.dev, 2026). Code: https://github.com/walln/parley.
57
+ EOF
58
+ echo done