BitKnight commited on
Commit
76c7d43
Β·
verified Β·
1 Parent(s): 02c3ad5

v1.4 / 4B v1.3: Japanese and more languages

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -11,6 +11,8 @@ pinned: false
11
 
12
  **A System One model for speech.** Jev made decision models the idea of the year: typed, probabilistic answers instead of generated text. DuplexJev brings that to raw audio, where a text decision model can't go because the transcript drops the tone. It answers the small closed questions a voice agent needs about every user turn (*has the user finished? should I reply, keep listening or just say "mm-hm"? is this a barge-in? emotion, gender, intent*) as a single token from a frozen LLM that hears the audio directly. **10 decisions in 92 ms**, 21Γ— faster than ASR β†’ LLM, under $0.50 per million decisions (4B).
13
 
 
 
14
  πŸ† **State of the art in paralinguistic understanding on public benchmarks:** DuplexJev-32B-Para v1.3 ranks first with **50.2** on LISTEN (EACL 2026), StressTest and MSPB combined (1,035 items, none from our training corpora), ahead of Gemini 3.8 Flash 47.8, Qwen3-Omni 45.0, Gemini 3.1 Pro 41.0, GPT-audio-1.5 40.9, Gemini 3.8 Live 40.0 and GPT-realtime-2.1 35.6; Gemini 3.8 Flash stays ahead on StressTest alone (89.0 vs 86.5). Details and every prediction: [benchmarks/paraling_compare](https://github.com/adventists-ai/duplexjev/tree/main/benchmarks/paraling_compare).
15
 
16
  πŸ† **Turn-taking on par with dedicated detectors:** DuplexJev-32B-Para scores 95.5 on the Easy-Turn test set
@@ -21,10 +23,10 @@ while answering any other question in the same pass. πŸ“„ Paper: [arXiv:2610.026
21
 
22
  | model | for | built on | qa100 | Easy-Turn | gender | emotion | licence |
23
  |---|---|---|---:|---:|---:|---:|---|
24
- | ⭐ [**DuplexJev-32B-Para**](https://huggingface.co/adventists-ai/DuplexJev-32B-Para) πŸ†• v1.3 | best overall and best live turn-taking; widest set of abilities: much better stress (StressTest 86.5), accents, laughter, breathing, coughs, sighs, speaking style, same speaker (one 80 GB GPU) | DuplexJev-32B-Turn + para LoRA | 96 | 94.4\* | **93.8** | **92.1** | CC BY-NC 4.0 |
25
- | ⭐ [**DuplexJev-4B-Para**](https://huggingface.co/adventists-ai/DuplexJev-4B-Para) πŸ†• v1.1 | the same on ~10 GB, and also holds a normal conversation; `duplexjev` default | DuplexJev-4B-Turn + para LoRA + conversation replay | 77 | 91.0\* | 89.2 | 90.0 | CC BY-NC 4.0 |
26
  | [**DuplexJev-4B-Para-LiveTurn**](https://huggingface.co/adventists-ai/DuplexJev-4B-Para-LiveTurn) πŸ†• | live end-of-turn for LiveKit / Pipecat agents on ~10 GB (+ accents); eot-bench false cut-offs 25.5% en / 38.8% zh | DuplexJev-4B-Para + accent and pause-level turn data | 76 | 92.0\* | 89.5 | 90.5 | CC BY-NC 4.0 |
27
- | [**DuplexJev-32B-Stress**](https://huggingface.co/adventists-ai/DuplexJev-32B-Stress) | 32B-Turn + hears stress and pauses (one 80 GB GPU) | DuplexJev-32B-Turn + stress LoRA | **96** | 94.4\* | 92.1 | 91.4 | CC BY-NC 4.0 |
28
  | [**DuplexJev-4B-Stress**](https://huggingface.co/adventists-ai/DuplexJev-4B-Stress) | 4B-Turn + stress and pauses (~10 GB; ~4 pts lower on VoiceBench) | DuplexJev-4B-Turn + stress LoRA | 73 | 91.8\* | 89.1 | 91.4 | CC BY-NC 4.0 |
29
 
30
  πŸŽ™οΈ **Live end of turn (v1.2):** on LiveKit's [eot-bench](https://github.com/livekit/eot-bench), false cut-offs at a 300 ms budget: 32B-Para v1.2 **20.0%** with the assistant's previous message as the plugins send it, 23.5% audio only (Smart Turn v3.2 35.2%, LiveKit Turn Detector v1 9.9%). Plugins: `pipecat-duplexjev`, `livekit-plugins-duplexjev`.
 
11
 
12
  **A System One model for speech.** Jev made decision models the idea of the year: typed, probabilistic answers instead of generated text. DuplexJev brings that to raw audio, where a text decision model can't go because the transcript drops the tone. It answers the small closed questions a voice agent needs about every user turn (*has the user finished? should I reply, keep listening or just say "mm-hm"? is this a barge-in? emotion, gender, intent*) as a single token from a frozen LLM that hears the audio directly. **10 decisions in 92 ms**, 21Γ— faster than ASR β†’ LLM, under $0.50 per million decisions (4B).
13
 
14
+ πŸ†• **Oct 22 Β· DuplexJev now hears Japanese.** 32B-Para v1.4: Japanese error 32.7 β†’ 11.6% (FLEURS), conversational Japanese 38.2 β†’ 11.1%; Korean 31.8 β†’ 7.6%, Vietnamese 41.7 β†’ 14.6%; Mandarin conversational laughter 89, breath 92, stressed word 85 on held-out speakers. 4B-Para v1.3 brings Japanese to 17.2%. [Release note](https://github.com/adventists-ai/duplexjev/blob/main/research/2026-10-japanese.md)
15
+
16
  πŸ† **State of the art in paralinguistic understanding on public benchmarks:** DuplexJev-32B-Para v1.3 ranks first with **50.2** on LISTEN (EACL 2026), StressTest and MSPB combined (1,035 items, none from our training corpora), ahead of Gemini 3.8 Flash 47.8, Qwen3-Omni 45.0, Gemini 3.1 Pro 41.0, GPT-audio-1.5 40.9, Gemini 3.8 Live 40.0 and GPT-realtime-2.1 35.6; Gemini 3.8 Flash stays ahead on StressTest alone (89.0 vs 86.5). Details and every prediction: [benchmarks/paraling_compare](https://github.com/adventists-ai/duplexjev/tree/main/benchmarks/paraling_compare).
17
 
18
  πŸ† **Turn-taking on par with dedicated detectors:** DuplexJev-32B-Para scores 95.5 on the Easy-Turn test set
 
23
 
24
  | model | for | built on | qa100 | Easy-Turn | gender | emotion | licence |
25
  |---|---|---|---:|---:|---:|---:|---|
26
+ | ⭐ [**DuplexJev-32B-Para**](https://huggingface.co/adventists-ai/DuplexJev-32B-Para) πŸ†• v1.4 | best overall, widest set of abilities: stress (StressTest 86.5 in v1.3), accents, laughter, breathing, coughs, sighs, speaking style, same speaker; πŸ†• **Japanese** (FLEURS error 32.7 β†’ 11.6%), Korean, Vietnamese, Thai, Arabic, Russian, and Mandarin conversational paralinguistics (one 80 GB GPU) | DuplexJev-32B-Turn + para LoRA + language LoRAs | **97** | 94.1\* | 92.1 | 89.2 | CC BY-NC 4.0 |
27
+ | ⭐ [**DuplexJev-4B-Para**](https://huggingface.co/adventists-ai/DuplexJev-4B-Para) πŸ†• v1.3 | the same on ~10 GB, and also holds a normal conversation; πŸ†• **Japanese** (FLEURS error 59.6 β†’ 17.2% since v1.1); `duplexjev` default | DuplexJev-4B-Turn + para LoRA + conversation replay + language LoRAs | 75 | 92.5\* | 86.5 | 81.6 | CC BY-NC 4.0 |
28
  | [**DuplexJev-4B-Para-LiveTurn**](https://huggingface.co/adventists-ai/DuplexJev-4B-Para-LiveTurn) πŸ†• | live end-of-turn for LiveKit / Pipecat agents on ~10 GB (+ accents); eot-bench false cut-offs 25.5% en / 38.8% zh | DuplexJev-4B-Para + accent and pause-level turn data | 76 | 92.0\* | 89.5 | 90.5 | CC BY-NC 4.0 |
29
+ | [**DuplexJev-32B-Stress**](https://huggingface.co/adventists-ai/DuplexJev-32B-Stress) | 32B-Turn + hears stress and pauses (one 80 GB GPU) | DuplexJev-32B-Turn + stress LoRA | 96 | 94.4\* | 92.1 | 91.4 | CC BY-NC 4.0 |
30
  | [**DuplexJev-4B-Stress**](https://huggingface.co/adventists-ai/DuplexJev-4B-Stress) | 4B-Turn + stress and pauses (~10 GB; ~4 pts lower on VoiceBench) | DuplexJev-4B-Turn + stress LoRA | 73 | 91.8\* | 89.1 | 91.4 | CC BY-NC 4.0 |
31
 
32
  πŸŽ™οΈ **Live end of turn (v1.2):** on LiveKit's [eot-bench](https://github.com/livekit/eot-bench), false cut-offs at a 300 ms budget: 32B-Para v1.2 **20.0%** with the assistant's previous message as the plugins send it, 23.5% audio only (Smart Turn v3.2 35.2%, LiveKit Turn Detector v1 9.9%). Plugins: `pipecat-duplexjev`, `livekit-plugins-duplexjev`.