Batched Speech Decisions Without Decoding: Single-Token Supervision Lets a Frozen LLM Hear Beyond the Transcript
Paper • 2610.02638 • Published
Speech decisions without decoding: turn-taking, emotion, non-verbal sounds and more from raw speech, in one forward pass.
Note Paper: batched speech decisions without decoding
10 voice-agent decisions from raw speech in one pass
Note Try it: ten decisions from your voice (32B)
Judge a voice against a picture in one forward pass
Note Voice + picture together (research preview)
Note Turn-taking specialist
Note Paralinguistics: emotion, non-verbal sounds, style
Note Speech + image (research preview)
Note Small and fast: ~10 GB GPU
Note Which word is stressed