Hugging Face's logo

Spaces:
townbox
/
ava
Running

App Files Community
ava / README.md
Mike0021's picture
Mike0021
Claude Opus 5.5
Show the newest avatar in link previews
c87dcf0 verified
preview code
|
Raw History Blame Contribute Delete
3.3 kB
metadata 
title: Ava
emoji: 🗣️
colorFrom: indigo
colorTo: purple
sdk: static
app_file: index.html
pinned: false
thumbnail: https://huggingface.co/spaces/townbox/ava/resolve/main/thumbnail-v3.jpg
short_description: Talk face to face with LFM3-Omni, running in your browser
models:
  - LiquidAI/LFM3-Omni-2B
  - LiquidAI/LFM3-Omni-2B-GGUF

Ava

Hands-free voice chat with Ava, a 3D lip-synced avatar, running entirely in the browser: the UX of victor/gemma-avatar on the model and WebGPU runtime of LiquidAI/LFM3-Omni-2B-WebGPU. No backend: your voice never leaves the device.

you speak → Silero VAD (WASM) → LFM3-Omni-2B (WebGPU): audio in, interleaved text + speech out → avatar speaks
  • Needs a desktop browser with WebGPU and shader-f16 (recent Chrome/Edge) and a 1.6 GB model download on first visit; later visits load from the browser cache.
  • Model runs in a worker, so the avatar keeps rendering. It hears the audio directly: there is no separate transcription step, and so no user transcript.
  • Barge-in: talk over her and generation and playback stop immediately.
  • Body language (moods, thumbs up, shrug, a wave) is read from her words as they are heard, in src/reactions.js.
  • Character is a short system prompt you can edit directly in Settings (src/system-prompt.js has the default). The only thing added to it is the model's required "Respond with interleaved text and audio." line.
  • Lip-sync is derived from the audio by HeadAudio, as in gemma-avatar.

Differences from gemma-avatar, all forced by the model: there is no voice picker (LFM3-Omni's interleaved mode has one voice and ignores voice requests), and the model doesn't call avatar tools. Offering any tool schema derails its conversation: with the original Space's tools "let's play a quick game" starts a timer, and with avatar tools it gestures on every turn, gives shallow replies and can loop without speaking. The runtime, message format, generation mode and greedy decoding otherwise match the original Space.

Known model behaviour

LFM3-Omni-2B can re-ask its last question and can't sustain a game like Twenty Questions: it answers "no" to everything and doesn't hold a secret. The original LiquidAI Space does the same with the same model. This app doesn't try to hide it.

Run 

bun install
bun run start   # builds dist/ and serves http://localhost:3000

Test

bun test tests covers the VAD segmenter and session state machine. e2e/run.sh <scenario> <outDir> drives the real app in headless Chromium on the real GPU: speech goes in through a PipeWire virtual mic, her voice is recorded at the OS sink. e2e/analyze.py <outDir> --stt reports latency, frame rate, mouth/audio correlation and a Whisper transcript. Needs PipeWire, playwright-core, Piper test clips (E2E_AUDIO) and a Python env with numpy, scipy, soundfile, faster-whisper.

Licences

Avatar brunette.glb: Ready Player Me, CC BY-NC 4.0 (non-commercial). Model: LFM license 1.0. Lfm3OmniForConditionalGeneration.js: copied from the LiquidAI Space, which states no licence for it. TalkingHead, HeadAudio, Silero VAD: MIT. ONNX Runtime: MIT.