Commit History

Add video call screenshot to README
6918b42

chenbhao commited on

Add assets directory
f894165

chenbhao commited on

Simplify voice_args: remove redundant fallback chain, require explicit name
276d80f

chenbhao Claude Opus 4.6 commited on

Remove silence-generated default voice; use cloned voice as default when available
aa3f48c

chenbhao commited on

Generate default voice from silence on startup; fix voice fallback priority
764189b

chenbhao commited on

Fix: remove duplicate voiceSel declaration breaking UI
dbc88a2

chenbhao commited on

Revert "Generate default voice from silence when no voices available"
e75ae33

chenbhao commited on

Voice selector: inline popup with groups (builtin/unseen/manual), delete cloned voices, outside-click close
38498df

chenbhao commited on

Generate default voice from silence when no voices available
6fb1e3e

chenbhao commited on

Fix: voice clone mic null when not in call mode
3e71846

chenbhao commited on

Fix: create model/speaker dir on demand for voice clone
e7c553c

chenbhao commited on

Fix voice clone, path defaults, README rewrite; add pydub dep
bf14804

chenbhao commited on

Rewrite README in English with codev-style layout; add Xet install guide
f2c9122

chenbhao commited on

Add training checkpoints and dataset via LFS
1b20b9f

chenbhao commited on

Add checkpoint files via LFS
e53f713

chenbhao commited on

Fix siglip README metadata for HF upload
c0add33

chenbhao commited on

Update docs: challenges.md (training bias + scene text approach), vam/multimodal/trainers docs sync
2460459

chenbhao commited on

Add NaN guard to audio code generation path
9422bfb

chenbhao commited on

Remove hardcoded '请描述这张图片' from camera prompt
74c8b11

chenbhao commited on

Revert "Remove '请描述这张图片' from camera prompt; img_tokens before user text"
ef84b16

chenbhao commited on

Revert "Camera: inject scene text instead of raw img_tokens to avoid description mode"
0389f23

chenbhao commited on

Revert "Fix scene refresh starving conversation: non-blocking lock + SCENE_LOCK guard"
a1e8c3d

chenbhao commited on

Fix scene refresh starving conversation: non-blocking lock + SCENE_LOCK guard
28843e3

chenbhao commited on

Camera: inject scene text instead of raw img_tokens to avoid description mode
0375745

chenbhao commited on

Remove '请描述这张图片' from camera prompt; img_tokens before user text
22518dd

chenbhao commited on

Revert camera prompt changes; add NaN guard and CUDA sync; add engineering challenges doc
5a72179

chenbhao commited on

Add suppression prefix before image tokens
2dd2738

chenbhao commited on

Camera context improvements: image tokens before user text + system prompt
ad61556

chenbhao commited on

Cast logits to float32 before softmax/sampling to prevent fp16 overflow
23b3234

chenbhao commited on

Remove hardcoded '请描述这张图片'; image tokens alone suffice
74d24eb

chenbhao commited on

Fix camera: don't force 'describe this image' when user has text input
8c47b2e

chenbhao commited on

Update README: add omni-o HF conversion, call server, and frontend
f1549f4

chenbhao commited on

Move audio/vision encoder .to(device) after model init for both HF and .pth paths
5eccaad

chenbhao commited on

Fix from_pretrained: use SenseVoice/Siglip encoder wrappers instead of raw models
3a4cdc5

chenbhao commited on

Default to HF format loading in omni_o_call.py
7efddcf

chenbhao commited on

Convert omni-o.pth to HF format + add from_pretrained support
64ccedb

chenbhao commited on

Replace web_demo.html with omni_o_web.html: self-contained frontend for omni-o call
9a9a9e0

chenbhao commited on

Rewrite omni_o_terminal.py: add real-time interrupt/barge-in
f53960b

chenbhao commited on

Add omni_o_terminal.py: terminal voice chat script
d91f099

chenbhao commited on

Add omni_o_call.py: real-time voice call server for omni-o checkpoint
f268594

chenbhao commited on

Fix eval_vam.py: update paths to checkpoint/ dirs, fix VAMConfig attn heads, remove open_thinking kwarg
cecc5b1

chenbhao commited on

Fix generate() to return last text tokens instead of (None, audio_frame) tuple
603135f

chenbhao commited on

fix VAM: funasr+pyarrow deadlock, librosa+numpy compat, reduce iter_batches batch_size
fe5285c

chenbhao commited on

feat: add VAM T2A config variant using omni-v initialization
75ec370

chenbhao commited on

feat: rename & add VAM mini pipeline configs
f1a17e1

chenbhao commited on

feat: add VAM SFT mini training (T2A Stage 1)
7036629

chenbhao commited on

feat: add interactive mode to eval_vlm.py with auto <image> insertion, update README
a4fb8db

chenbhao commited on

feat: add VLM SFT mini configs, resume training, dataset streaming, and eval fixes
9a1a7d2

chenbhao commited on

refactor: rename VLM configs, add VLM SFT configs, and improve model loading
56d3c4a

chenbhao Claude Opus 4.6 commited on

refactor: reorganize dataset into lm/vlm/vam subdirectories
d9f29d1

chenbhao Claude Opus 4.6 commited on