ViuAI
/

Viu-1.5B-MoE

Text Generation

Mixture of Experts

mixture-of-experts

Model card Files Files and versions

Viu-1.5B-MoE / model /scripts

135 kB

Ctrl+K

Ctrl+K

1 contributor

History: 46 commits

ViuAI's picture

Vectorize MoE dispatch (argsort+bincount): eliminate 2,688 CUDA kernel launches per pass

43847d6 verified 7 days ago

deep_audit_streaming.py

6.17 kB
Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm 7 days ago
train.py

101 kB
Add live elapsed time counter (fmt_duration) and step pace (s/step, step/h) to console logs 7 days ago
verify_arch.py

3.55 kB
Sync model/scripts/verify_arch.py after full codebase audit, retry hardening, and token security fixes 10 days ago
viu_moe.py

24.5 kB
Vectorize MoE dispatch (argsort+bincount): eliminate 2,688 CUDA kernel launches per pass 7 days ago