ViuAI
/

Viu-1.5B-MoE

Text Generation

Mixture of Experts

mixture-of-experts

Model card Files Files and versions

Viu-1.5B-MoE / model /scripts /deep_audit_streaming.py

Commit History

Oct 2 18 days ago

08:42
Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

ViuAI

Verified signature
41a0763