AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

vllm-sr 's collections 4

⛵ Vela 1.0
The model family for intelligent routing.
🌊 MoM 1.0
long context models for MoM multilingual embeddings
🧙 MoM Nano
long context models for MoM multilingual classifier (domain, jailbreak, pii, factual, feedback, modality)