AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

vllm-sr 's models 80