vLLM Semantic Router

community

https://vllm-sr.ai

Activity Feed Request to join this org

AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

Xunzhuo updated a Space about 1 hour ago

Xunzhuo new activity 1 day ago

vllm-sr/Decision-1.0-Eos-0.8B:Load with 🤗 Transformers (trust_remote_code)

Xunzhuo new activity 1 day ago

vllm-sr/Decision-1.0-Lux-9B:Load with 🤗 Transformers (trust_remote_code)

View all activity

vllm-sr 's Spaces 3

Decision Studio

Generate decision probabilities for your prompts and questions

README

Vela Studio

Explore Vela models for language, images, and speech.