Hugging Face's logo

ShoaibSSM
/
a100-qwen-api-runtime

Model card Files
xet
 Community
a100-qwen-api-runtime / scripts /serve.sh

Commit History

22 days ago

  1. Bound llama.cpp HTTP and compute threads; enable four slots

    ShoaibSSM
    Verified signature
    d861a68

  2. Add lazy two-model router and detached ngrok setup

    ShoaibSSM
    Verified signature
    350d99c

  3. Add pinned A100 Qwen API runtime and benchmark scripts

    ShoaibSSM
    Verified signature
    42b02cd