Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

alexz949
/
BasisServe-CALS

Text Generation
basisserve
low-rank-compression
kv-cache-compression
tensor-parallelism
palu
c1
global-kl
Model card Files Files and versions
xet
Community
BasisServe-CALS / system_benchmarks
207 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
alexz949's picture
alexz949
add Qwen3-32B TP8 V96 benchmark results
3cd67a4 verified 26 days ago
  • tp1_capacity
    add TP1 capacity and chunked RoPE results (part 2) 26 days ago
  • tp1_lrqk_local
    add TP1 offline and LRQK GPU-local results 27 days ago
  • tp1_offline
    add TP1 offline and LRQK GPU-local results 27 days ago
  • vllm_32b_tp8_sm89_4k_budget8k
    add optimized Qwen3-32B TP8 benchmark results 27 days ago
  • vllm_32b_tp8_v96
    add Qwen3-32B TP8 V96 benchmark results 26 days ago