Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

awai-network
/
basho

Text Generation
custom
murakumo
artificial-organism
openai-compatible
writing
draft-review
Model card Files Files and versions
xet
Community
basho / serving /configs
3.04 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
com-junkawasaki's picture
com-junkawasaki
Add tuned FP8 config for HF RTX PRO 6000 Server Edition
f18a0dc verified 28 days ago
  • N=12576,K=4096,device_name=NVIDIA_RTX_PRO_6000_Blackwell_Server_Edition,dtype=fp8_w8a8,block_shape=[32,32].json
    1.52 kB
    Add tuned FP8 config for HF RTX PRO 6000 Server Edition 28 days ago
  • N=12576,K=4096,device_name=NVIDIA_RTX_PRO_6000_Blackwell_Workstation_Edition,dtype=fp8_w8a8,block_shape=[32,32].json
    1.52 kB
    Add pinned GLM-5.3 vLLM runtime patches 28 days ago