clef-flash-NVFP4 / vllm_plugin

Commit History

29 days ago

  1. Server: CUDA graphs for prompt-sized steps (70 -> 37 ms), --gdn-backend, Server-Timing

    Verified signature
    89d3a1b

30 days ago

  1. vllm_plugin: host-side lm_head under TP, int32 id fix, --flashinfer-autotune (auto off for TP>1)

    Verified signature
    27798c6

  1. Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server)

    Verified signature
    771ba1d