Error in function 'TllmGenFmhaRunner' at .sglang/lib/python3.12/site-packages/flashinfer/data/include/flashinfer/trtllm/fmha/fmhaRunner.cuh:37: Unsupported architecture

#12

by shakhizat - opened 26 days ago

Hello,

Could you please share the command to run GLM-5.3-Flash-NVFP4 on the machine with RTX PRO 6000 Blackwell GPUs(sm_120)?

Thanks,

BR,
Shakhizat

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment