linoyts HF Staff commited on
Commit
00503cf
·
verified ·
1 Parent(s): f93a153

Install flashinfer jit-cache shim + sm120f provider (skip FP4 JIT)

Browse files
Files changed (1) hide show
  1. requirements.txt +8 -4
requirements.txt CHANGED
@@ -8,11 +8,15 @@ fastvideo @ git+https://github.com/hao-ai-lab/FastVideo.git@376e445f0e8d192c2d9a
8
 
9
  # NVFP4 FP4 GEMMs (packed linears + decoder) on Blackwell.
10
  flashinfer-python
11
- # Prebuilt flashinfer FP4 cubins for sm120 (RTX PRO 6000). flashinfer uses these
12
- # instead of JIT-compiling fp4_quantization_120f / fp4_gemm_cutlass_sm120 on the
13
- # first forward, cutting ~175 s off every cold boot (the FastVideo analog of the
14
- # official H3 Spaces' prebuilt-AOTI download).
 
 
 
15
  --find-links https://flashinfer.ai/whl/cu130/flashinfer-jit-cache-sm120f/
 
16
  flashinfer-jit-cache-sm120f==0.7.2+cu130
17
 
18
  spaces
 
8
 
9
  # NVFP4 FP4 GEMMs (packed linears + decoder) on Blackwell.
10
  flashinfer-python
11
+ # Prebuilt flashinfer FP4 cubins for sm120 (RTX PRO 6000): skip the ~175 s
12
+ # fp4_quantization_120f / fp4_gemm_cutlass_sm120 JIT compile on every cold boot
13
+ # (the FastVideo analog of the official H3 Spaces' prebuilt-AOTI download).
14
+ # Two packages: the shim (top-level `flashinfer_jit_cache` with __version__ and
15
+ # provider discovery) + the sm120f provider (the actual cubins + entry point).
16
+ # Installing the provider alone leaves a namespace package with no __version__.
17
+ --find-links https://flashinfer.ai/whl/cu130/flashinfer-jit-cache/
18
  --find-links https://flashinfer.ai/whl/cu130/flashinfer-jit-cache-sm120f/
19
+ flashinfer-jit-cache==0.7.2+cu130
20
  flashinfer-jit-cache-sm120f==0.7.2+cu130
21
 
22
  spaces