Commit History
-
Delete the miscalibrated sm_120 SAME-S fp8 encoder
Verified signatureIts activation quantisers were calibrated with a percentile-of-percentile plus a 1e-4 floor, putting the clip points far below where the decoder's plain amax puts them. The equivalent sm_90 engine was deleted when that was found; this copy was missed and only surfaced when the deprecated engines were swept into legacy/. Keeping it under legacy/ would have left a trap: it is the one file there that is wrong rather than merely superseded, and anyone building sm_120 from it would inherit the bug. The recalibrated weights live in onnx/same-s/enc_fp8.onnx, which build_autoencoders.py uses to produce enc_fp8_chunkable.trt.197c684 -
Move deprecated sm_120 TRT engines under legacy/
Verified signatureThese are not reachable from the runtime registry: every tier resolves to the chunkable engines (dec_*_chunkable_limiter / enc_*_chunkable). Kept rather than deleted so older checkouts and reproductions still have them, but moved out of the way so the live set is unambiguous. Copies are server-side; the ONNX sources are untouched, and four of them (enc_dynamic_triton_swa.onnx, enc_dynamic_bf16.onnx, both enc_fp8.onnx) remain load-bearing for build_autoencoders.py -- 'chunkable' is a profile choice for the encoders, not a graph change.19ab22a
-
retire fp8_fast; remove the superseded sm_90 fp8 engines (miscalibrated encoder, 8192-ceiling decoders)
Verified signature935685c -
retire fp8_fast; remove the superseded sm_90 fp8 engines (miscalibrated encoder, 8192-ceiling decoders)
Verified signature276f110
-
SAME-L: remove miscalibrated enc_fp8.trt (activation scales 1.3-28x too small; superseded by enc_fp8_chunkable.trt on sm_90)
Verified signature2c8b02a
-
Delete old fp16mixed names + retired medium dit_bf16.trt (fp16 rename shipped)
Verified signature48e34e2 -
Rename fp16mixed->fp16 DiT/T5Gemma engines+onnx (copies; deletes follow after code merge)
Verified signature3f29675 -
Remove redundant w8_bf16 engines (int8 weights fold to bf16 at build → identical size/speed to the bf16 baseline)
Verified signature63cc70d -
Add sm_120 TRT engines (AOT SWA, wide profile) for the quantized tiers
Verified signature4e8cc21
-
sm_120 sa3-m: add the fp8 medium-DiT tier (176 fp8 GEMM + 96 bf16 fused MHA, 1.43-1.95x vs fp16mixed) (#7)
- sm_120 sa3-m: add the fp8 medium-DiT tier (176 fp8 GEMM + 96 bf16 fused MHA, 1.43-1.95x vs fp16mixed) (af5680d9cca1dfc854e0dc95ea4e60470b33bc0f)f8e0a0f -
sm_120 SAME-L: AOT (graph-capturable) engines + tensorRT/README.md (#6)
- sm_120 SAME-L: AOT (graph-capturable) engines + tensorRT/README.md (1d2139821d87b6160099860d29a82d535269a33b)a05f2d4
-
Fix the bf16 medium DiT: bake RoPE's tables into the graph (clipping 3.112% -> 0.014%) (#5)
- Fix the bf16 medium DiT: bake RoPE's tables into the graph (clipping 3.112% -> 0.014%) (59bd967d4635c6e32b0b2a677d56a21984654b9d)6152b1d -
Rebuild medium DiT fp16-mixed engines (sm_90 + new sm_120): attention now fuses, 4.3x faster (#4)
- Rebuild medium DiT fp16-mixed engines (sm_90 + new sm_120): attention now fuses, 4.3x faster (f3263ec28281132dda00915ad3a83920f3b98730) - Complete the sm_120 engine set (mirror sm_90's 15 files) (dcca4a7a8676aa3846ca92ecf7607d572706d685)06debc3