fp8-gemm / benchmarks /README.md
liangsu9988's picture
Promote latest kernel artifacts to main
6a04ab4 verified
|
Raw History Blame Contribute Delete
395 Bytes
# Benchmarks
```bash
python fp8-gemm/benchmarks/benchmark.py --backend source --mode headline
```
The benchmark sweeps dispatcher rows and explicit M=1 GEMV variants.
On NVIDIA Thor, use `--mode thor-full`. The runner records normal launches,
CUDA Graph replay, all SM110 Sq/T1/Wide diagnostic tiles, and an optional
original FlashRT pointer-API comparison when `FLASHRT_NATIVE_ROOT` is set.