File size: 820 Bytes
02c100f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | # FlashRT Adaptive Norms
This package provides FlashRT adaptive normalization kernels for Hugging Face
Kernel Hub.
It is intended for DiT, VLA, video, and world-model blocks that use RMSNorm
plus per-row or single-row-broadcast style scale/shift/gate parameters.
## Kernels
- `ada_rms_norm_style_bf16`: RMSNorm + style scale/shift, with BF16 output and
BF16 gate extraction.
- `gate_residual_ada_norm_fp8_static_bf16`: in-place gated residual update,
AdaRMSNorm, static FP8 E4M3 output, and BF16 gate extraction.
## Hardware
- CUDA 12.8+
- BF16-capable NVIDIA GPUs
- FP8-capable NVIDIA GPUs for the FP8 output API
The per-row and broadcast contracts are source-validated on RTX 5090 and
Jetson AGX Thor SM110.
## Upstream
The serving source of truth remains FlashRT:
https://github.com/LiangSu8899/FlashRT
|