pat883 commited on
Commit
2d2dfa8
·
verified ·
1 Parent(s): edd3a97

Add kernel card (library_name: kernels)

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: kernels
3
+ tags:
4
+ - kernels
5
+ - rocm
6
+ ---
7
+
8
+ # Flash-Attention Decode (RDNA4/gfx1201)
9
+
10
+ Dense, paged, and fp8 flash-attention decode kernels (GQA, sliding-window, block-table KV cache).
11
+
12
+ Built with [kernel-builder](https://github.com/huggingface/kernel-builder) for AMD RDNA4 (gfx1201).
13
+ Load with the [`kernels`](https://github.com/huggingface/kernels) library:
14
+
15
+ ```python
16
+ from kernels import get_kernel
17
+ kernel = get_kernel("pat883/attn-decode")
18
+ ```
19
+
20
+ > Requires a ROCm PyTorch build (torch 2.10 / ROCm 7.x) on an RDNA4 card. Built variants:
21
+ > `torch210-cxx11-rocm70` and `torch210-cxx11-rocm71`.