Kernels:

kernels-community
/

flash-attn2

Trusted publisher

kernels-bot commited on Jul 20

Commit

39ecabf

verified ·

1 Parent(s): 4b10649

Uploaded using `kernel-builder`.

Files changed (1) hide show

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ This is the repository card of kernels-community/flash-attn2 that has been pushe
 # make sure `kernels` is installed: `pip install -U kernels`
 from kernels import get_kernel
-kernel_module = get_kernel("kernels-community/flash-attn2", version=2)
 flash_attn_func = kernel_module.flash_attn_func
 flash_attn_func(...)
@@ -33,4 +33,4 @@ flash_attn_func(...)
 ## Benchmarks
-Benchmarking script is available for this kernel. Run `kernels benchmark kernels-community/flash-attn2 --version 2`.

 # make sure `kernels` is installed: `pip install -U kernels`
 from kernels import get_kernel
+kernel_module = get_kernel("kernels-community/flash-attn2", version=3)
 flash_attn_func = kernel_module.flash_attn_func
 flash_attn_func(...)
 ## Benchmarks
+Benchmarking script is available for this kernel. Run `kernels benchmark kernels-community/flash-attn2 --version 3`.