Instructions to use kernels-community/flash-attn3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/flash-attn3 with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("kernels-community/flash-attn3", version=1) - Notebooks
- Google Colab
- Kaggle
Remove warning
Browse files
README.md
CHANGED
|
@@ -4,8 +4,6 @@ tags:
|
|
| 4 |
- kernel
|
| 5 |
---
|
| 6 |
|
| 7 |
-
**Warning:** do not use yet! We are still ironing out the last few issues.
|
| 8 |
-
|
| 9 |
# Flash Attention 3
|
| 10 |
|
| 11 |
Flash Attention is a fast and memory-efficient implementation of the
|
|
|
|
| 4 |
- kernel
|
| 5 |
---
|
| 6 |
|
|
|
|
|
|
|
| 7 |
# Flash Attention 3
|
| 8 |
|
| 9 |
Flash Attention is a fast and memory-efficient implementation of the
|