Instructions to use kernels-community/vllm-flash-attn3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/vllm-flash-attn3 with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("kernels-community/vllm-flash-attn3", version=1) - Notebooks
- Google Colab
- Kaggle
Commit History
-
Add model repository removal notice
Verified signaturea92851c
-
Uploaded using `kernel-builder`.
Verified signature9a3cd57 -
Uploaded using `kernel-builder`.
Verified signature70687aa
-
Uploaded using `kernel-builder`.
Verified signature3cca626 -
Uploaded using `kernel-builder`.
Verified signature665ab1a
-
Uploaded using `kernel-builder`.
Verified signature1ac12d8 -
Uploaded using `kernel-builder`.
Verified signature91f20ee
-
Uploaded using `kernel-builder`.
Verified signaturefd46099 -
Uploaded using `kernel-builder`.
Verified signaturefea478c
-
Uploaded using `kernel-builder`.
Verified signaturee194a3b
-
Build uploaded using `kernels`.
Verified signature09146f0
-
Build uploaded using `kernels`.
Verified signaturecd9ce3f
-
Benchmarks uploaded using `kernels`.
Verified signature7619475
-
Build uploaded using `kernels`.
Verified signatureacb99ce
-
feat: add benchmark file
Verified signature674fdd3
-
Update tag
Verified signatureca303b4
-
Remove sources
5d398ae -
Build uploaded using `kernels`.
Verified signature66b8aff
-
Update README.md (#6)
Verified signature- Update README.md (7776b664b525af81c3c4c71822290e8e28ec0cbd) Co-authored-by: Sergio Paniego <sergiopaniego@users.noreply.huggingface.co>58b695b
-
feat: add quick start and readme example
drbh6324f5a
-
README for vllm-flash-attn3 (#1)
Verified signature- README for vllm-flash-attn3 (8baf45cab739644ffa1320b6f31b00efaaad8ce8)62efba7
-
Build for Torch 2.8
ee60723 -
Build x86_64-linux
28fbd26
-
Sync with upstream
a64d4b2
-
Add the Torch versions to build for and note.
86272b3
-
Fix package name
d203fdb -
Build
eb4bd6b
-
Small build fixes
fae3de0
-
Track shared libraries
d368b9b -
Convert FA3 to Kernel Hub format
4d1b54e