Instructions to use replicate/vllm-flash-attn3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/vllm-flash-attn3 with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/vllm-flash-attn3", version=1) - Notebooks
- Google Colab
- Kaggle
Commit History
-
Add model repository removal notice
Verified signaturea92851c
-
Uploaded using `kernel-builder`.
Verified signature70687aa
-
Uploaded using `kernel-builder`.
Verified signaturefea478c
-
Update tag
Verified signatureca303b4
-
Remove sources
5d398ae
-
Update README.md (#6)
Verified signature- Update README.md (7776b664b525af81c3c4c71822290e8e28ec0cbd) Co-authored-by: Sergio Paniego <sergiopaniego@users.noreply.huggingface.co>58b695b
-
feat: add quick start and readme example
drbh6324f5a
-
README for vllm-flash-attn3 (#1)
Verified signature- README for vllm-flash-attn3 (8baf45cab739644ffa1320b6f31b00efaaad8ce8)62efba7