How to use replicate/flash-attn2 with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/flash-attn2", version=1)
https://huggingface.co/replicate/flash-attn2/resolve/b0e71dbd4023a76fc61fc6a8c3a94de0a3fabd6f/tests/__init__.py
hf download hf://replicate/flash-attn2@b0e71dbd4023a76fc61fc6a8c3a94de0a3fabd6f/tests/__init__.py
curl -L -o __init__.py https://huggingface.co/replicate/flash-attn2/resolve/b0e71dbd4023a76fc61fc6a8c3a94de0a3fabd6f/tests/__init__.py
