Instructions to use replicate/sage_attention with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/sage_attention with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/sage_attention", version=1) - Notebooks
- Google Colab
- Kaggle
Download flake.nix from replicate/sage_attention: direct link, hf CLI and curl.
- Browser
- Download file 335 Bytes
-
https://huggingface.co/replicate/sage_attention/resolve/main/flake.nix
- Command line
-
hf download hf://replicate/sage_attention/flake.nix
-
curl -L -o flake.nix https://huggingface.co/replicate/sage_attention/resolve/main/flake.nix
335 Bytes
| { | |
| description = "Flake for Torch kernel extension"; | |
| inputs = { | |
| kernel-builder.url = "github:huggingface/kernel-builder/redo-capabilities"; | |
| }; | |
| outputs = { self, kernel-builder, }: | |
| kernel-builder.lib.genFlakeOutputs { | |
| path = ./.; | |
| rev = self.shortRev or self.dirtyShortRev or self.lastModifiedDate; | |
| }; | |
| } | |