Instructions to use replicate/sage_attention with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/sage_attention with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/sage_attention", version=1) - Notebooks
- Google Colab
- Kaggle
add tags
Browse files
README.md
CHANGED
|
@@ -1 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
This is a build of the [SageAttention](https://github.com/thu-ml/SageAttention) compatible with kernels library
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- kernel
|
| 4 |
+
- cuda
|
| 5 |
+
---
|
| 6 |
+
# SageAttention
|
| 7 |
+
|
| 8 |
This is a build of the [SageAttention](https://github.com/thu-ml/SageAttention) compatible with kernels library
|