Instructions to use Efficient-Large-Model/Sol-Attn-Kernel-Source with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use Efficient-Large-Model/Sol-Attn-Kernel-Source with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("Efficient-Large-Model/Sol-Attn-Kernel-Source", version=1) - Notebooks
- Google Colab
- Kaggle
Download torch-ext/sol_attn/common/runtime.py from Efficient-Large-Model/Sol-Attn-Kernel-Source: direct link, hf CLI and curl.
- Browser
- Download file 319 Bytes
-
https://huggingface.co/Efficient-Large-Model/Sol-Attn-Kernel-Source/resolve/main/torch-ext/sol_attn/common/runtime.py
- Command line
-
hf download hf://Efficient-Large-Model/Sol-Attn-Kernel-Source/torch-ext/sol_attn/common/runtime.py
-
curl -L -o runtime.py https://huggingface.co/Efficient-Large-Model/Sol-Attn-Kernel-Source/resolve/main/torch-ext/sol_attn/common/runtime.py
319 Bytes
| """Small host helpers shared by the architecture backends.""" | |
| from cutlass.cute.runtime import from_dlpack | |
| def to_cute_tensor(tensor): | |
| return from_dlpack( | |
| tensor, | |
| assumed_align=16, | |
| enable_tvm_ffi=True, | |
| ).mark_layout_dynamic(leading_dim=tensor.ndim - 1) | |
| __all__ = ["to_cute_tensor"] | |