Instructions to use kernels-community/rotary with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/rotary with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("kernels-community/rotary", version=1) - Notebooks
- Google Colab
- Kaggle
Commit History
-
add `apply_rotary_pos_emb` API to make it adapt to transformers
Signed-off-by: Liu, Kaixuan <kaixuan.liu@intel.com>6069b37
-
Build x86_64-linux for XPU
d7f24a6 -
Update flake
12cf072 -
Ensure tests also work in test shells
e78fee4 -
Make test shells work again
77fc3a8 -
Fix CUDA build
c4d3c95 -
Add support for XPU (sycl) (#3)
Verified signature- Add support for XPU(sycl) (b87db80d558d76f8193f293889e6aee81e9d3743) - Revert changes to the build folder (f425aa577e0fb59ed08c568985b007ab686da778) - Delete pyc files (acc75a3bf1a67e06659873b98909b4e997b3f45f) Co-authored-by: Kai Yang <YangKai0616@users.noreply.huggingface.co>e94ff91
-
Build (aarch64-linux)
Also remove old Torch 2.5 builds.74b8263
-
Build for Torch 2.8 (x86_64-linux)
005dcc7 -
Prepare for Torch 2.8
d5e8892
-
feat: add tag to trigger hfjob build
Verified signaturec9a4754
-
Build (AArch64)
804a326 -
Build
c752386 -
Update flake input
6b8e81d -
Use default capabilities
797557e
-
Build (aarch64)
5afb550 -
Build
d595dec -
Fix URL
0a590ce -
Update flake
c7fa2df -
Update compute capabilities
d3b39ec
-
feat: update to include rev in kernel for reproducible symbols
drbha7bfea8
-
Update for build.toml changes
52bc5f9
-
Update README.md (#1)
Verified signature- Update README.md (98ef016ed0c8fc154bc22639fb02e0be1cdbacba) Co-authored-by: Lysandre <lysandre@users.noreply.huggingface.co>3f164d2
-
Build
4db658e -
Make it a flake
81c07e0 -
Track .so files with git-lfs
dfa5d04 -
Add rotary kernel
bbf5511