kernels-staging/finegrained-fp8
Updated
AI & ML interests
Staging repository for kernels-community.
Recent Activity
View all activity
kernels-bot
updated a
model about 1 month ago
Post
184
We have recently added Torch Stable ABI support to kernels and kernel-builder. This allows kernel developers to target a particular Torch version and the kernel will be supported on that Torch version and later Torch versions (up to ~2 years).
This makes it much easier to write kernels with long-term support and not just the last two Torch releases.
We have also started rolling out Stable ABI support to kernels in kernels-community, starting with Flash Attention 3, supporting Torch 2.9 and later as well as CUDA versions starting at 12.6:
https://huggingface.co/kernels/kernels-community/flash-attn3/tree/v1/build
This makes it much easier to write kernels with long-term support and not just the last two Torch releases.
We have also started rolling out Stable ABI support to kernels in kernels-community, starting with Flash Attention 3, supporting Torch 2.9 and later as well as CUDA versions starting at 12.6:
https://huggingface.co/kernels/kernels-community/flash-attn3/tree/v1/build
- 1 reply
kernels-bot
updated a
model about 1 month ago
kernels-bot
published a
model about 1 month ago
kernels-bot
updated a
model about 1 month ago
kernels-bot
published a
model about 1 month ago
kernels-bot
updated 2
models about 1 month ago
kernels-bot
published a
model about 1 month ago
kernels-bot
updated a
model about 1 month ago
kernels-bot
published a
model about 1 month ago
kernels-bot
updated a
model about 1 month ago
kernels-bot
published a
model about 1 month ago
kernels-bot
updated a
model about 2 months ago
kernels-bot
published a
model about 2 months ago
kernels-bot
updated a
model about 2 months ago
kernels-bot
published a
model about 2 months ago
kernels-bot
updated a
model about 2 months ago
kernels-bot
published a
model about 2 months ago
Post
272
Two large changes in kernel-builder this week:
kernel-builder now links libstdc++ dynamically. To support a wide range of systems, we build against libstdc++ from manylinux_2_28 (EL 8 and later).
Following our Torch support policy that the current and previous Torch versions are supported, Torch 2.10 support was removed. We will soon also support the Torch stable ABI, so that it is possible to write kernels that support a large number of Torch versions.
kernel-builder now links libstdc++ dynamically. To support a wide range of systems, we build against libstdc++ from manylinux_2_28 (EL 8 and later).
Following our Torch support policy that the current and previous Torch versions are supported, Torch 2.10 support was removed. We will soon also support the Torch stable ABI, so that it is possible to write kernels that support a large number of Torch versions.