Kernels:
Trusted publisher
|
Download README.md from kernels-community/fp8-fbgemm: direct link, hf CLI and curl.
- Browser
- Download file 738 Bytes
-
https://huggingface.co/kernels/kernels-community/fp8-fbgemm/resolve/v1/README.md
- Command line
-
hf download hf://kernels-community/fp8-fbgemm@v1/README.md
-
curl -L -o README.md https://huggingface.co/kernels/kernels-community/fp8-fbgemm/resolve/v1/README.md
738 Bytes
metadata
library_name: kernels
license: bsd-3-clause
This is the repository card of kernels-community/fp8-fbgemm that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.
How to use
# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel
kernel_module = get_kernel("kernels-community/fp8-fbgemm", version=1)
quantize_fp8_per_row = kernel_module.quantize_fp8_per_row
quantize_fp8_per_row(...)
Available functions
quantize_fp8_per_row
Benchmarks
Benchmarking script is available for this kernel. Run kernels benchmark kernels-community/fp8-fbgemm --version 1.