How to use replicate/quantization-bitsandbytes with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/quantization-bitsandbytes", version=1)
https://huggingface.co/replicate/quantization-bitsandbytes/resolve/main/build/torch212-cxx11-cpu-x86_64-linux/__init__.py
hf download hf://replicate/quantization-bitsandbytes/build/torch212-cxx11-cpu-x86_64-linux/__init__.py
curl -L -o __init__.py https://huggingface.co/replicate/quantization-bitsandbytes/resolve/main/build/torch212-cxx11-cpu-x86_64-linux/__init__.py
