Instructions to use replicate/flashinfer-draft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/flashinfer-draft with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/flashinfer-draft", version=1) - Notebooks
- Google Colab
- Kaggle
Download .gitignore from replicate/flashinfer-draft: direct link, hf CLI and curl.
- Browser
- Download file 23 Bytes
-
https://huggingface.co/replicate/flashinfer-draft/resolve/main/.gitignore
- Command line
-
hf download hf://replicate/flashinfer-draft/.gitignore
-
curl -L -o .gitignore https://huggingface.co/replicate/flashinfer-draft/resolve/main/.gitignore
23 Bytes
| .bak | |
| __pycache__ | |
| result |