Instructions to use replicate/moe-new-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/moe-new-models with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/moe-new-models", version=1) - Notebooks
- Google Colab
- Kaggle
Commit History
-
Sync with vLLM, add `apply_router_weight_on_input` arg to `fused_moe`
Use `apply_router_weight_on_input` for Llama4.1aea118
-
Update for build.toml changes
29fbb6a
-
Normalize some directory names
3d21f81
-
Sync with upstream
6eaa88c
-
Add MoE configs
fdd8ac0
-
Add MoE kernels from vLLM
TODO: add MoE configs, but this requires a change to the builder.29e93ec