Instructions to use kernels-community/moe-new-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/moe-new-models with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("kernels-community/moe-new-models", version=1) - Notebooks
- Google Colab
- Kaggle
Commit History
-
Sync with vLLM, add `apply_router_weight_on_input` arg to `fused_moe`
Use `apply_router_weight_on_input` for Llama4.1aea118
-
Module name has to correspond to repo name
a8ef99b -
Fix Llama expert layout
3c64348 -
Add Llama MoE
6d19dd0
-
Update for build.toml changes
29fbb6a
-
Vendor `w8a8_block_fp8_matmul` and `per_token_group_quant_fp8`
b41d28a -
Normalize some directory names
3d21f81