Instructions to use kernels-community/moe-new-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/moe-new-models with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("kernels-community/moe-new-models", version=1) - Notebooks
- Google Colab
- Kaggle
Commit History
Update tag cb39b57 verified
Fix kernel-builder URL d2bb63e
Build 06c20de
Sync with vLLM, add `apply_router_weight_on_input` arg to `fused_moe` 1aea118
Module name has to correspond to repo name a8ef99b
Build 031b5c2
Fix Llama expert layout 3c64348
Add flake.lock ef18c25
Add Llama MoE 6d19dd0
feat: update to include rev in kernel for reproducible symbols fbbc5a8
drbh commited on