How to use replicate/sonic-moe with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/sonic-moe", version=1)
ac0e6e3 ed64e75 ac0e6e3 d934615 ac0e6e3
1
2
3
4
5
6
7
8
9
10
11
12
13
{ "name": "sonic-moe", "id": "_sonic_moe_cuda_86f75d9", "version": 1, "license": "Apache-2.0", "python-depends": [ "tvm-ffi", "nvidia-cutlass-dsl" ], "backend": { "type": "cuda" } }
