HelloSun
/

minicpm47woek_EPQ

Text Generation

Mixture of Experts

expert-offloading

Model card Files Files and versions

minicpm47woek_EPQ / tools

57.5 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

HelloSun's picture

EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M

12eb3a5 verified 7 days ago

determinism_check.py

5.42 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
drop_model_cache.py

1.61 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
epq_lock.so.c

4.55 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
gguf_index.py

10.1 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
io_probe.py

4.33 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
moe_layer_check.py

4.51 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
moe_ref.py

9.15 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
route_overlap.py

5.16 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
strict8g.py

12.6 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago