HelloSun
/

minicpm47woek_EPQ

Text Generation

Mixture of Experts

expert-offloading

Model card Files Files and versions

minicpm47woek_EPQ / bench /results

55.1 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

HelloSun's picture

EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M

12eb3a5 verified 7 days ago

ram_sweep.json

5.4 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
ram_sweep_n9.json

13.4 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
strict_budgets.json

14 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
strict_headline.json

6.49 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
strict_headline.md

746 Bytes
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
strict_prefetch.json

6.15 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
strict_threads.json

5.54 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago
summary.json

3.46 kB
EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M 7 days ago