HelloSun
/

minicpm47woek_EPQ

Text Generation

Mixture of Experts

expert-offloading

Model card Files Files and versions

minicpm47woek_EPQ / sdq /__init__.py

HelloSun's picture

EPM: expert paging CPU inference for MiniCPM-V-4.7-35B-A3B Q4_K_M

12eb3a5 verified 7 days ago

Raw History Blame Contribute Delete

0 Bytes