Instructions to use infosave/MiniCPM5-2B-cmf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- cortiq
How to use infosave/MiniCPM5-2B-cmf with cortiq:
# one Rust binary, no additional dependencies cargo install cortiq-cli # or a prebuilt binary from github.com/infosave2007/cmf/releases hf download infosave/MiniCPM5-2B-cmf --include "*.cmf" --local-dir . ls *.cmf # some repos ship more than one quantization
cortiq run FILE.cmf --prompt "What is the capital of France?"
cortiq serve FILE.cmf --port 8080 # OpenAI-compatible server
- Notebooks
- Google Colab
- Kaggle
Commit History
23 days ago
-
Card: GPTQ q4tp (ppl 18.91), 0.7.6 speeds, no workaround flags
Verified signaturea28842c -
q4tp: GPTQ-rounded, embeddings and head at 8 bits (ppl 18.91)
Verified signature23ea44a -
Card: q8_2f is the default file
Verified signature87b9e76 -
Model card
Verified signature7c0b3e1 -
MiniCPM5-2B CMF: q4tp + q8_2f
Verified signature90513d5 -
initial commit
Verified signature0dc25ee