Instructions to use infosave/flint-cmf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- cortiq
How to use infosave/flint-cmf with cortiq:
# one Rust binary, no additional dependencies cargo install cortiq-cli # or a prebuilt binary from github.com/infosave2007/cmf/releases hf download infosave/flint-cmf --include "*.cmf" --local-dir . ls *.cmf # some repos ship more than one quantization
cortiq run FILE.cmf --prompt "What is the capital of France?"
cortiq serve FILE.cmf --port 8080 # OpenAI-compatible server
- Notebooks
- Google Colab
- Kaggle
Commit History
3 days ago
-
docs: document v0.8.30 native Metal Flint path
Verified signatureb2f03e7 -
Document Apple silicon Flint runtime limitation
Verified signature4f33e0e -
Publish corrected Flint CMF artifacts for cortiq 0.8.30
Verified signature25dc581 -
Upload README.md with huggingface_hub
Verified signaturef48f22d -
Upload flint-q2tp.cmf.sha256 with huggingface_hub
Verified signature3778e10 -
Upload flint-q4tp.cmf.sha256 with huggingface_hub
Verified signature80427b9 -
Upload flint-q2tp.cmf with huggingface_hub
Verified signature5c21ba9 -
Upload flint-q4tp.cmf with huggingface_hub
Verified signature78481ce -
initial commit
Verified signature3bdfe58