Instructions to use m-i/KAT-Dev-72B-Exp-mlx-6Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use m-i/KAT-Dev-72B-Exp-mlx-6Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download m-i/KAT-Dev-72B-Exp-mlx-6Bit --local-dir KAT-Dev-72B-Exp-mlx-6Bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload README.md with huggingface_hub
Verified signature0e2f717 -
Upload generation_config.json with huggingface_hub
Verified signaturefd89155 -
Upload tokenizer.json with huggingface_hub
Verified signaturebea25dd -
Upload merges.txt with huggingface_hub
Verified signature55c5e23 -
Upload vocab.json with huggingface_hub
Verified signature75d2839 -
Upload added_tokens.json with huggingface_hub
Verified signaturec88c7c7 -
Upload special_tokens_map.json with huggingface_hub
Verified signature48e2ec9 -
Upload tokenizer_config.json with huggingface_hub
Verified signature408c3fb -
Upload chat_template.jinja with huggingface_hub
Verified signature60d41c4 -
Upload config.json with huggingface_hub
Verified signature4159a79 -
Upload model.safetensors.index.json with huggingface_hub
Verified signaturefb78242 -
Upload model-00012-of-00012.safetensors with huggingface_hub
Verified signature91d94d4 -
Upload model-00011-of-00012.safetensors with huggingface_hub
Verified signature234fb18 -
Upload model-00010-of-00012.safetensors with huggingface_hub
Verified signaturef1505e4 -
Upload model-00009-of-00012.safetensors with huggingface_hub
Verified signature4988dae -
Upload model-00008-of-00012.safetensors with huggingface_hub
Verified signature6a835e8 -
Upload model-00007-of-00012.safetensors with huggingface_hub
Verified signature6dab69a -
Upload model-00006-of-00012.safetensors with huggingface_hub
Verified signature25332a0 -
Upload model-00005-of-00012.safetensors with huggingface_hub
Verified signaturefaea316 -
Upload model-00004-of-00012.safetensors with huggingface_hub
Verified signatured0e1960 -
Upload model-00003-of-00012.safetensors with huggingface_hub
Verified signature113ff6e -
Upload model-00002-of-00012.safetensors with huggingface_hub
Verified signatureddc6a13 -
Upload model-00001-of-00012.safetensors with huggingface_hub
Verified signature3af4ded -
initial commit
Verified signature9cf4f45