Instructions to use AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit --local-dir AX-Clef-Flash-9B-MLX-AXQ-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download axquant_smoke.json from AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit: direct link, hf CLI and curl.
- Browser
- Download file 1.03 kB
-
https://huggingface.co/AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit/resolve/main/axquant_smoke.json
- Command line
-
hf download hf://AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit/axquant_smoke.json
-
curl -L -o axquant_smoke.json https://huggingface.co/AutomatosX/AX-Clef-Flash-9B-MLX-AXQ-6bit/resolve/main/axquant_smoke.json
1.03 kB
| { | |
| "cases": [ | |
| { | |
| "answers": { | |
| "department": { | |
| "choice": "technical", | |
| "confidence": 0.8955, | |
| "probabilities": { | |
| "billing": 0.1045, | |
| "technical": 0.8955 | |
| }, | |
| "type": "choice" | |
| }, | |
| "outage": { | |
| "noul": 0.7439, | |
| "type": "noul" | |
| }, | |
| "urgency": { | |
| "confidence": 0.9009, | |
| "legend": { | |
| "0": "Can wait", | |
| "1": "Today" | |
| }, | |
| "probabilities": { | |
| "0": 0.0991, | |
| "1": 0.9009 | |
| }, | |
| "score": 0.9009, | |
| "type": "score" | |
| } | |
| }, | |
| "passed": true | |
| } | |
| ], | |
| "device": "Device(gpu, 0)", | |
| "elapsed_seconds": 3.8355276660295203, | |
| "mlx_version": "0.32.4", | |
| "mtp_execution_verified": false, | |
| "passed": true, | |
| "payload_sha256": "f8d3df1b036a3c8edbc8ed03317a30c5cce2c893956988be29d9dec07689123c", | |
| "quality_certified": false, | |
| "runtime": "mlx-lm", | |
| "task": "decision", | |
| "version": "0.32.2" | |
| } | |