Zero-Shot Classification
MLX
Safetensors
qwen3_5
decision-model
agents
apple-silicon
8-bit precision
Instructions to use openjev/openjev-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use openjev/openjev-MLX with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download openjev/openjev-MLX --local-dir openjev-MLX
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
card: tested quick start (pinned versions, pinned downloads, correct helper paths)
Browse files
README.md
CHANGED
|
@@ -28,10 +28,20 @@ The same frozen 10,000 text questions, the same helper code, the same fixed cali
|
|
| 28 |
## Run it
|
| 29 |
|
| 30 |
```bash
|
| 31 |
-
uv venv mlx
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
```
|
| 36 |
|
| 37 |
Then call `http://localhost:3000/v1/systemone` exactly as the main card describes. `shim_mlx.py` swaps only the helper's model client for an MLX one; prompts, option layout, readout and calibration are the helper's own code.
|
|
|
|
| 28 |
## Run it
|
| 29 |
|
| 30 |
```bash
|
| 31 |
+
uv venv mlx --python 3.12
|
| 32 |
+
uv pip install --python mlx/bin/python "mlx==0.32.2" "mlx-lm==0.31.3" \
|
| 33 |
+
"transformers==5.17.0" "openai==3.16.2" "huggingface-hub==1.32.0"
|
| 34 |
+
|
| 35 |
+
# Download the text-only weights and the two helper files.
|
| 36 |
+
mlx/bin/hf download openjev/openjev-MLX --revision ddbabafe9fbf296d767a91ad99717752530a3927 --local-dir openjev-MLX
|
| 37 |
+
mlx/bin/hf download openjev/openjev helper/shim.py helper/shim_mlx.py \
|
| 38 |
+
--revision 1c341f65bfe5d50fdb935c71e9739c9e0938d6c4 --local-dir openjev-api
|
| 39 |
+
|
| 40 |
+
TOKENIZER=openjev-MLX SHIM_MODEL=openjev-MLX \
|
| 41 |
+
READOUT_T=0.85 READOUT_NOUL_T=1.829074 READOUT_NOUL_BIAS=0 \
|
| 42 |
+
READOUT_TARGETED=1 READOUT_INSTR_STYLE=pyrepr SHIM_STAGGER=1 \
|
| 43 |
+
mlx/bin/python openjev-api/helper/shim_mlx.py \
|
| 44 |
+
--helper openjev-api/helper/shim.py --model openjev-MLX --port 3000
|
| 45 |
```
|
| 46 |
|
| 47 |
Then call `http://localhost:3000/v1/systemone` exactly as the main card describes. `shim_mlx.py` swaps only the helper's model client for an MLX one; prompts, option layout, readout and calibration are the helper's own code.
|