File size: 1,801 Bytes
9e77ea9 63aecab c59bf1e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 | ---
license: cc-by-nc-4.0
base_model: openjev/openjev
tags:
- decision-model
- zero-shot-classification
- agents
- mlx
- apple-silicon
- 4-bit
---
# OpenJev, MLX 4-bit
**OpenJev decisions on Apple silicon, in about 15 GB.** This text-only build uses 4-bit affine quantization with group size 64. Give it text, JSON or browser DOM, your labels and your rules. It returns a typed choice, yes/no probability or score through the same OpenJev API.
Labels are supplied at request time. Each question with up to 52 options uses one forward pass. See the [main model](https://huggingface.co/openjev/openjev) for the API and available formats.
## Run it
```bash
uv venv mlx --python 3.12
uv pip install --python mlx/bin/python "mlx==0.32.2" "mlx-lm==0.31.3" \
"transformers==5.17.0" "openai==3.16.2" "huggingface-hub==1.32.0"
mlx/bin/hf download openjev/openjev-MLX-4bit --local-dir openjev-MLX-4bit
mlx/bin/hf download openjev/openjev helper/shim.py helper/shim_mlx.py \
--revision 1c341f65bfe5d50fdb935c71e9739c9e0938d6c4 --local-dir openjev-api
TOKENIZER=openjev-MLX-4bit SHIM_MODEL=openjev-MLX-4bit \
READOUT_T=0.85 READOUT_NOUL_T=1.829074 READOUT_NOUL_BIAS=0 \
READOUT_TARGETED=1 READOUT_INSTR_STYLE=pyrepr SHIM_STAGGER=1 \
mlx/bin/python openjev-api/helper/shim_mlx.py \
--helper openjev-api/helper/shim.py --model openjev-MLX-4bit --port 3000
```
Send requests to `http://localhost:3000/v1/systemone` using the main model's examples.
## Licence
Weights: CC BY-NC 4.0 for research and non-commercial use, with attribution. For a commercial licence, email [support@loopai.com](mailto:support@loopai.com). Helper code: Apache 2.0. Upstream notices are included in `NOTICE` and `LICENSE-APACHE-2.0`.
OpenJev is an independent project, not affiliated with TypeSafe; Jev is their product.
|