---
license: cc-by-nc-4.0
base_model: openjev/openjev
tags:
- decision-model
- zero-shot-classification
- agents
- mlx
- apple-silicon
- 4-bit
---

# OpenJev, MLX 4-bit

**OpenJev decisions on Apple silicon, in about 15 GB.** This text-only build uses 4-bit affine quantization with group size 64. Give it text, JSON or browser DOM, your labels and your rules. It returns a typed choice, yes/no probability or score through the same OpenJev API.

Labels are supplied at request time. Each question with up to 52 options uses one forward pass. See the [main model](https://huggingface.co/openjev/openjev) for the API and available formats.

## Run it

```bash
uv venv mlx --python 3.12
uv pip install --python mlx/bin/python "mlx==0.32.2" "mlx-lm==0.31.3" \
  "transformers==5.17.0" "openai==3.16.2" "huggingface-hub==1.32.0"

mlx/bin/hf download openjev/openjev-MLX-4bit --local-dir openjev-MLX-4bit
mlx/bin/hf download openjev/openjev helper/shim.py helper/shim_mlx.py \
  --revision 1c341f65bfe5d50fdb935c71e9739c9e0938d6c4 --local-dir openjev-api

TOKENIZER=openjev-MLX-4bit SHIM_MODEL=openjev-MLX-4bit \
READOUT_T=0.85 READOUT_NOUL_T=1.829074 READOUT_NOUL_BIAS=0 \
READOUT_TARGETED=1 READOUT_INSTR_STYLE=pyrepr SHIM_STAGGER=1 \
  mlx/bin/python openjev-api/helper/shim_mlx.py \
  --helper openjev-api/helper/shim.py --model openjev-MLX-4bit --port 3000
```

Send requests to `http://localhost:3000/v1/systemone` using the main model's examples.

## Licence

Weights: CC BY-NC 4.0 for research and non-commercial use, with attribution. For a commercial licence, email [support@loopai.com](mailto:support@loopai.com). Helper code: Apache 2.0. Upstream notices are included in `NOTICE` and `LICENSE-APACHE-2.0`.

OpenJev is an independent project, not affiliated with TypeSafe; Jev is their product.