minimodels / decision-1.0 (candy-cane)

candy-cane — /v1/systemone decision model.

Docker

docker build -t minimodels-decision-1.0 .
docker run --rm --gpus all --network none -e JEV_PORT=8000 -p 8000:8000 minimodels-decision-1.0

Python Server

pip install -r requirements.txt
python3 scripts/serve_torch_jev.py \
  --adapter-path adapter \
  --calibration configs/candy_cane.json \
  --host 0.0.0.0 \
  --port 8000

Endpoints

  • GET /health
  • GET /v1/models
  • POST /v1/systemone

License

Apache License 2.0

Downloads last month
19
Safetensors
Model size
31B params
Tensor type
U32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support