modernbert-jev v2 (fine-tuned, x86 QUInt8)

150M ModernBERT-base NLI (tasksource/ModernBERT-base-nli), fine-tuned with KL distillation on 50k JevDistillCorpus-v3 rows + MNLI aux, exported to ONNX opset 17, dynamically quantized with unsigned int8 weights (signed mis-executes on x86 ORT).

  • model.onnx โ€” int8 model, ~150 MB, 1 CPU thread
  • tokenizer.json, config.json โ€” Rust tokenizer + head config (GLUE label order)
  • calibration.json โ€” per-head temperatures (choice 0.9, score 0.9, noul 2.5)

Run with https://github.com/KSonny4/modernbert-jev: modernbert-jev run --model <this-dir> --request ... or serve for POST /v1/systemone.

Public JevBench accuracy (self-measured, 231 items): 0.554.

Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support