devops-thiago commited on
Commit
77178b3
·
verified ·
1 Parent(s): ca98e1a

Update model card metadata and benchmark provenance

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -60,7 +60,7 @@ Instead of generating text token by token, ClassOne evaluates structured decisio
60
 
61
  ## Official Results (Benchmark Heaven)
62
 
63
- Official third-party JevBench leaderboards are hosted at **[Benchmark Heaven](https://benchmarkheaven.com/jev-models)** (checked `2026-11-13`, benchmark release `v1.8.8`; see the live entry for [`classone-qwen3.5-9b`](https://benchmarkheaven.com/jev-models/classone-qwen3.5-9b)). Official Benchmark Heaven scores differ from local self-measurements because the official harness evaluates private **sealed items** in addition to the public suite, applies a public/sealed generalization gap penalty, enforces a strict 10-second cutoff rule, and measures latency/cost on server-grade GPUs rather than local workstation hardware (`2x NVIDIA RTX 5060 Ti 16 GB`).
64
 
65
  ## Edge vs Cloud Latency (Self-Measured Comparison)
66
 
@@ -77,7 +77,7 @@ Measured against a remote cloud LLM decision API round-trip:
77
  - **`Choice`** — Categorical selection over 2–255 dynamic options with full probability distribution
78
  - **`Score`** — Continuous ordinal rubric rating over 2–10 levels (expected value)
79
 
80
- All outputs are calibrated with a combined NLL + normalized Brier loss and post-hoc temperature scaling.
81
 
82
  ## Quickstart
83
 
 
60
 
61
  ## Official Results (Benchmark Heaven)
62
 
63
+ Official third-party JevBench leaderboards are hosted at **[Benchmark Heaven](https://benchmarkheaven.com/jev-models)** (checked `2026-11-13`, JevBench `v1.8.10` / method `v1.7`, published `2026-11-12`; see the live entry for [`classone-qwen3.5-9b`](https://benchmarkheaven.com/jev-models/classone-qwen3.5-9b)). Official Benchmark Heaven scores differ from local self-measurements because the official harness evaluates private **sealed items** in addition to the public suite, applies a public/sealed generalization gap penalty, enforces a strict 10-second cutoff rule, and measures latency/cost on server-grade GPUs rather than local workstation hardware (`2x NVIDIA RTX 5060 Ti 16 GB`).
64
 
65
  ## Edge vs Cloud Latency (Self-Measured Comparison)
66
 
 
77
  - **`Choice`** — Categorical selection over 2–255 dynamic options with full probability distribution
78
  - **`Score`** — Continuous ordinal rubric rating over 2–10 levels (expected value)
79
 
80
+ All outputs are calibrated with a combined focal NLL (γ=2.0) + normalized Brier + contrastive margin loss and post-hoc temperature scaling.
81
 
82
  ## Quickstart
83