Vox MENS β€” Qwen3 adapter ladder

MENS is the Vox project's own adapter ladder: one LoRA adapter per size of a pinned Qwen3 base model, trained on Vox source and gated before it is published. The docs page explains what MENS is, how hubs and spokes relate and how the gates decide; this index is the one place that lists every size.

Vox MENS overview

Sizes and spokes

Size vox-lang harness: tool-selection harness: argument-generation rust Hub Repo
0.6B passed planned planned planned published v12 brbrainerd/vox-mens-qwen3-0.6b
1.7B failed planned planned planned published v7 brbrainerd/vox-mens-qwen3-1.7b
4B passed planned planned planned published v7 brbrainerd/vox-mens-qwen3-4b
8B passed planned planned planned published v6 brbrainerd/vox-mens-qwen3-8b
14B not evaluated planned planned planned published v1 brbrainerd/vox-mens-qwen3-14b
32B not trained planned planned planned no weights brbrainerd/vox-mens-qwen3-32b

Each trained cell holds the size's gate, defined in the state legend, and planned marks a spoke with no adapter yet. Declared in hub-cards.yaml: no run record carries training lanes yet, and every current ladder adapter was trained on the vox-lang mix. Phase 338 plan 06 replaces this with a value derived from the run.

Which model should I use

Pick among the sizes whose gate is current by held-out adapter pass@1, and step down to the next smaller current size when the pick does not fit your memory. Each card's Why this size section says what work that size suits, the training peak is measured while training and is not a serving figure, and phase 340's selector will replace this rule.

Among the sizes with a current gate and an adapter score from the current serving path, 0.6B has the highest held-out adapter pass@1, 28.8%, and a tie goes to the smaller size.

Size Adapter pass@1 Training peak
0.6B 15/52 (28.8%) 15321 MiB
4B 13/52 (25.0%) 34460 MiB
8B 14/52 (26.9%) 49374 MiB
vox mens hub pull --size 0.6B --namespace brbrainerd

What's next

  • 1.7B: review the gate that stopped 1.7B, because the current evaluation measured its adapter and repeating that evaluation would measure the same adapter. There is no estimate for 1.7B.

  • 14B: produce the records that are missing for 14B: collateral_damage_report.json, anti_stub, pass_at_k. Re-evaluate the 14B adapter on the held-out bench under the current serving path with vox mens eval-local. This is an estimate, not a measurement: the 14B re-gate is projected at about 8.0 hours, or 11.0 hours if slower, with low confidence. Basis: 337-RESEARCH.md, Projections, end of the "4B 128/slice collateral gate" paragraph: about 700 new generations for the 14B gate at 42 s/item expected and 58 s/item conservative, giving 29400 s = 8.2 h and 40600 s = 11.3 h; the research text rounds these to about 8 h and about 11 h. Per-item rates for 14B are projections, not measurements.

  • harness: tool-selection: Chooses which harness tool to call next. No adapter has been trained for harness: tool-selection, and there is no estimate for it. The plan for harness: tool-selection is on the docs page.

  • harness: argument-generation: Fills in the arguments for a chosen harness tool call. No adapter has been trained for harness: argument-generation, and there is no estimate for it. The plan for harness: argument-generation is on the docs page.

  • rust: Writes and edits Rust code for the same workflows. No adapter has been trained for rust, and there is no estimate for it. The plan for rust is on the docs page.

Held-out pass@1 by size

Size Base pass@1 Adapter pass@1
0.6B 6/52 (11.5%) 15/52 (28.8%)
1.7B 3/52 (5.8%) 19/52 (36.5%)
4B 4/52 (7.7%) 13/52 (25.0%)
8B 5/52 (9.6%) 14/52 (26.9%)

The table lists held-out pass@1 (defined here) only for sizes with a report under the current prompt protocol qwen3_non_thinking_codegen_v1, and an adapter score recorded under an earlier serving path is shown as a dash because it does not count.

Links

This index is generated by vox mens hub sync from each size's records, and how the cards are made is on the docs page.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Space using brbrainerd/vox-mens-index 1