Instructions to use TaskWizerAI/opencodifier-e1e-2b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use TaskWizerAI/opencodifier-e1e-2b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/home/mkinney/t5500-bundle/models/Qwen3.5-2B") model = PeftModel.from_pretrained(base_model, "TaskWizerAI/opencodifier-e1e-2b") - Transformers
How to use TaskWizerAI/opencodifier-e1e-2b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="TaskWizerAI/opencodifier-e1e-2b")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TaskWizerAI/opencodifier-e1e-2b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use TaskWizerAI/opencodifier-e1e-2b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "TaskWizerAI/opencodifier-e1e-2b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TaskWizerAI/opencodifier-e1e-2b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/TaskWizerAI/opencodifier-e1e-2b
- SGLang
How to use TaskWizerAI/opencodifier-e1e-2b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "TaskWizerAI/opencodifier-e1e-2b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TaskWizerAI/opencodifier-e1e-2b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "TaskWizerAI/opencodifier-e1e-2b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TaskWizerAI/opencodifier-e1e-2b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use TaskWizerAI/opencodifier-e1e-2b with Docker Model Runner:
docker model run hf.co/TaskWizerAI/opencodifier-e1e-2b
Restore full model card (results, training, usage, license frontmatter)
Browse files
README.md
CHANGED
|
@@ -1,98 +1,94 @@
|
|
| 1 |
---
|
| 2 |
-
base_model: Qwen3.5-2B
|
| 3 |
library_name: peft
|
|
|
|
| 4 |
pipeline_tag: text-generation
|
| 5 |
tags:
|
| 6 |
-
- base_model:adapter:Qwen3.5-2B
|
| 7 |
- lora
|
| 8 |
-
-
|
| 9 |
-
- opencodifier
|
| 10 |
- decision-model
|
| 11 |
-
|
| 12 |
---
|
| 13 |
|
| 14 |
-
# OpenCodifier E1-E 2B
|
| 15 |
-
|
| 16 |
-
A verdict-slot LoRA adapter on Qwen3.5-2B for typed decision-making (choice, boolean, score).
|
| 17 |
-
Part of the OpenCodifier decision runtime: opencodifier.pages.dev.
|
| 18 |
-
|
| 19 |
-
## Model Details
|
| 20 |
|
| 21 |
-
|
| 22 |
-
- **
|
| 23 |
-
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
-
|
| 27 |
|
| 28 |
-
##
|
| 29 |
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
|
| 35 |
-
|
| 36 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## Training
|
| 39 |
|
| 40 |
-
- **
|
| 41 |
-
- **
|
| 42 |
-
|
| 43 |
-
- **
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
### JevBench Public 231 (231 items, authors' harness)
|
| 48 |
|
| 49 |
-
|
| 50 |
-
|---|---|
|
| 51 |
-
| Accuracy | 0.6840 |
|
| 52 |
-
| Macro | 0.6840 |
|
| 53 |
-
| ECE | 0.127 (calibrated T=3.362) |
|
| 54 |
-
| Brier | 0.332 |
|
| 55 |
-
| p50 latency | ~1.7 s (CPU, single decision) |
|
| 56 |
-
| Replay determinism | 231/231 |
|
| 57 |
-
|
| 58 |
-
### Suite Holdout (231 items, internal)
|
| 59 |
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
|
|
|
| 63 |
|
| 64 |
-
##
|
| 65 |
|
| 66 |
-
|
|
|
|
|
|
|
| 67 |
|
| 68 |
-
|
| 69 |
|
| 70 |
-
```
|
| 71 |
-
|
| 72 |
-
|
| 73 |
|
| 74 |
-
|
| 75 |
-
|
| 76 |
```
|
| 77 |
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
- Not a general-purpose language model
|
| 81 |
-
- Not trained for prose generation
|
| 82 |
-
- Not calibrated for non-decision classification
|
| 83 |
|
| 84 |
-
##
|
| 85 |
|
| 86 |
-
|
| 87 |
-
Apply the calibration artifact from `results/calibration/qwen3.5-2b-q4_k_m/fit.json`
|
| 88 |
-
before evaluating on any surface other than the holdout.
|
| 89 |
|
| 90 |
-
##
|
| 91 |
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
|
| 97 |
-
|
| 98 |
-
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: Qwen/Qwen3.5-2B
|
| 3 |
library_name: peft
|
| 4 |
+
license: apache-2.0
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
tags:
|
|
|
|
| 7 |
- lora
|
| 8 |
+
- transformers
|
|
|
|
| 9 |
- decision-model
|
| 10 |
+
- opencodifier
|
| 11 |
---
|
| 12 |
|
| 13 |
+
# OpenCodifier E1-E β Qwen3.5-2B verdict-slot decision LoRA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
+
A LoRA adapter that turns [Qwen/Qwen3.5-2B](https://huggingface.co/Qwen/Qwen3.5-2B)
|
| 16 |
+
into a Jev-style **decision model**: probabilities are read from the
|
| 17 |
+
log-probs of verdict-slot label tokens at the answer position β nothing is
|
| 18 |
+
generated, nothing is parsed. It is the decision rung of the
|
| 19 |
+
[OpenCodifier](https://github.com/aliasfoxkde/OpenCodifier) ladder, and the
|
| 20 |
+
first own-trained arm to pass both release-gate legs.
|
| 21 |
|
| 22 |
+
## Results
|
| 23 |
|
| 24 |
+
All numbers from the OpenCodifier evaluation records
|
| 25 |
+
([BENCHMARKS.md](https://github.com/aliasfoxkde/OpenCodifier/blob/main/docs/BENCHMARKS.md),
|
| 26 |
+
TRAINING.md Β§9.9.1). Public 231-item JevBench split, deterministic
|
| 27 |
+
readout, fp16, single V100.
|
| 28 |
|
| 29 |
+
| metric | value |
|
| 30 |
+
|---|---|
|
| 31 |
+
| JevBench-231 accuracy | **0.6840** (publish bar 0.6494 β clear) |
|
| 32 |
+
| Internal holdout suite | **0.8083** (gate β₯ 0.75 β GATE_PASS; seed-replicated 0.8000) |
|
| 33 |
+
| Raw board ECE | 0.207 |
|
| 34 |
+
| Holdout-fitted temperature (T=3.362, analysis-only on board) | ECE 0.207 β 0.127 |
|
| 35 |
+
| Auto-decidable @5% risk | 0.100 (23/231) |
|
| 36 |
+
| Brier | 0.504 |
|
| 37 |
+
| p50 latency | 0.58 s |
|
| 38 |
+
|
| 39 |
+
Per-family shape: routing / tool-selection / ordinal families at 1.00;
|
| 40 |
+
relational/compositional families are the weakness (multi_hop 0.389,
|
| 41 |
+
judge_hard 0.412, long_policy 0.368). The board is lost on compositional
|
| 42 |
+
families, not on routing β the candidate lever is relational-heavy
|
| 43 |
+
soft-label data, not parameters.
|
| 44 |
|
| 45 |
## Training
|
| 46 |
|
| 47 |
+
- **Base**: Qwen3.5-2B, LoRA verdict-slot readout
|
| 48 |
+
- **Corpus**: merged-v3 (173,452 records; composition and join rates in
|
| 49 |
+
TRAINING.md). The corpus itself is **not** released with this adapter.
|
| 50 |
+
- **Schedule**: 11,009 steps, single V100 (T5500), fp16
|
| 51 |
+
- **Calibration**: temperature T=3.362 fitted on a labelled holdout
|
| 52 |
+
(holdout ECE 0.179 β 0.117); artifact ships in the OpenCodifier repo
|
| 53 |
+
at `calibration/e1e-qwen3.5-2b-holdout.json`
|
|
|
|
| 54 |
|
| 55 |
+
## Intended use
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
|
| 57 |
+
Typed multiple-choice decisions (routing, tool selection, ordinal
|
| 58 |
+
grading) where calibrated token-level probabilities β not free text β
|
| 59 |
+
are the product. Pairs with the OpenCodifier engine's confidence gate:
|
| 60 |
+
low-confidence reads abstain or escalate to a stronger rung.
|
| 61 |
|
| 62 |
+
## Out of scope
|
| 63 |
|
| 64 |
+
Free-form generation; the base model's general chat ability is not
|
| 65 |
+
preserved or claimed. Not evaluated for safety of generated content β
|
| 66 |
+
the adapter is a readout head, not a chat model.
|
| 67 |
|
| 68 |
+
## How to use
|
| 69 |
|
| 70 |
+
```python
|
| 71 |
+
from peft import PeftModel
|
| 72 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 73 |
|
| 74 |
+
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-2B", torch_dtype="float16")
|
| 75 |
+
model = PeftModel.from_pretrained(base, "TaskWizerAI/opencodifier-e1e-2b")
|
| 76 |
```
|
| 77 |
|
| 78 |
+
Scores come from label-token log-probs at the answer position; see the
|
| 79 |
+
OpenCodifier repo for the readout harness and the Jev adapter wire shape.
|
|
|
|
|
|
|
|
|
|
| 80 |
|
| 81 |
+
## License
|
| 82 |
|
| 83 |
+
Apache-2.0, matching the OpenCodifier project.
|
|
|
|
|
|
|
| 84 |
|
| 85 |
+
## Citation
|
| 86 |
|
| 87 |
+
```bibtex
|
| 88 |
+
@software{opencodifier_e1e_2026,
|
| 89 |
+
title = {OpenCodifier E1-E: a gate-passing 2B decision-model LoRA},
|
| 90 |
+
author = {Kinney, Michael},
|
| 91 |
+
year = {2026},
|
| 92 |
+
url = {https://github.com/aliasfoxkde/OpenCodifier}
|
| 93 |
+
}
|
| 94 |
+
```
|