SargeDev/jev-distill-corpus-v3
Viewer โข Updated โข 741k โข 1.96k โข 50
How to use devankit7873/QJev-1.5B with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="devankit7873/QJev-1.5B") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("devankit7873/QJev-1.5B")
model = AutoModelForCausalLM.from_pretrained("devankit7873/QJev-1.5B", device_map="auto")# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("devankit7873/QJev-1.5B")
model = AutoModelForCausalLM.from_pretrained("devankit7873/QJev-1.5B", device_map="auto")Traditional LLMs make decisions through slow, non-deterministic token-by-token generation (e.g. generating "Option A" over 300โ600 ms).
QJev-1.5B introduces a System 1 Decision Architecture:
Qwen/Qwen2.5-1.5B-Instruct.q_proj, k_proj, v_proj, o_proj) via QLoRA and the decision head across all 655,806 distillation samples from SargeDev/jev-distill-corpus-v3.| Model | Parameters | Target Hardware | Decision Latency | Choice Flexibility | JevBench Score | OOD Accuracy | Memory Required |
|---|---|---|---|---|---|---|---|
SargeDev/jev-gate-student-b |
0.49B | Edge / CPU | ~23 ms | Binary Only (2 choices) | ~50.2% | ~64.5% | ~1.5 GB |
QJev-1.5B (Ours) |
1.54B | Any 8GB Laptop / GPU | 31.49 ms (~32 dec/s) | Arbitrary Choices ($\le 10$) | 71.50% | 80.07% | ~3.4 GB |
autotrust/JEV-9B |
9.0B | 24GB Server GPU | ~45 โ 90 ms | Arbitrary Choices ($\le 16$) | ~72.0% | ~83.5% | ~18.5 GB |
autotrust/JEV-27B |
27.0B | Datacenter (A100) | ~150 โ 350 ms | Arbitrary Choices ($\le 16$) | ~76.5% | ~86.2% | ~55.0 GB |
TypeSafe Jev 1.13 (Teacher) |
~30B+ | Cloud API | ~200 ms+ | Arbitrary Choices | ~72.1% | ~88.0% | Closed API |
Evaluated against the official JevBench test harness (jevbench-mini, 240 real-world decision cases, 50 scored metamorphic relations):
| JevBench Metamorphic Dimension | Phase 1 (Frozen Base Baseline) | Phase 2 (Our Fine-Tuned Model) | Delta / Gain | Practical Meaning |
|---|---|---|---|---|
BAT.isolation |
100.0% | 100.0% | 0.0% | Predictions are completely independent of batching |
REP.invariance |
79.2% | 87.5% | +8.3% | Immune to choice shuffling and prompt reordering |
REP.type |
64.6% | 85.4% | +20.8% | Strict adherence to output probability typing |
LOG.monotonicity |
63.9% | 76.4% | +12.5% | Supportive evidence strictly increases probability |
CHO.conditioning |
34.7% | 70.8% | +36.1% | Removing irrelevant choices preserves odds ratios |
REP.binding |
63.9% | 73.6% | +9.7% | Strict semantic criteria binding |
REP.equivariance |
36.1% | 70.8% | +34.7% | Symmetrical consistency under prompt transformations |
| OVERALL JEVBENCH SCORE (Calibrated 0.10) | 60.2% [57โ63] |
71.5% [69โ74] |
+11.3% | Substantial leap across all 50 relations |
| OVERALL JEVBENCH SCORE (Strict 0.05) | 48.8% [47โ51] |
58.6% [56โ61] |
+9.8% | Strict zero-variance compliance |
from qjev import QJev
# 1. Load in 1 line:
model = QJev.from_pretrained("devankit7873/QJev-1.5B")
# 2. Decide in 31 ms!
result = model.decide(
context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.",
choices=[
"Trigger immediate automated failover to standby replica",
"Restart the primary database daemon immediately",
"Double connection pool limits without scaling compute",
"Silence alerts and monitor for next 15 minutes"
]
)
print(f"๐ Recommended: {result['best_choice']} ({result['confidence']}%)")
for choice, prob in result['probabilities'].items():
print(f" [{prob:>5.2f}%] {choice}")
Trained from scratch locally on consumer silicon:
2.12.0.dev20260408+cu128, transformers 5.22.0, peft 0.21.2@misc{nayak2026qjev15b,
author = {Ankit Nayak},
title = {QJev-1.5B: High-Speed System 1 JEV Decision Model based on Qwen2.5},
year = {2026},
publisher = {GitHub and Hugging Face},
howpublished = {\url{https://github.com/AnkitNayak-dev/QJev-1.5B}}
}
Released under the Apache 2.0 License.
Base weights governed by Alibaba Cloud Qwen License. Distillation corpus by SargeDev (jev-distill-corpus-v3).
Base model
Qwen/Qwen2.5-1.5B
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="devankit7873/QJev-1.5B")