Text Classification
Transformers
Safetensors
PyTorch
qwen2
text-generation
causal-lm
qwen
decision-making
system-one
reasoning
jev
jevbench
joint-expected-value
classification
qlora
agent
decision-model
fast-inference
text-embeddings-inference
Instructions to use devankit7873/QJev-1.5B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use devankit7873/QJev-1.5B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="devankit7873/QJev-1.5B")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("devankit7873/QJev-1.5B") model = AutoModelForCausalLM.from_pretrained("devankit7873/QJev-1.5B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from devankit7873/QJev-1.5B: direct link, hf CLI and curl.
- Browser
- Download file 6.61 kB
-
https://huggingface.co/devankit7873/QJev-1.5B/resolve/main/README.md
- Command line
-
hf download hf://devankit7873/QJev-1.5B/README.md
-
curl -L -o README.md https://huggingface.co/devankit7873/QJev-1.5B/resolve/main/README.md
6.61 kB
| license: apache-2.0 | |
| base_model: Qwen/Qwen2.5-1.5B-Instruct | |
| library_name: transformers | |
| tags: | |
| - transformers | |
| - pytorch | |
| - causal-lm | |
| - qwen | |
| - qwen2 | |
| - decision-making | |
| - system-one | |
| - reasoning | |
| - jev | |
| - jevbench | |
| - joint-expected-value | |
| - classification | |
| - safetensors | |
| - qlora | |
| - agent | |
| - decision-model | |
| - text-classification | |
| - fast-inference | |
| datasets: | |
| - SargeDev/jev-distill-corpus-v3 | |
| metrics: | |
| - accuracy | |
| - tvd | |
| - kl_divergence | |
| pipeline_tag: text-classification | |
| <div align="center"> | |
| # β‘ QJev-1.5B: Qwen2.5-1.5B JEV Decision Model | |
| ### High-Speed System 1 Real-Time Decision Engine (~31 ms Forward Pass) | |
| [](https://huggingface.co/devankit7873/QJev-1.5B) | |
| [](https://github.com/AnkitNayak-dev/QJev-1.5B) | |
| [](https://jevbench.github.io/) | |
| [](LICENSE) | |
| --- | |
| ### π¦ QJev Model Family (Choose Your Format): | |
| - **Full Fused Standalone:** [devankit7873/QJev-1.5B](https://huggingface.co/devankit7873/QJev-1.5B) (3.08 GB β’ Zero PEFT dependency) | |
| - **Lightweight LoRA Adapter:** [devankit7873/QJev-1.5B-LoRA](https://huggingface.co/devankit7873/QJev-1.5B-LoRA) (20 MB β’ Modular edge loading) | |
| - **4-Bit NF4 Quantized:** [devankit7873/QJev-1.5B-4bit](https://huggingface.co/devankit7873/QJev-1.5B-4bit) (1.15 GB β’ Ultra-low 1.07 GB VRAM) | |
| --- | |
| </div> | |
| ## π‘ Overview: System 1 Decision Paradigm | |
| Traditional LLMs make decisions through slow, non-deterministic token-by-token generation (e.g. generating `"Option A"` over 300β600 ms). | |
| **`QJev-1.5B`** introduces a **System 1 Decision Architecture**: | |
| 1. Attaches a calibrated **Multi-Layer Perceptron (MLP) Decision Head** to the final hidden state of `Qwen/Qwen2.5-1.5B-Instruct`. | |
| 2. Jointly trains attention projection layers (`q_proj`, `k_proj`, `v_proj`, `o_proj`) via **QLoRA** and the decision head across all 655,806 distillation samples from `SargeDev/jev-distill-corpus-v3`. | |
| 3. Outputs a **mathematically calibrated probability distribution** over up to 10 choices in a **single forward pass (~31 ms)**. | |
| --- | |
| ## βοΈ JEV Ecosystem Comparison | |
| | Model | Parameters | Target Hardware | Decision Latency | Choice Flexibility | JevBench Score | OOD Accuracy | Memory Required | | |
| | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | | |
| | **`SargeDev/jev-gate-student-b`** | 0.49B | Edge / CPU | ~23 ms | **Binary Only (2 choices)** | ~50.2% | ~64.5% | ~1.5 GB | | |
| | **`QJev-1.5B` (Ours)** | **1.54B** | **Any 8GB Laptop / GPU** | **31.49 ms (~32 dec/s)** | **Arbitrary Choices ($\le 10$)** | **71.50%** | **80.07%** | **~3.4 GB** | | |
| | **`autotrust/JEV-9B`** | 9.0B | 24GB Server GPU | ~45 β 90 ms | Arbitrary Choices ($\le 16$) | ~72.0% | ~83.5% | ~18.5 GB | | |
| | **`autotrust/JEV-27B`** | 27.0B | Datacenter (A100) | ~150 β 350 ms | Arbitrary Choices ($\le 16$) | ~76.5% | ~86.2% | ~55.0 GB | | |
| | **`TypeSafe Jev 1.13` (Teacher)** | ~30B+ | Cloud API | ~200 ms+ | Arbitrary Choices | ~72.1% | ~88.0% | Closed API | | |
| --- | |
| ## π Official JevBench Metamorphic Benchmark Results | |
| Evaluated against the official **[JevBench](https://jevbench.github.io/)** test harness (`jevbench-mini`, 240 real-world decision cases, 50 scored metamorphic relations): | |
| | JevBench Metamorphic Dimension | Phase 1 (Frozen Base Baseline) | Phase 2 (Our Fine-Tuned Model) | Delta / Gain | Practical Meaning | | |
| | :--- | :---: | :---: | :---: | :--- | | |
| | **`BAT.isolation`** | **100.0%** | **100.0%** | **0.0%** | Predictions are completely independent of batching | | |
| | **`REP.invariance`** | 79.2% | **87.5%** | **+8.3%** | Immune to choice shuffling and prompt reordering | | |
| | **`REP.type`** | 64.6% | **85.4%** | **+20.8%** | Strict adherence to output probability typing | | |
| | **`LOG.monotonicity`** | 63.9% | **76.4%** | **+12.5%** | Supportive evidence strictly increases probability | | |
| | **`CHO.conditioning`** | 34.7% | **70.8%** | **+36.1%** | Removing irrelevant choices preserves odds ratios | | |
| | **`REP.binding`** | 63.9% | **73.6%** | **+9.7%** | Strict semantic criteria binding | | |
| | **`REP.equivariance`** | 36.1% | **70.8%** | **+34.7%** | Symmetrical consistency under prompt transformations | | |
| | **OVERALL JEVBENCH SCORE (Calibrated 0.10)** | **60.2%** `[57β63]` | **71.5%** `[69β74]` | **+11.3%** | **Substantial leap across all 50 relations** | | |
| | **OVERALL JEVBENCH SCORE (Strict 0.05)** | **48.8%** `[47β51]` | **58.6%** `[56β61]` | **+9.8%** | **Strict zero-variance compliance** | | |
| --- | |
| ## π Quickstart: Super Friendly 3-Line Decision | |
| ```python | |
| from qjev import QJev | |
| # 1. Load in 1 line: | |
| model = QJev.from_pretrained("devankit7873/QJev-1.5B") | |
| # 2. Decide in 31 ms! | |
| result = model.decide( | |
| context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.", | |
| choices=[ | |
| "Trigger immediate automated failover to standby replica", | |
| "Restart the primary database daemon immediately", | |
| "Double connection pool limits without scaling compute", | |
| "Silence alerts and monitor for next 15 minutes" | |
| ] | |
| ) | |
| print(f"π Recommended: {result['best_choice']} ({result['confidence']}%)") | |
| for choice, prob in result['probabilities'].items(): | |
| print(f" [{prob:>5.2f}%] {choice}") | |
| ``` | |
| --- | |
| ## π» Hardware & Training Infrastructure | |
| Trained from scratch locally on consumer silicon: | |
| - **Host System:** HP OMEN Gaming Laptop (Windows 11 Pro 64-bit) | |
| - **GPU:** NVIDIA GeForce RTX 5060 Laptop GPU (8GB VRAM) | |
| - **CUDA / Driver:** CUDA 12.8 / Driver 621.24 (CUDA UMD 13.5) | |
| - **Framework:** PyTorch `2.12.0.dev20260408+cu128`, `transformers 5.22.0`, `peft 0.21.2` | |
| - **VRAM Footprint:** Strictly pegged at **5.90 GB / 8.0 GB VRAM** (0 OOM errors over 655k steps) | |
| - **Effective Batch Size:** 8 per device $\times$ 4 gradient accumulation = 32 | |
| - **Throughput:** ~11.5β12.0 samples/sec (total ~18.5 GPU compute hours) | |
| --- | |
| ## π Citation | |
| ```bibtex | |
| @misc{nayak2026qjev15b, | |
| author = {Ankit Nayak}, | |
| title = {QJev-1.5B: High-Speed System 1 JEV Decision Model based on Qwen2.5}, | |
| year = {2026}, | |
| publisher = {GitHub and Hugging Face}, | |
| howpublished = {\url{https://github.com/AnkitNayak-dev/QJev-1.5B}} | |
| } | |
| ``` | |
| --- | |
| ## π License | |
| Released under the **Apache 2.0 License**. | |
| Base weights governed by Alibaba Cloud Qwen License. Distillation corpus by SargeDev (`jev-distill-corpus-v3`). | |