Text Classification
PEFT
Safetensors
Transformers
PyTorch
lora
qlora
qwen
qwen2
decision-making
system-one
reasoning
jev
jevbench
joint-expected-value
classification
agent
fast-inference
Instructions to use devankit7873/QJev-1.5B-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use devankit7873/QJev-1.5B-LoRA with PEFT:
from peft import PeftModel from transformers import AutoModel base_model = AutoModel.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct") model = PeftModel.from_pretrained(base_model, "devankit7873/QJev-1.5B-LoRA") - Transformers
How to use devankit7873/QJev-1.5B-LoRA with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="devankit7873/QJev-1.5B-LoRA")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("devankit7873/QJev-1.5B-LoRA", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from devankit7873/QJev-1.5B-LoRA: direct link, hf CLI and curl.
- Browser
- Download file 3.13 kB
-
https://huggingface.co/devankit7873/QJev-1.5B-LoRA/resolve/main/README.md
- Command line
-
hf download hf://devankit7873/QJev-1.5B-LoRA/README.md
-
curl -L -o README.md https://huggingface.co/devankit7873/QJev-1.5B-LoRA/resolve/main/README.md
3.13 kB
metadata
license: apache-2.0
base_model: devankit7873/QJev-1.5B
library_name: peft
tags:
- transformers
- peft
- lora
- qlora
- pytorch
- qwen
- qwen2
- decision-making
- system-one
- reasoning
- jev
- jevbench
- joint-expected-value
- classification
- safetensors
- agent
- fast-inference
datasets:
- SargeDev/jev-distill-corpus-v3
metrics:
- accuracy
- tvd
- kl_divergence
pipeline_tag: text-classification
β‘ QJev-1.5B-LoRA: Lightweight PEFT Adapter (~20 MB)
Joint Attention Adapter + MLP Decision Head for Qwen/Qwen2.5-1.5B-Instruct
π¦ Part of the QJev Model Family:
- Flagship Standalone (Fused): devankit7873/QJev-1.5B (3.08 GB)
- Lightweight LoRA Adapter: devankit7873/QJev-1.5B-LoRA (20 MB)
- 4-Bit Quantized: devankit7873/QJev-1.5B-4bit (1.20 GB, 1.07 GB VRAM)
π‘ Overview
QJev-1.5B-LoRA is the lightweight PEFT / LoRA adapter release for edge, mobile, and modular LLM deployments.
Instead of downloading the entire 3GB transformer weights, developers who already cache Qwen/Qwen2.5-1.5B-Instruct can download just 20 MB to equip their base model with high-speed System 1 decision-making capabilities.
- Adapter Size: 17.5 MB (
adapter_model.safetensors, targetingq_proj,k_proj,v_proj,o_proj, rank 16, alpha 32) - Decision Head Size: 3.18 MB (
decision_head.safetensors, 1536 $\to$ 512 $\to$ 10) - JevBench Calibrated Score: 71.5% (Identical performance to full merged model)
π Quickstart: Super Friendly 3-Line Decision
from qjev import QJev
# 1. Load the adapter in 1 line:
model = QJev.from_pretrained("devankit7873/QJev-1.5B-LoRA")
# 2. Decide in 31 ms!
result = model.decide(
context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.",
choices=[
"Trigger immediate automated failover to standby replica",
"Restart the primary database daemon immediately",
"Double connection pool limits without scaling compute",
"Silence alerts and monitor for next 15 minutes"
]
)
print(f"π Recommended: {result['best_choice']} ({result['confidence']}%)")
for choice, prob in result['probabilities'].items():
print(f" [{prob:>5.2f}%] {choice}")
π License
Released under the Apache 2.0 License. Base model governed by Alibaba Cloud Qwen License.