Text Classification
PEFT
Safetensors
Transformers
PyTorch
lora
qlora
qwen
qwen2
decision-making
system-one
reasoning
jev
jevbench
joint-expected-value
classification
agent
fast-inference
Instructions to use devankit7873/QJev-1.5B-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use devankit7873/QJev-1.5B-LoRA with PEFT:
from peft import PeftModel from transformers import AutoModel base_model = AutoModel.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct") model = PeftModel.from_pretrained(base_model, "devankit7873/QJev-1.5B-LoRA") - Transformers
How to use devankit7873/QJev-1.5B-LoRA with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="devankit7873/QJev-1.5B-LoRA")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("devankit7873/QJev-1.5B-LoRA", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from devankit7873/QJev-1.5B-LoRA: direct link, hf CLI and curl.
- Browser
- Download file 3.13 kB
-
https://huggingface.co/devankit7873/QJev-1.5B-LoRA/resolve/main/README.md
- Command line
-
hf download hf://devankit7873/QJev-1.5B-LoRA/README.md
-
curl -L -o README.md https://huggingface.co/devankit7873/QJev-1.5B-LoRA/resolve/main/README.md
3.13 kB
| license: apache-2.0 | |
| base_model: devankit7873/QJev-1.5B | |
| library_name: peft | |
| tags: | |
| - transformers | |
| - peft | |
| - lora | |
| - qlora | |
| - pytorch | |
| - qwen | |
| - qwen2 | |
| - decision-making | |
| - system-one | |
| - reasoning | |
| - jev | |
| - jevbench | |
| - joint-expected-value | |
| - classification | |
| - safetensors | |
| - agent | |
| - fast-inference | |
| datasets: | |
| - SargeDev/jev-distill-corpus-v3 | |
| metrics: | |
| - accuracy | |
| - tvd | |
| - kl_divergence | |
| pipeline_tag: text-classification | |
| <div align="center"> | |
| # โก QJev-1.5B-LoRA: Lightweight PEFT Adapter (~20 MB) | |
| ### Joint Attention Adapter + MLP Decision Head for `Qwen/Qwen2.5-1.5B-Instruct` | |
| [](https://huggingface.co/devankit7873/QJev-1.5B-LoRA) | |
| [](https://github.com/AnkitNayak-dev/QJev-1.5B) | |
| [](https://jevbench.github.io/) | |
| [](LICENSE) | |
| --- | |
| ### ๐ฆ Part of the QJev Model Family: | |
| - **Flagship Standalone (Fused):** [devankit7873/QJev-1.5B](https://huggingface.co/devankit7873/QJev-1.5B) (3.08 GB) | |
| - **Lightweight LoRA Adapter:** [devankit7873/QJev-1.5B-LoRA](https://huggingface.co/devankit7873/QJev-1.5B-LoRA) (20 MB) | |
| - **4-Bit Quantized:** [devankit7873/QJev-1.5B-4bit](https://huggingface.co/devankit7873/QJev-1.5B-4bit) (1.20 GB, 1.07 GB VRAM) | |
| --- | |
| </div> | |
| ## ๐ก Overview | |
| **`QJev-1.5B-LoRA`** is the lightweight **PEFT / LoRA adapter release** for edge, mobile, and modular LLM deployments. | |
| Instead of downloading the entire 3GB transformer weights, developers who already cache `Qwen/Qwen2.5-1.5B-Instruct` can download just **20 MB** to equip their base model with high-speed System 1 decision-making capabilities. | |
| - **Adapter Size:** 17.5 MB (`adapter_model.safetensors`, targeting `q_proj`, `k_proj`, `v_proj`, `o_proj`, rank 16, alpha 32) | |
| - **Decision Head Size:** 3.18 MB (`decision_head.safetensors`, 1536 $\to$ 512 $\to$ 10) | |
| - **JevBench Calibrated Score:** **71.5%** (Identical performance to full merged model) | |
| --- | |
| ## ๐ Quickstart: Super Friendly 3-Line Decision | |
| ```python | |
| from qjev import QJev | |
| # 1. Load the adapter in 1 line: | |
| model = QJev.from_pretrained("devankit7873/QJev-1.5B-LoRA") | |
| # 2. Decide in 31 ms! | |
| result = model.decide( | |
| context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.", | |
| choices=[ | |
| "Trigger immediate automated failover to standby replica", | |
| "Restart the primary database daemon immediately", | |
| "Double connection pool limits without scaling compute", | |
| "Silence alerts and monitor for next 15 minutes" | |
| ] | |
| ) | |
| print(f"๐ Recommended: {result['best_choice']} ({result['confidence']}%)") | |
| for choice, prob in result['probabilities'].items(): | |
| print(f" [{prob:>5.2f}%] {choice}") | |
| ``` | |
| --- | |
| ## ๐ License | |
| Released under the **Apache 2.0 License**. Base model governed by Alibaba Cloud Qwen License. | |