⚑ QJev-1.5B-LoRA: Lightweight PEFT Adapter (~20 MB)

Joint Attention Adapter + MLP Decision Head for Qwen/Qwen2.5-1.5B-Instruct

Hugging Face GitHub JevBench License


πŸ“¦ Part of the QJev Model Family:


πŸ’‘ Overview

QJev-1.5B-LoRA is the lightweight PEFT / LoRA adapter release for edge, mobile, and modular LLM deployments.

Instead of downloading the entire 3GB transformer weights, developers who already cache Qwen/Qwen2.5-1.5B-Instruct can download just 20 MB to equip their base model with high-speed System 1 decision-making capabilities.

  • Adapter Size: 17.5 MB (adapter_model.safetensors, targeting q_proj, k_proj, v_proj, o_proj, rank 16, alpha 32)
  • Decision Head Size: 3.18 MB (decision_head.safetensors, 1536 $\to$ 512 $\to$ 10)
  • JevBench Calibrated Score: 71.5% (Identical performance to full merged model)

πŸš€ Quickstart: Super Friendly 3-Line Decision

from qjev import QJev

# 1. Load the adapter in 1 line:
model = QJev.from_pretrained("devankit7873/QJev-1.5B-LoRA")

# 2. Decide in 31 ms!
result = model.decide(
    context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.",
    choices=[
        "Trigger immediate automated failover to standby replica",
        "Restart the primary database daemon immediately",
        "Double connection pool limits without scaling compute",
        "Silence alerts and monitor for next 15 minutes"
    ]
)

print(f"πŸ‘‰ Recommended: {result['best_choice']} ({result['confidence']}%)")
for choice, prob in result['probabilities'].items():
    print(f"  [{prob:>5.2f}%]  {choice}")

πŸ“„ License

Released under the Apache 2.0 License. Base model governed by Alibaba Cloud Qwen License.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for devankit7873/QJev-1.5B-LoRA

Adapter
(1)
this model

Dataset used to train devankit7873/QJev-1.5B-LoRA