Instructions to use AnkitNayak-dev/QJev-1.5B-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use AnkitNayak-dev/QJev-1.5B-LoRA with PEFT:
from peft import PeftModel from transformers import AutoModel base_model = AutoModel.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct") model = PeftModel.from_pretrained(base_model, "AnkitNayak-dev/QJev-1.5B-LoRA") - Transformers
How to use AnkitNayak-dev/QJev-1.5B-LoRA with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="AnkitNayak-dev/QJev-1.5B-LoRA")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AnkitNayak-dev/QJev-1.5B-LoRA", device_map="auto") - Notebooks
- Google Colab
- Kaggle
QJev-1.5B-LoRA: PEFT Decision Adapter
Joint Attention Adapter and MLP Decision Head for Qwen2.5-1.5B-Instruct
QJev Model Family:
Qwen/Qwen2.5-1.5B-Instruct (Base Model)
โโโ devankit7873/QJev-1.5B (Flagship Fused 16-bit, 3.08 GB)
โโโ devankit7873/QJev-1.5B-LoRA (PEFT Adapter, 20 MB)
โโโ devankit7873/QJev-1.5B-4bit (NF4 Quantized, 1.15 GB)
Overview
QJev-1.5B-LoRA is the parameter-efficient adapter release of QJev-1.5B. It is designed for multi-tenant, edge, and modular environments where the base model (Qwen/Qwen2.5-1.5B-Instruct) is already locally cached.
By downloading only 20.7 MB of weights (17.5 MB LoRA adapter + 3.18 MB MLP decision head), users can attach direct expected value decision inference onto an existing base model instance without duplicating base model storage.
Specifications
- Adapter Parameters: Rank 16, Alpha 32 targeting attention projection layers (
q_proj,k_proj,v_proj,o_proj). - Adapter File Size: 17.5 MB (
adapter_model.safetensors). - Decision Head File Size: 3.18 MB (
decision_head.safetensors, 1536 -> 512 -> 10). - Benchmark Evaluation: Evaluates identically to the merged model (62.53% strict tolerance 0.05 / 71.50% relaxed tolerance 0.10 on JevBench).
Quickstart
Python API
from qjev import QJev
# Load the PEFT adapter on top of cached Qwen base weights
model = QJev.from_pretrained("devankit7873/QJev-1.5B-LoRA")
# Execute decision inference
result = model.decide(
context="Production database primary replica CPU utilization reached 100% and connection pool is exhausted.",
choices=[
"Trigger immediate automated failover to standby replica",
"Restart the primary database daemon immediately",
"Double connection pool limits without scaling compute",
"Silence alerts and monitor for next 15 minutes"
]
)
print(f"Recommended Action: {result['best_choice']} ({result['confidence']}%)")
for choice, prob in result['probabilities'].items():
print(f" [{prob:>5.2f}%] {choice}")
Output
Recommended Action: Trigger immediate automated failover to standby replica (88.28%)
[88.28%] Trigger immediate automated failover to standby replica
[ 6.54%] Restart the primary database daemon immediately
[ 4.79%] Double connection pool limits without scaling compute
[ 0.45%] Silence alerts and monitor for next 15 minutes
Architecture and Integration
When loaded, the adapter hooks into the transformer backbone via PEFT, and the final hidden state of the input sequence is routed through the LayerNorm and two-layer MLP projection head to produce normalized decision logits across the candidate options.
License
Released under the Apache 2.0 License. Base model weights are governed by the Alibaba Cloud Qwen License.
- Downloads last month
- 38
Model tree for AnkitNayak-dev/QJev-1.5B-LoRA
Base model
Qwen/Qwen2.5-1.5B