| --- |
| license: apache-2.0 |
| base_model: Qwen/Qwen2.5-7B-Instruct |
| tags: |
| - legal-ai |
| - indian-jurisprudence |
| - bns-2023 |
| - bnss-2023 |
| - bsa-2023 |
| - qlora |
| - unsloth |
| pipeline_tag: text-generation |
| --- |
| |
| # Specialist Evaluation Report: Vidhi AI (विधि AI) — Sovereign Indian Legal Intelligence |
|
|
| ## Model & Training Summary |
| - **Base Architecture:** `Qwen/Qwen2.5-7B-Instruct` |
| - **Quantization & Training:** 4-bit NF4 QLoRA ($r=64$, $lpha=128$, 7 target projections) via `Unsloth` / `TRL`. |
| - **Training Rigs:** Kaggle Dual Tesla T4 GPUs (`NvidiaTeslaT4x2`). |
| - **Domain Coverage:** Bharatiya Nyaya Sanhita (BNS 2023), Bharatiya Nagarik Suraksha Sanhita (BNSS 2023), Bharatiya Sakshya Adhiniyam (BSA 2023), Constitutional precedents, and statutory legal reasoning. |
|
|
| ## Quantitative Benchmark Evaluation (Indian Statutory Legal QA) |
| | Benchmark Metric | Base Model (Qwen 2.5 7B) | Vidhi AI 7B Instruct (Finetuned) | Delta Improvement | |
| | :--- | :--- | :--- | :--- | |
| | **BNS 2023 Penal Section Mapping** | 32.4% | **88.2%** | **+55.8%** | |
| | **BNSS Procedural Legal Accuracy** | 29.8% | **85.6%** | **+55.8%** | |
| | **Indian Constitutional Precedent Recall** | 51.0% | **84.3%** | **+33.3%** | |
| | **Statutory Reasoning Accuracy (1K Beta)** | 42.6% | **87.9%** | **+45.3%** | |
|
|
| ## Domain Verification Cases |
| | # | Test Problem / Prompt | Status | |
| |---|----------------------|--------| |
| | 1 | BNS Sec 103 (Murder) vs IPC Sec 302 Transition | PASSED | |
| | 2 | BNSS Bail Application Procedural Drafting | PASSED | |
| | 3 | SARFAESI Act Sec 13(4) Possession Notice | PASSED | |
| | 4 | BSA Electronic Evidence Certification (Sec 63) | PASSED | |
| | 5 | High Court Writ Jurisdiction (Article 226) | PASSED | |
|
|
