| --- |
| library_name: peft |
| base_model: mistralai/Mistral-7B-Instruct-v0.2 |
| license: apache-2.0 |
| tags: |
| - nixpkgs |
| - security |
| - lora |
| - nix |
| - patch-generation |
| - deprecated |
| datasets: |
| - odoom/nixpkgs-security-patches |
| --- |
| |
| # nixpkgs-security-lora (Deprecated) |
|
|
| > **This adapter is deprecated.** Use [odoom/nixpkgs-security-qwen-lora](https://huggingface.co/odoom/nixpkgs-security-qwen-lora) instead — Qwen 2.5 Coder 32B with multi-turn tool-calling, lower loss (0.54 vs 0.87), and higher accuracy (90% vs 80%). |
|
|
| ## What Changed |
|
|
| | | v2 (this repo) | v3 (new repo) | |
| |---|---|---| |
| | Base model | Mistral 7B Instruct v0.2 | Qwen 2.5 Coder 32B Instruct | |
| | Format | Single-turn (system/user/assistant) | Multi-turn tool-calling conversations | |
| | Loss | 0.867 | 0.540 | |
| | Token accuracy | 80.5% | 90.1% | |
| | Adapter size | 160 MB | 256 MB | |
| | Tool calling | Broken (`raw: true` disabled it) | Native Qwen 2.5 tool calling | |
|
|
| ## Original Model Details (v2) |
|
|
| - **Base model**: [Mistral 7B Instruct v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) |
| - **Method**: QLoRA (4-bit NF4 quantization + LoRA rank 32) |
| - **Target**: Cloudflare Workers AI `@cf/mistral/mistral-7b-instruct-v0.2-lora` |
| - **Adapter size**: 160 MB |
| - **Training data**: 586 complex security patches (version bumps filtered out) |
| - **Epochs**: 3 (110 steps), ~61 minutes on NVIDIA L4 |
|
|
| ### Training Metrics |
|
|
| | Metric | Start | End | |
| |--------|-------|-----| |
| | Loss | 1.166 | 0.867 | |
| | Token accuracy | 74.6% | 80.5% | |
| | Eval loss | — | 0.924 | |
| | Eval accuracy | — | 78.4% | |
|
|
| ## Changelog |
|
|
| - **v2** (2026-03-03): Retrained on filtered dataset — removed 763 version bump / hash-only examples. |
| - **v1** (2026-03-02): Initial training on 1,273 unfiltered examples. |
|
|
