File size: 1,944 Bytes
0e75a71 6d5952c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 | ---
license: apache-2.0
language:
- es
library_name: peft
base_model: unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit
pipeline_tag: text-generation
tags:
- lora
- qlora
- sft
- trl
- unsloth
- address-parsing
- costa-rica
- qwen3
---
# tac-1-lora — QLoRA adapter for tac-1
## Overview
This is the QLoRA adapter that produced [`CodeStrux-Tech/tac-1`](https://huggingface.co/CodeStrux-Tech/tac-1). **Most users want the merged tac-1 repo**, not these adapter weights. Use this repo only if you need to inspect or extend the adapter directly.
## Loading with PEFT
PEFT loading requires the base model `unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit`.
## Training configuration
- **Base model:** Qwen/Qwen3-4B-Instruct-2507
- **Method:** QLoRA (r=16, α=32)
- **Learning rate:** 2e-4
- **Epochs:** 2
- **Max sequence length:** 4096
- **Steps:** 692
- **Final train loss:** 0.043
- **Hardware:** ~2 h 50 m on an RTX 4080 16 GB
- **Stack:** unsloth 2025.11.1 / transformers 4.57.2 / trl 0.23.0
## Training data
The adapter was trained on the tac-1 corpus: 5,532 examples (seed 0), 805 heldout (seed 1); `--max-legs 4`; 22 districts ingested, 19,042 POIs, 11 griddable; holdout districts grecia, curridabat, go-guadalupe excluded from training. See [`CodeStrux-Tech/tac-1-corpus`](https://huggingface.co/CodeStrux-Tech/tac-1-corpus).
### Training data attribution
Contains information from OpenStreetMap (https://www.openstreetmap.org/copyright), which is made available under the Open Database License (ODbL) 1.0. © OpenStreetMap contributors.
For full architecture, evaluation, and limitations, see [`CodeStrux-Tech/tac-1`](https://huggingface.co/CodeStrux-Tech/tac-1).
tac-1 is a derivative work of [Qwen/Qwen3-4B-Instruct-2507](https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507), Copyright 2024 Alibaba Cloud, licensed under the Apache License, Version 2.0. The upstream LICENSE is included in this repository.
|