Tiny Aya SMS extraction: models
Collection
Lexsi hackathon T1-P5: LoRA + GGUF models β’ 10 items β’ Updated
How to use Meowniece/tiny-aya-sms-extract-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("CohereLabs/tiny-aya-global")
model = PeftModel.from_pretrained(base_model, "Meowniece/tiny-aya-sms-extract-lora")LoRA adapter for CohereLabs/tiny-aya-global trained with AlignTune on data curated with CuratorKIT and evaluated with AuditKIT.
Input: one SMS in English, Hindi or Hinglish. Output: one JSON object with 11 fields (see the dataset card).
| Split | Exact match | Field accuracy | Hallucination β | Non-txn F1 |
|---|---|---|---|---|
| test_id | 68.7 | 90.9 | 10.6 | 83.3 |
| test_ood | 76.7 | 94.0 | 1.4 | 95.5 |
| challenge | 59.1 | 87.3 | 12.1 | 78.6 |
Training path: aligntune Β· prompt format: chat Β· 1600 curated examples Β· LoRA r=16, Ξ±=32, lr=0.0002, 1 epoch(s).
Licence: the base model is CC-BY-NC (non-commercial). Commercial deployment needs a licence from Cohere. Data: fully synthetic; bank names are fictional; no real customer data.