parthasaradhi789/text2sql-sqlite-clean
Viewer โข Updated โข 10.3k โข 36
How to use parthasaradhi789/text2sql-qwen2.5-coder-1.5b-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "parthasaradhi789/text2sql-qwen2.5-coder-1.5b-lora")QLoRA adapter (r=16, alpha=32, all linear layers) trained for 1 epoch on parthasaradhi789/text2sql-sqlite-clean.
Quick check on 300 validation questions from unseen domains (execution accuracy, notebook
batched greedy decoding): base 57.0% -> fine-tuned 69.3%.
Final numbers come from the evaluation harness in the code repository (https://github.com/wittyparth/text2sql-specialist).
Git commit used for training: 1d71449. Training run: https://wandb.ai/parthasaradhimunakala-parthasaradhi-site/text2sql-specialist/runs/379av0n3
Base model
Qwen/Qwen2.5-1.5B