Financial-v1-2B

A fine-tuned version of unsloth/Qwen3.5-2B trained on PersonalFinance Extended data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.

The base model was adapted to follow the style and content of the PersonalFinance Extended dataset. Expect improved performance on tasks similar to those represented in the training data.

Model Details

Property Value
Base model unsloth/Qwen3.5-2B
Training data data/PersonalFinance-Extended.json
Fine-tuning epochs 1
Fine-tuning date 2026-07-26
Fine-tuning method LoRA (merged to full 16-bit)

Training Hyperparameters

LoRA

Parameter Value
r 64
alpha 128
dropout 0.02
target_modules ['q_proj', 'v_proj']

Training

Parameter Value
learning_rate 1e-05
batch_size 1
gradient_accumulation_steps 8
warmup_ratio 0.1
max_seq_length 512
quantization none

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model     = AutoModelForCausalLM.from_pretrained("theprint/Financial-v1-2B")
tokenizer = AutoTokenizer.from_pretrained("theprint/Financial-v1-2B")

Generated by Auto-SFT

Downloads last month
52
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for theprint/Financial-v1-2B

Finetuned
Qwen/Qwen3.5-2B
Adapter
(51)
this model
Adapters
2 models