Spaces:
Sleeping
Sleeping
Commit History
-
fix: set per_device_eval_batch_size=1 to prevent OOM during evaluation loop
26efb80 -
perf: increase batch size to 2 and enable group_by_length to massively speed up training
c38b6f2 -
fix: change device_map='auto' to local_process_index to prevent cross-GPU loss calculation error in transformers 4.46
b602c40 -
fix: set remove_unused_columns=True so Trainer drops 'messages' list before data collation
1bbece6 -
fix: change max_length to max_seq_length in SFTConfig for trl 0.12.1 compatibility
930fd33 -
refactor: address Phase 2 review findings
- #3 add length filter: drop 82 train examples >2560 tok (verified) so their SQL labels aren't truncated; dev unaffected (0 dropped). MAX_LEN constant (DRY vs SFTConfig). - #4 DRY: load_dataset now uses train_file/val_file vars instead of hardcoded paths. - #1 document + guard the peft _torch_supports_distributed test workaround (hasattr-gated). - #5 fix stale comments (grad_accum 4->8; 'all linear layers' -> fused-projection rationale). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>e03c947 -
fix: LoRA adapts all 7 projections via Phi-3 fused names + guard assertion; r=16, Spider data, max_length=2560
5f0c197
-
initial deployment
55159b1