Spaces:
Sleeping
Sleeping
Commit History
-
fix: set per_device_eval_batch_size=1 to prevent OOM during evaluation loop
26efb80 -
perf: increase batch size to 2 and enable group_by_length to massively speed up training
c38b6f2 -
fix: use accelerate launch for DDP training instead of naive multi-GPU to avoid DataParallel crashes
9638be2 -
fix: change device_map='auto' to local_process_index to prevent cross-GPU loss calculation error in transformers 4.46
b602c40 -
fix: set remove_unused_columns=True so Trainer drops 'messages' list before data collation
1bbece6 -
fix: change max_length to max_seq_length in SFTConfig for trl 0.12.1 compatibility
930fd33 -
fix: restore PyTorch compatibility by removing triton downgrade, rely on latest bitsandbytes
0139d8c -
fix: downgrade triton to 3.1.0 in Kaggle notebook to fix bitsandbytes CUDA errors
1735ce5 -
fix: upgrade bitsandbytes to >=0.45.0 to resolve Triton ModuleNotFoundError on Kaggle
1cbd61f -
feat: add Kaggle notebook for Phase 3 training
021f693 -
docs(plan): deterministic rewrite — pin Spider to minktn/spider-data + anti-spiral rules; Phase 2 max_length=2560 + length filter
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>d1cd1fa -
refactor: address Phase 2 review findings
- #3 add length filter: drop 82 train examples >2560 tok (verified) so their SQL labels aren't truncated; dev unaffected (0 dropped). MAX_LEN constant (DRY vs SFTConfig). - #4 DRY: load_dataset now uses train_file/val_file vars instead of hardcoded paths. - #1 document + guard the peft _torch_supports_distributed test workaround (hasattr-gated). - #5 fix stale comments (grad_accum 4->8; 'all linear layers' -> fused-projection rationale). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>e03c947 -
fix: LoRA adapts all 7 projections via Phi-3 fused names + guard assertion; r=16, Spider data, max_length=2560
5f0c197 -
feat: Spider data pipeline pinned to minktn/spider-data (per-example CREATE TABLE schema); drop find_spider.py
2ff9360 -
docs(plan): drop Phase 0 (repo reconciliation done via merge); point rollback at backup/pre-merge-1d8be28
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>1bd448a -
Merge remote-tracking branch 'origin/main'
# Conflicts: # .gitignore # Dockerfile # requirements-space.txt # requirements.txt # scripts/CONVERT_GGUF.md # scripts/merge_adapter.py # scripts/validate_gguf.py # src/inference.py # src/server.py25fa767 -
docs: condense writeup + add v2 implementation plan (Spider + fused-layer fix + CPU serving)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>670dcec
-
Complete CPU GGUF serving + docs + minimal UI redesign
Serving: - Serve fine-tuned Phi-3 as a 4-bit Q4_K_M GGUF via llama.cpp (source-built llama-cpp-python 0.3.19); cap n_threads to the container's vCPU count. - Dockerfile builds llama-cpp-python from source against glibc (prebuilt wheels are musl-only for phi3-capable versions) with single-threaded compile to avoid build OOM. Frontend: - Redesign the web UI as a flat, minimal layout (no gradients/glass/glow), with a project stats panel, schema row counts, and an on-page FAQ. - Remove the unreliable base-model comparison; single fine-tuned result with a wall-clock timer and an accurate CPU banner. Docs + eval: - Add fine-tuning + quantization + deployment blog and HF model cards (docs/). - Add the execution-accuracy eval harness (scripts/eval_execution_accuracy.py). - Update repo README to reflect GGUF/CPU serving. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>1d8be28 -
Redesign UI: flat minimal layout, no gradients/glass; add project stats panel and schema row counts
Verified signature61c1901 -
Rewrite CPU banner (T4 now paid; 5-8min load, 2-4min query) and add on-page FAQ
Verified signaturec935f9c -
Update Space README: GGUF/llama.cpp CPU serving, highlights, accurate timing
Verified signature9748758 -
Remove unreliable base-model comparison card; single fine-tuned result + wall-clock timer + accurate CPU banner
Verified signature9497393 -
Fix CPU thread oversubscription: cap n_threads to 2 (cpu-basic vCPUs) for faster generation
Verified signature4853f12 -
Fix build OOM (exit 137): CMAKE_BUILD_PARALLEL_LEVEL=1 (single-threaded compile)
Verified signaturebf1a6c4 -
Fix inference SIGSEGV: pin llama-cpp-python==0.3.19 (0.3.2 crashed on this GGUF); verified locally
Verified signature2ee2903 -
Build llama-cpp-python from source (glibc); prebuilt wheels are musl-only for phi3-capable versions
Verified signaturef438c10 -
Pin llama-cpp-python==0.3.19 + --only-binary (use prebuilt CPU wheel, no source build)
Verified signature2641362 -
Re-deploy llama.cpp + GGUF CPU serving (default Q4_K_M); fast CPU inference
Verified signaturee44cdab
-
Revert "Migrate CPU serving to llama.cpp + Q5_K_M GGUF (was bf16 transformers)"
This reverts commit 564ad28ca5effbb5f2390da477c1915c03fbc8ad.d031aeb -
Revert "Make torch/transformers/peft lazy imports so CPU Space boots without them"
This reverts commit eac26c792828354a0af21d78d763b0320eb0d2b2.2f03b0e -
Make torch/transformers/peft lazy imports so CPU Space boots without them
eac26c7 -
Migrate CPU serving to llama.cpp + Q5_K_M GGUF (was bf16 transformers)
564ad28 -
Fix bugs
a7bb6b3 -
Fix bugs
52e3716 -
Fix bugs
19cfcb8 -
Update CPU warning banner with accurate load and query times
e4ff54d -
Fix inference device bug, auto-load model, remove fine-tuning console, UI cleanup
f5ce94d -
Add README with HF Spaces config
6227517 -
initial deployment
55159b1