Commit History

  1. fix: set per_device_eval_batch_size=1 to prevent OOM during evaluation loop

    26efb80
  2. perf: increase batch size to 2 and enable group_by_length to massively speed up training

    c38b6f2
  3. fix: use accelerate launch for DDP training instead of naive multi-GPU to avoid DataParallel crashes

    9638be2
  4. fix: change device_map='auto' to local_process_index to prevent cross-GPU loss calculation error in transformers 4.46

    b602c40
  5. fix: set remove_unused_columns=True so Trainer drops 'messages' list before data collation

    1bbece6
  6. fix: change max_length to max_seq_length in SFTConfig for trl 0.12.1 compatibility

    930fd33
  7. fix: restore PyTorch compatibility by removing triton downgrade, rely on latest bitsandbytes

    0139d8c
  8. fix: downgrade triton to 3.1.0 in Kaggle notebook to fix bitsandbytes CUDA errors

    1735ce5
  9. fix: upgrade bitsandbytes to >=0.45.0 to resolve Triton ModuleNotFoundError on Kaggle

    1cbd61f
  10. feat: add Kaggle notebook for Phase 3 training

    021f693
  11. docs(plan): deterministic rewrite — pin Spider to minktn/spider-data + anti-spiral rules; Phase 2 max_length=2560 + length filter⁠

    Bhuvandesai +1: Claude Opus 4.8
    d1cd1fa
  12. refactor: address Phase 2 review findings⁠

    Bhuvandesai +1: Claude Opus 4.8
    e03c947
  13. fix: LoRA adapts all 7 projections via Phi-3 fused names + guard assertion; r=16, Spider data, max_length=2560

    5f0c197
  14. feat: Spider data pipeline pinned to minktn/spider-data (per-example CREATE TABLE schema); drop find_spider.py

    2ff9360
  15. docs(plan): drop Phase 0 (repo reconciliation done via merge); point rollback at backup/pre-merge-1d8be28⁠

    Bhuvandesai +1: Claude Opus 4.8
    1bd448a
  16. Merge remote-tracking branch 'origin/main'⁠

    25fa767
  17. docs: condense writeup + add v2 implementation plan (Spider + fused-layer fix + CPU serving)⁠

    Bhuvandesai +1: Claude Opus 4.8
    670dcec

  1. Complete CPU GGUF serving + docs + minimal UI redesign⁠

    Bhuvandesai +1: Claude Opus 4.8
    1d8be28
  2. Redesign UI: flat minimal layout, no gradients/glass; add project stats panel and schema row counts

    Verified signature
    61c1901
  3. Rewrite CPU banner (T4 now paid; 5-8min load, 2-4min query) and add on-page FAQ

    Verified signature
    c935f9c
  4. Update Space README: GGUF/llama.cpp CPU serving, highlights, accurate timing

    Verified signature
    9748758
  5. Remove unreliable base-model comparison card; single fine-tuned result + wall-clock timer + accurate CPU banner

    Verified signature
    9497393
  6. Fix CPU thread oversubscription: cap n_threads to 2 (cpu-basic vCPUs) for faster generation

    Verified signature
    4853f12
  7. Fix build OOM (exit 137): CMAKE_BUILD_PARALLEL_LEVEL=1 (single-threaded compile)

    Verified signature
    bf1a6c4
  8. Fix inference SIGSEGV: pin llama-cpp-python==0.3.19 (0.3.2 crashed on this GGUF); verified locally

    Verified signature
    2ee2903
  9. Build llama-cpp-python from source (glibc); prebuilt wheels are musl-only for phi3-capable versions

    Verified signature
    f438c10
  10. Pin llama-cpp-python==0.3.19 + --only-binary (use prebuilt CPU wheel, no source build)

    Verified signature
    2641362
  11. Re-deploy llama.cpp + GGUF CPU serving (default Q4_K_M); fast CPU inference

    Verified signature
    e44cdab

  1. Revert "Migrate CPU serving to llama.cpp + Q5_K_M GGUF (was bf16 transformers)"⁠

    d031aeb
  2. Revert "Make torch/transformers/peft lazy imports so CPU Space boots without them"⁠

    2f03b0e
  3. Make torch/transformers/peft lazy imports so CPU Space boots without them

    eac26c7
  4. Migrate CPU serving to llama.cpp + Q5_K_M GGUF (was bf16 transformers)

    564ad28
  5. Fix bugs

    a7bb6b3
  6. Fix bugs

    52e3716
  7. Fix bugs

    19cfcb8
  8. Update CPU warning banner with accurate load and query times

    e4ff54d
  9. Fix inference device bug, auto-load model, remove fine-tuning console, UI cleanup

    f5ce94d
  10. Add README with HF Spaces config

    6227517
  11. initial deployment

    55159b1