fix: resolve SIGSEGV and OpenMP deadlock for LightGBM + PyTorch coexistence
yash-b18
09fcfe1
- downloader.py: rewrite to use HfFileSystem streaming JSONL (datasets 4.x compat)
- user_features.py: fix .mode().iat[0] IndexError on empty Series
- deep.py: add weights_only=True to torch.load to prevent interactive hang in PyTorch 2.11
- serve_utils.py: lazy-import torch after LightGBM pickle load to prevent SIGSEGV;
call torch.set_num_threads(1) immediately after import to prevent OpenMP deadlock
when LightGBM and PyTorch share a process on Apple Silicon macOS
- app.py: fix personas endpoint to use rating column (not label); add detailed
model-loading logs to aid future debugging
- recommender.py: fix feat[item_idx] KeyError in classical recommendations;
fix nan title/category/brand display
feat: data pipeline — download, preprocess, split, and feature engineering
Sets up the complete project skeleton for the Explainable Multi-Stage
Recommendation System. Includes directory layout, central config module,
pipeline orchestrator, Makefile, report outline, and all package __init__
files. No model or data code yet — that comes in subsequent branches.
