Spaces:
Running
Running
Commit History
-
Add DuckDB shadow-read backend with source-metadata fix
Jenny Chim +1: Claude Opus 4.7 (1M context)Two-part change behind a feature flag. Backend dispatcher (lib/data-backend.ts) routes 11 API routes + app/page.tsx to either lib/model-data.ts (default JSON path) or the new lib/duckdb-data.ts based on DATA_BACKEND=duckdb. The DuckDB path reads payload_json from local Parquet via @duckdb/node-api; pipeline-side export is gated by EXPORT_EXPERIMENTAL_PARQUET=1 (lives in eval_cards_backend_pipeline). For parity testing, lib/hf-data.ts gains HF_DATA_LOCAL_DIR (override the default .cache/hf-data path) and HF_DATA_OFFLINE=1 (refuse remote fetches so background refreshes can't poison parity tests). scripts/compare-data-backends.mjs diffs the two backends endpoint-by-endpoint. Source-metadata fallback (item #4 in notes/ts-to-pipeline-migration.md) deleted: pipeline now carries source_metadata on every model_result row (verified 86,183/86,183 production hierarchy + 43,859/43,859 eval-detail). Removed getCanonicalSourceMetadata, buildSourceMetadataIndex, and three inline duplicates in lib/…2fcae3f
-
feat: refine model and benchmark exploration
03e2430
