Spaces:
Sleeping
Sleeping
Commit History
-
Remove histogram_utils shim; update all imports to metrics/model_registry
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>e750974
-
feat: add eval metrics pipeline (perplexity, paper reference, dashboard overlay)
- compute_perplexity.py: sliding-window eval on WikiText-103 or Pile subset, configurable via --corpus/--pile-tokens; uses eval_loop + NLLCollector pattern designed for future data-weighted statistics (dressed operators <W_QK>_{data}) - extract_paper_loss.py: fetch HF model-card benchmarks and compare vs reference - paper_reference_loss.csv: reference loss values from literature for validation - load_eval_metrics() in dashboard_utils.py: graceful parquet loader - step_evolution.py: optional secondary-axis overlay of eval metrics vs step Output schema: model, revision, step, metric, value, source, corpus 43 tests passing. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>17def50