Fetching metadata from the HF Docker repository...
-
feat: Stage 8 β eval dashboard, mandatory web search, docs updateβ
benroshan +1: Claude Sonnet 4.6 - eval-dashboard/: standalone Vite+React static site (own Vercel project)
MetricCard, EvolutionChart (Recharts), RunTable, LatencyStats
reads versioned JSON runs from public/data/runs/ + index.json
- scripts/run_eval_versioned.py: offline eval script
metrics: answer_correctness, answer_relevancy, context_recall, precision@5, latency p50/p95/p99
writes versioned JSON + updates index.json
- data/ground_truth/eval_pairs.json: expanded 20 β 50 pairs
added multi-hop, comparative, negative, numeric, edge-case questions
- frontend: removed per-message faithfulness badge (MessageBubble.jsx)
removed web search toggle β hardcoded always-on (ChatArea.jsx)
- server/routes/chat.py: removed score_faithfulness() call; web_search default True
- docs: architecture, decisions, api-spec, evolution, structure updated for Stage 8
- .env.example: updated comments; LangSmith listed as optional
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
-
chore: run full RAGAS eval β all 4 metrics now populatedβ
benroshan +1: Claude Sonnet 4.6 - eval_pairs.json: add ground_truth to all 20 pairs (unlocks context metrics)
- ragas_benchmark.json: faithfulness=1.0, answer_relevancy=0.88, context_precision=1.0, context_recall=0.83
- run_ragas_local.py: add --full flag for context metrics, --eval-model arg, dynamic metric list
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
-
Add Dockerfile and Render config