Spaces:
Sleeping
Sleeping
Commit History
-
Major upgrade: 50-question benchmark, persistent analytics, paper-style TABLE II
Adityademo.py changes: - BENCHMARK_QUESTIONS now dynamically loads all 50 keys from reference_answers.json instead of a hardcoded 6-item list - Quick Questions grid fixed: 3-column layout (i % 3) prevents button overflow - compute_auto_metrics() extended with answer_relevance and faithfulness metrics - _estimate_cost() helper added for per-query USD cost estimation - run_benchmark() stores 7 metric groups per row (rouge, sim/accuracy, groundedness, answer_relevance, faithfulness, cost, latency) - benchmark_kpis() computes all 8 TABLE II metrics including hallucination rate and weighted overall score (1–5) - Analytics always visible: zero-KPI fallback renders charts and table even before first benchmark run; empty-state annotation shown on Plotly charts - Benchmark persistence: results saved to data/benchmark_cache.json after run and loaded from cache on every app startup — run once, display permanently - Analytics table expanded to TABLE II format with Best and Unit columns data/r…900c573
-
Major upgrade: auto-metrics, Plotly charts, Qwen2.5, PDF support, expanded KB
Aditya- Add ROUGE-L and semantic similarity auto-metrics per answer card - Add Plotly bar charts for aggregate quality/speed comparison in Analytics section - Upgrade fine-tuned model from TinyLlama to Qwen/Qwen2.5-1.5B-Instruct - Update Colab notebook with Qwen2.5 model and ChatML prompt format - Add PDF ingestion to RAG pipeline (drop PDFs into data/pdfs/) - Add 5 new knowledge base docs: big_o_notation, heaps, sql_basics, typescript_basics, git_basics - Add data/reference_answers.json with 21 Q&A pairs for automated scoring - Add HuggingFace Spaces frontmatter and deploy guide to README - Add plotly, rouge-score, pypdf, langchain-huggingface, numpy to requirementsa52cc98