Spaces:
Sleeping
Sleeping
Commit History
-
Prepare for Hugging Face Spaces deployment
Aditya- Add HF Space YAML frontmatter to README.md (Streamlit SDK) - Update demo.py: check checkpoint-25/ (committed) instead of finetuned_model/ (gitignored) so Fine-Tuned works on HF Spaces - Update spinner message for first-run base model download868a905
-
Major upgrade: 50-question benchmark, persistent analytics, paper-style TABLE II
Adityademo.py changes: - BENCHMARK_QUESTIONS now dynamically loads all 50 keys from reference_answers.json instead of a hardcoded 6-item list - Quick Questions grid fixed: 3-column layout (i % 3) prevents button overflow - compute_auto_metrics() extended with answer_relevance and faithfulness metrics - _estimate_cost() helper added for per-query USD cost estimation - run_benchmark() stores 7 metric groups per row (rouge, sim/accuracy, groundedness, answer_relevance, faithfulness, cost, latency) - benchmark_kpis() computes all 8 TABLE II metrics including hallucination rate and weighted overall score (1–5) - Analytics always visible: zero-KPI fallback renders charts and table even before first benchmark run; empty-state annotation shown on Plotly charts - Benchmark persistence: results saved to data/benchmark_cache.json after run and loaded from cache on every app startup — run once, display permanently - Analytics table expanded to TABLE II format with Best and Unit columns data/r…900c573
-
Fix card rendering: safe_answer(), benchmark accuracy key, and badge blank-line bug
Aditya- Replace html_lib.escape() with safe_answer() which also converts \n to <br>, preventing Streamlit's markdown parser from exiting the HTML block mid-card - Fix _header_badge() returning "" (empty string) causing a whitespace-only line that terminated the HTML block — now returns <span></span> as a safe placeholder - Fix run_benchmark() using wrong key 'sem_sim' instead of 'accuracy', causing all benchmark accuracy scores to show as 0% - Install rouge-score package for ROUGE-L metric computation - Remove stale rating_submitted session state reference2215d95
-
Major upgrade: auto-metrics, Plotly charts, Qwen2.5, PDF support, expanded KB
Aditya- Add ROUGE-L and semantic similarity auto-metrics per answer card - Add Plotly bar charts for aggregate quality/speed comparison in Analytics section - Upgrade fine-tuned model from TinyLlama to Qwen/Qwen2.5-1.5B-Instruct - Update Colab notebook with Qwen2.5 model and ChatML prompt format - Add PDF ingestion to RAG pipeline (drop PDFs into data/pdfs/) - Add 5 new knowledge base docs: big_o_notation, heaps, sql_basics, typescript_basics, git_basics - Add data/reference_answers.json with 21 Q&A pairs for automated scoring - Add HuggingFace Spaces frontmatter and deploy guide to README - Add plotly, rouge-score, pypdf, langchain-huggingface, numpy to requirementsa52cc98
-
Improve UI: animated 3D background, spinning logo, and interactive quick questions
Aditya- Add canvas-based 3D particle network background via components.html - Add spinning conic-gradient ring logo with float + glow animation - Add hero title shimmer animation and animated gradient background orbs - Fix quick question buttons to persist via session state and auto-trigger all 3 systems - Restyle answer cards with icon headers, time chips, and per-system color themes - Style buttons as pill chips, improve text input, hide Streamlit chromee2b3faf -
Add LLM vs RAG vs Fine-Tuning comparison project
Aditya4a3f117