Spaces:
Sleeping
Sleeping
Commit History
-
feat: add LLM-as-judge evaluator and benchmark runner
LLM-as-judge (llama-3.1-8b-instant) scores responses on 5 metrics: relevance, hallucination, coherence, completeness, and depth. Resumable benchmark runner evaluates 50 queries across both agents, saves results incrementally to JSON to handle rate-limit interruptions. Results: multi-agent achieves 6x lower hallucination (4% vs 24%) with comparable relevance (0.85 vs 0.877) across 50 domain-spanning queries.b5122b0