LCA-ChatBot-Streamlit / evaluation

Commit History

tracked progres report and data folder also and added correct evaluation results, Add graph-seeded multi-hop QA generator and --qa-file eval; document in README
784726a

sshobhit1106 commited on

Add 3-way eval (no-RAG/RAG/RAG+graph) with per-call graph toggle and --sample flag
e068f04

sshobhit1106 commited on

Add --sample flag for random-subset eval and document GraphRAG in README
a19266e

sshobhit1106 commited on

added knowledge graphs and fix: correct BERTScore unpacking to use recall not precision (bert_score returns P,R,F1); relabel stale precision values in eval_results.json
5568c1a

sshobhit1106 commited on

Added a --merge flag to run_eval that re-scores a model's cached predictions across all books into one row (named by book, no LLM calls), erroring if the model hasn't fully evaluated every QA-bearing book — and documented it in the README.
00c67fa

sshobhit1106 commited on

Consolidated all per-(book,model) eval files into one eval_predictions.jsonl and one eval_results.json (tagged internally by model/provider/book), migrated existing data in, and updated the readme
f567878

sshobhit1106 commited on

switched BERTScore/ROUGE-L to recall (paper Eq. 4/7), updated the README, and back-filled the hauschild tag onto 250 untagged QA pairs (backup at qa_pairs.jsonl.bak).
2eee1e9

sshobhit1106 commited on

Add --books flag to generate_qa for restricting QA generation to specific book ids
2fcc236

sshobhit1106 commited on

updated comments for evaluation
b3065e9

sshobhit1106 commited on

Multi-book RAG support: config.BOOKS registry ingesting multiple PDFs into one Chroma collection with book-aware citations, robust chapter tagging for TOC-less/junk-TOC PDFs, an incremental --add flag to index a new PDF without a full re-embed, and updated README (multi-book docs + Limitations).
bd22721

sshobhit1106 commited on

improved code to remove balanced generation from each pair and replaced with random choosing chunks from the whole book and generating qa pairs from those chunk with parameter --pairs-per-chunk and --num-chunks
9aec7b1

sshobhit1106 commited on

improved code to add more qa pairs on generation instead of replacing old one
4f3bce8

sshobhit1106 commited on

improved comments - 1 generate_qa.py
03efdbe

sshobhit1106 commited on

added comment for each code files for better understanding
5957e3b

sshobhit1106 commited on

completed evaluation by generating 240 QA pairs
4804517

sshobhit1106 commited on

completed evaluation by generating 5 QA pairs
0e8be16

sshobhit1106 commited on

added basic plan made by claude
7e6947e

sshobhit1106 commited on