Spaces:
Running
Running
Commit History
-
fix: sentence-aware chunking, score threshold, DOCX tables, streaming error handling, LLM_MODEL env var
Bhaskar Ram- embedder.py: replace character slicer with sentence-boundary-aware chunker (regex split on [.!?]+capital / paragraph breaks, sentence-level overlap) - retriever.py: add MIN_SCORE=0.30 cosine-similarity threshold to drop irrelevant chunks before they reach the LLM - document_loader.py: extend _load_docx() to extract table cell text (previously tables were silently skipped) - chain.py: split retry logic (connection phase only) from mid-stream error handling; partial responses now surfaced on stream interruption - chain.py + .env.example: LLM_MODEL now read from env var with Llama 3.1 8B as fallback (was hardcoded, env override was broken)2623b17
-
feat: apply all 15 upgrades — BGE embeddings, cosine FAISS, streaming LLM, tenacity retry, dotenv, Dockerfile, tests
Bhaskar Rama465955