Spaces:
Build error
Build error
Commit History
-
docs: bring the fix log up to date with the follow-on fixes
Shubham Pawar +1: Claude Sonnet 5Groq model config, streaming BYOK, query error mapping, Redis-scheme guard, the Streamlit source-panel fix, and the CI (ruff + promptfoo) changes. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XbYxD9aoni29EHJ3xcUd2qbfd111c -
fix: make ingestion and querying robust; add acceptance-test corpus
Shubham Pawar +1: Claude Sonnet 5Issues found while building an end-to-end test corpus and running it against the live API (see docs/fixes/2026-09-05-ingestion-and-event-loop-blocking.md): Ingestion - Markdown ingest returned HTTP 500 in offline / strict-TLS environments: UnstructuredMarkdownLoader downloads a spaCy model at runtime. Switched .md/.markdown to TextLoader (markdown is chunked as plain text anyway). - A single ingest/query froze the whole worker: async handlers ran the synchronous load->chunk->embed->store / retrieve->LLM work on the event loop. Moved it to run_in_threadpool; stream() driven via iterate_in_threadpool. /health now stays ~1ms responsive during a 5.5s ingest (was blocked ~4.75s). - /api/ingest had no upload limits. Added MAX_UPLOAD_FILES / MAX_FILE_SIZE_MB / MAX_TOTAL_UPLOAD_MB, enforced before any work, returning HTTP 413. - Embedding model now warmed in the lifespan startup hook instead of stalling the first request. Querying - Groq model llama-3.3-70b-versatile is decom…c8f7f2e
-
docs: add architecture diagram and rewrite README
- Added architecture diagram to docs/ - Updated README with multi-provider BYOK features - Added system architecture section with diagram - Updated tech stack, quick start, and project structure - Added BYOK explanation and roadmap sections353a687
-
fix: update tests to match actual implementation
- Fix test_loaders.py to use MultiFormatDocumentLoader - Fix test_pipeline.py to remove non-existent has_results property - Add TESTING_ROADMAP.md documentation - All 62 unit tests now passa9cc6d5 -
docs: add comprehensive HF Spaces deployment guide
- Add docs/deployment/DEPLOYMENT.md with step-by-step instructions - Document secrets configuration for HF Spaces - Include troubleshooting and local testing instructions - Reference existing Dockerfile, start.sh, and deploy.yml5a5df35 -
feat: add async/batch processing utilities
- Add AsyncBatchProcessor with concurrency control - Add AsyncDocumentProcessor for document pipelines - Add RateLimiter (token bucket algorithm) - Add AsyncRetry decorator with exponential backoff - Add gather_with_concurrency helper - Add run_async sync-async bridge - Add comprehensive unit tests (16 tests, all passing) - Add documentation in docs/explanations/phase5/dcb67f2 -
feat: add query caching with in-memory and Redis backends
- Add CacheEntry dataclass with TTL support - Add InMemoryCache with LRU eviction - Add RedisCache for distributed deployments - Add QueryCache with get_or_compute pattern - Add create_cache factory function - Add comprehensive unit tests (all passing) - Add documentation in docs/explanations/phase5/7dd3c91
-
feat: add cross-encoder and LLM reranking
98e014c
-
feat: configure HF Spaces deployment
91ab187 -
feat: add Promptfoo evaluation framework
- Add promptfooconfig.yaml with test cases - Add golden_tests.yaml with expected Q&A - Add runner.py Python wrapper - Add evaluation documentationd9d0a60
-
feat: integrate Langfuse observability
- Add LangfuseTracer class with span/generation support - Add LangChain callback handler integration - Add create_traced_chain for automatic tracing - Update RAG pipeline with conditional tracing895d205 -
feat: add Streamlit frontend with chat interface
- Add main chat app with st.chat_input - Add file upload with multi-format support - Add source attribution with expandable panel - Add modern gradient styling - Add Streamlit theme configuration00d5502 -
feat: add streaming responses and error handling
- Add ErrorHandlerMiddleware for global error catching - Add RequestLoggingMiddleware for request timing - Add RateLimitMiddleware for abuse prevention - Update /api/query/stream with SSE format350b79e -
feat: implement FastAPI application structure
- Add main FastAPI app with CORS and lifespan - Add Pydantic models for all endpoints - Add health check endpoints - Add /api/query with streaming support - Add /api/ingest with file upload - Update settings with API configurationb6fa51d
-
feat: add end-to-end testing scripts
- Add comprehensive test_e2e.py test suite - Add interactive demo.py script - Add testing documentation7640b67 -
feat: implement basic retrieval pipeline
- Add RetrievalResult dataclass with context extraction - Add Retriever class with score filtering - Add RetrieverFactory for easy setup - Add create_retriever convenience function - Update package exportsca03d00
-
feat: integrate HuggingFace embeddings
- Add EmbeddingsManager class with lazy loading - Add 4 pre-configured embedding models - Add get_embeddings convenience function - Add list_available_models helper - Update package exportsdeb2f2c
-
feat: implement ChromaDB vector store
- Add VectorStore class with persistant storage - Add similarity search with/without scores - Add batch document processing - Add retriever integration for LangChain - Update package exports1ac24a4