Spaces:
Build error
Build error
Commit History
-
fix: make ingestion and querying robust; add acceptance-test corpus
Shubham Pawar +1: Claude Sonnet 5Issues found while building an end-to-end test corpus and running it against the live API (see docs/fixes/2026-09-05-ingestion-and-event-loop-blocking.md): Ingestion - Markdown ingest returned HTTP 500 in offline / strict-TLS environments: UnstructuredMarkdownLoader downloads a spaCy model at runtime. Switched .md/.markdown to TextLoader (markdown is chunked as plain text anyway). - A single ingest/query froze the whole worker: async handlers ran the synchronous load->chunk->embed->store / retrieve->LLM work on the event loop. Moved it to run_in_threadpool; stream() driven via iterate_in_threadpool. /health now stays ~1ms responsive during a 5.5s ingest (was blocked ~4.75s). - /api/ingest had no upload limits. Added MAX_UPLOAD_FILES / MAX_FILE_SIZE_MB / MAX_TOTAL_UPLOAD_MB, enforced before any work, returning HTTP 413. - Embedding model now warmed in the lifespan startup hook instead of stalling the first request. Querying - Groq model llama-3.3-70b-versatile is decom…c8f7f2e
-
feat: add multi-provider LLM support (Gemini, OpenAI, Claude, Groq)
- Added provider selection cards on login page with tier badges - Dynamic Get Key links for each provider - Updated pipeline to support multiple LLM providers - Added langchain-openai, langchain-anthropic, langchain-groq deps - Updated API models and routes for provider parametera226579
-
feat: add BYOK (Bring Your Own Key) support
- Added api_key field to QueryRequest model - Updated query endpoint to pass user key to pipeline - Added _build_chain_with_key() for dynamic LLM creation - Added API key input field in sidebar with password mask - Users can now use their own Gemini API keyef93124
-
fix: update ingest for logging
8842b64 -
fix: update ingest.py
d810146 -
fix: update ingest.py
bcdaff2 -
fix: update ingest.py
4915931 -
fix: remove unecessary imports
65607a5
-
fix: improve markdown file ingestion handling
- Fix MIME type detection for .md files in frontend upload - Add explicit MIME type mapping for markdown files - Add .markdown extension to API supported file typese1dbbef
-
feat: add streaming responses and error handling
- Add ErrorHandlerMiddleware for global error catching - Add RequestLoggingMiddleware for request timing - Add RateLimitMiddleware for abuse prevention - Update /api/query/stream with SSE format350b79e -
feat: implement FastAPI application structure
- Add main FastAPI app with CORS and lifespan - Add Pydantic models for all endpoints - Add health check endpoints - Add /api/query with streaming support - Add /api/ingest with file upload - Update settings with API configurationb6fa51d
-
feat: initial project setup and structure
- Created project directory structure (src/, api/, rag/, llmops/, frontend/, evals/, tests/, config/, docs/) - Added README.md with project overview and quick start guide - Added .gitignore for Python, IDE, and environment files - Added .env.example with configuration template - Added requirements.txt with 2025-updated dependencies - Added LICENSE (MIT) - Added Python package __init__.py files - Added config/settings.py with Pydantic-based configurationa5f90d1