Spaces:
Runtime error
Runtime error
Commit History
-
Refactor document ingestion and chunking to support LaTeX content
- Updated `DocumentIngestionService` to generalize content ingestion, allowing both Markdown and LaTeX formats. - Introduced `LaTeXAwareChunker` for chunking LaTeX documents while preserving structures. - Enhanced `UnifiedDocumentChunker` to handle both Markdown and LaTeX content types seamlessly. - Modified `_process_latex_content` to return raw LaTeX for GOT-OCR without LLM conversion. - Improved UI rendering for LaTeX content, ensuring proper display using MathJax. - Added backward compatibility for existing Markdown ingestion methods.63279a9
-
Implement multi-document processing capabilities and enhance UI
- Introduced support for processing up to 5 files simultaneously with a combined size limit of 20MB. - Added new processing types: Combined, Individual, Summary, and Comparison for enhanced document analysis. - Updated the Gemini Flash parser to handle multiple documents and format outputs based on processing type. - Enhanced the UI to dynamically display processing options and real-time validation for file uploads. - Unified document conversion method to streamline single and multi-file processing. - Improved error handling and logging for batch processing operations.111954a
-
Add data clearing service and vector store management
- Introduced `DataClearingService` for managing the clearing of vector store and chat history data. - Implemented `clear_all_documents` method in `VectorStoreManager` to remove all documents from the vector store. - Enhanced UI with a button to clear all data, integrating the new service for user interaction. - Updated logging to provide detailed feedback during data clearing operations.f46dfbd -
Refactor document ingestion and output file handling
- Updated `create_document_hash` to `create_file_hash` for full SHA-256 hashing. - Introduced duplicate checking and deletion methods in `DocumentIngestionService`. - Enhanced `ingest_markdown_content` to utilize original file content for deduplication. - Modified `_create_output_file` to preserve original filename and handle conflicts. - Improved logging for document processing and ingestion status.3f1b4af
-
Refactor and enhance application structure for Markit_v2
- Introduced centralized configuration management for API keys and application settings. - Implemented a new environment manager for dependency checks and setup. - Refactored document processing into a dedicated service layer for improved organization. - Enhanced error handling with custom exceptions for better clarity. - Updated README with new configuration options and usage instructions. - Added lightweight launcher for local development. - Improved logging setup for better debugging and information tracking. - Updated .gitignore to include new files and directories. This commit lays the groundwork for a more modular and maintainable codebase, facilitating future feature additions and improvements.a773878
-
Removing chat with document feature
bdc060b -
restore
66f3c4d -
Remove chat with document feature, updated ui, remove ocrmac, pinned transformer version to 4.37 for GOT OCR
e66626c -
Implement Markit_GOT files into Markit_v2
dda982a