Spaces:
Runtime error
Runtime error
Commit History
-
Update embedding model to Google Generative AI and enhance vector store functionality
- Changed the embedding model from OpenAI to Google Generative AI in the EmbeddingManager class. - Updated the configuration to reflect the new embedding model path. - Modified validation checks to ensure the presence of the Google API key for RAG embeddings. - Added a new method to reset the vector store, allowing for a complete clear and recreation of the collection. - Enhanced logging to provide clearer feedback on embedding model initialization and vector store operations.4dfec96
-
Integrate Gemini API for enhanced image processing in MarkItDown
- Updated `app.py` to reflect the use of Gemini for image processing in MarkItDown. - Modified `requirements.txt` to include `ffmpeg-python` for audio processing and removed OpenAI dependency. - Enhanced `setup.sh` to install Gemini dependencies and updated installation instructions. - Introduced `gemini_client_wrapper.py` to create a wrapper for Gemini API, mimicking OpenAI's interface for compatibility with MarkItDown. - Added tests in `test_gemini_wrapper.py` to validate Gemini integration and MarkItDown functionality. - Refactored `markitdown_parser.py` to utilize Gemini for image files while maintaining standard processing for other formats. - Updated parser names and descriptions for clarity across various parsers.033e4ba
-
Implement multi-document processing capabilities and enhance UI
- Introduced support for processing up to 5 files simultaneously with a combined size limit of 20MB. - Added new processing types: Combined, Individual, Summary, and Comparison for enhanced document analysis. - Updated the Gemini Flash parser to handle multiple documents and format outputs based on processing type. - Enhanced the UI to dynamically display processing options and real-time validation for file uploads. - Unified document conversion method to streamline single and multi-file processing. - Improved error handling and logging for batch processing operations.111954a
-
Update .gitignore and enhance README with data management instructions
- Added log files to .gitignore to prevent unnecessary tracking. - Expanded README to include new commands for clearing data and running the application with fresh data. - Clarified what data gets cleared during testing, improving usability for developers.a4f1c9e
-
Enhance RAG (Retrieval-Augmented Generation) functionality and dependencies
- Added RAG configuration management and integrated support for LangChain, ChromaDB, and sentence-transformers. - Implemented document ingestion, chunking, and embedding management for RAG capabilities. - Updated application to check and install necessary RAG dependencies automatically. - Enhanced README to include RAG features and usage instructions. - Refactored environment checks to ensure RAG dependencies are available. - Improved UI to support document conversion and chat functionalities with RAG integration. - Updated requirements.txt to include new RAG-related packages.575f1c7 -
Add Docling support for advanced document processing
- Integrated Docling library for enhanced PDF understanding and table structure recognition. - Updated application to check for Docling installation and install it if missing. - Enhanced README with usage instructions for Docling alongside MarkItDown. - Added Docling configuration options and parser implementation. - Updated requirements.txt to include Docling as a dependency. - Refactored environment checks and logging for better error handling related to Docling. - Introduced a new Docling parser for document conversion to Markdown.c0c51c2
-
Refactor and enhance application structure for Markit_v2
- Introduced centralized configuration management for API keys and application settings. - Implemented a new environment manager for dependency checks and setup. - Refactored document processing into a dedicated service layer for improved organization. - Enhanced error handling with custom exceptions for better clarity. - Updated README with new configuration options and usage instructions. - Added lightweight launcher for local development. - Improved logging setup for better debugging and information tracking. - Updated .gitignore to include new files and directories. This commit lays the groundwork for a more modular and maintainable codebase, facilitating future feature additions and improvements.a773878
-
Approach #2 -- converting latex output from GOT OCR to markdown
5b7f920 -
restore to version 1
23ad33e -
Latex2Markdown display changes --attemtp1
33f1b65
-
remove docling and pypdfium because of independencies
b3a5734 -
Implement Markit_GOT files into Markit_v2
dda982a