Spaces:
Runtime error
Runtime error
Commit History
-
Integrate Gemini API for enhanced image processing in MarkItDown
- Updated `app.py` to reflect the use of Gemini for image processing in MarkItDown. - Modified `requirements.txt` to include `ffmpeg-python` for audio processing and removed OpenAI dependency. - Enhanced `setup.sh` to install Gemini dependencies and updated installation instructions. - Introduced `gemini_client_wrapper.py` to create a wrapper for Gemini API, mimicking OpenAI's interface for compatibility with MarkItDown. - Added tests in `test_gemini_wrapper.py` to validate Gemini integration and MarkItDown functionality. - Refactored `markitdown_parser.py` to utilize Gemini for image files while maintaining standard processing for other formats. - Updated parser names and descriptions for clarity across various parsers.033e4ba
-
Add advanced retrieval strategies and update dependencies for RAG implementation
- Introduced BM25Retriever and EnsembleRetriever for enhanced document retrieval methods. - Updated `app.py`, `requirements.txt`, and `setup.sh` to include new dependencies for BM25 and community retrievers. - Enhanced `RAGChatService` to support multiple retrieval methods: similarity, MMR, BM25, and hybrid. - Updated README to document new retrieval strategies and configuration options. - Added comprehensive tests for retrieval methods and implementation structure.21c909d
-
Enhance RAG (Retrieval-Augmented Generation) functionality and dependencies
- Added RAG configuration management and integrated support for LangChain, ChromaDB, and sentence-transformers. - Implemented document ingestion, chunking, and embedding management for RAG capabilities. - Updated application to check and install necessary RAG dependencies automatically. - Enhanced README to include RAG features and usage instructions. - Refactored environment checks to ensure RAG dependencies are available. - Improved UI to support document conversion and chat functionalities with RAG integration. - Updated requirements.txt to include new RAG-related packages.575f1c7 -
Add Docling support for advanced document processing
- Integrated Docling library for enhanced PDF understanding and table structure recognition. - Updated application to check for Docling installation and install it if missing. - Enhanced README with usage instructions for Docling alongside MarkItDown. - Added Docling configuration options and parser implementation. - Updated requirements.txt to include Docling as a dependency. - Refactored environment checks and logging for better error handling related to Docling. - Introduced a new Docling parser for document conversion to Markdown.c0c51c2
-
Initial Implementation of Markitdown. Implemented:
- Basic python usage - Image integration using OpenAI - Plugin disabled by defaultdbdd7c8
-
Approach #2 -- converting latex output from GOT OCR to markdown
5b7f920 -
restore to version 1
23ad33e -
Latex2Markdown display changes --attemtp1
33f1b65 -
Please work
4fab3b3 -
handling zerogpu usage
610b772
-
changes on logging for better debugging
5bb2b30 -
change in strategy --implementing github got ocr instead of hugging face model
0f5865d -
Error: Error processing document with GOT-OCR (ZeroGPU): Numpy is not available
6372663 -
Error: Error processing document with GOT-OCR (ZeroGPU): Numpy is not available
8efc942
-
Error: Error processing document with GOT-OCR (ZeroGPU): Numpy is not available
87e9b54 -
Error: Error processing document with GOT-OCR (ZeroGPU): Numpy is not available
4523ddf -
Error: Error processing document with GOT-OCR (ZeroGPU): Numpy is not available
17cb3f3 -
adding zerogpufor got ocr
66d2b1b -
major clean up in unused libraries in requirements
f7427de -
Independencies: The user requested safetensors==0.4.1
transformers 4.37.2 depends on safetensors>=0.4.19ddb112 -
solving version independencies
7869899 -
removing marker attempt 2
e5140fc -
reviving google gemini parser issue
baf5fd5 -
restore
66f3c4d -
resolving compatiability issue with docling and GOT OCR
98f25ae -
resolving compatiability issue with docling and GOT OCR
5367fe1 -
Remove chat with document feature, updated ui, remove ocrmac, pinned transformer version to 4.37 for GOT OCR
e66626c -
Implement Markit_GOT files into Markit_v2
dda982a