# Medical Literature RAG System
A comprehensive Retrieval-Augmented Generation (RAG) system specifically designed for medical literature analysis and question-answering, with advanced topic modeling and evaluation capabilities.
## Overview
This project implements a state-of-the-art RAG pipeline that processes medical literature from PubMed data, performs intelligent topic clustering using BERTopic, and provides accurate question-answering capabilities for medical research queries. The system is particularly optimized for ChatGPT and AI applications in healthcare research.
## Key Features
### **Advanced Data Processing**
- **Multi-format Support**: Processes Excel files containing medical literature metadata
- **Smart Data Cleaning**: Automatic deduplication, standardization, and validation
- **Structured Record Management**: Handles PMID, abstracts, MeSH terms, keywords, and citations
### **Intelligent Topic Modeling**
- **BERTopic Integration**: Advanced topic discovery usi…