Spaces:
Sleeping
Sleeping
Download app/services/document_loader.py from mghfuran/ZKnowledgeAgent: direct link, hf CLI and curl.
- Browser
- Download file 395 Bytes
-
https://huggingface.co/spaces/mghfuran/ZKnowledgeAgent/resolve/main/app/services/document_loader.py
- Command line
-
hf download hf://spaces/mghfuran/ZKnowledgeAgent/app/services/document_loader.py
-
curl -L -o document_loader.py https://huggingface.co/spaces/mghfuran/ZKnowledgeAgent/resolve/main/app/services/document_loader.py
395 Bytes
| from langchain_community.document_loaders import PyPDFLoader | |
| from langchain_text_splitters import RecursiveCharacterTextSplitter | |
| def load_pdf(file_path): | |
| loader = PyPDFLoader(file_path) | |
| documents = loader.load() | |
| splitter = RecursiveCharacterTextSplitter( | |
| chunk_size=500, | |
| chunk_overlap=100 | |
| ) | |
| chunks = splitter.split_documents(documents) | |
| return chunks |