tahamajs's picture
download
raw
1.92 kB
# CA19: Advanced Experimental Memory Systems in AI
# Core dependencies for comprehensive RAG system with GPU memory optimization
# Core scientific computing
torch>=2.0.0
torchvision>=0.15.0
numpy>=1.24.0
matplotlib>=3.7.0
seaborn>=0.12.0
pandas>=2.0.0
scikit-learn>=1.3.0
psutil>=5.9.0
tqdm>=4.65.0
# LangChain ecosystem for RAG systems
langchain>=0.1.0
langchain-community>=0.0.20
langchain-core>=0.1.0
langchain-google-genai>=1.0.0
langgraph>=0.0.20
langsmith>=0.0.70
# Google Gemini API integration
google-generativeai>=0.3.0
# Vector stores and embeddings
chromadb>=0.4.0
faiss-cpu>=1.7.4
pinecone-client>=2.2.4
sentence-transformers>=2.2.0
# Memory profiling and optimization
memory-profiler>=0.60.0
pympler>=0.9
py-spy>=0.3.14
# GPU memory management
py3nvml>=0.2.7
nvidia-ml-py3>=7.352.0
# Visualization and analysis
plotly>=5.15.0
dash>=2.12.0
bokeh>=3.2.0
# Data handling and storage
h5py>=3.9.0
zarr>=2.16.0
lmdb>=1.4.0
# Configuration and utilities
pyyaml>=6.0
click>=8.1.0
rich>=13.5.0
fire>=0.5.0
pydantic>=2.0.0
dataclasses-json>=0.6.0
# Async support
aiohttp>=3.9.0
# Memory management and caching
redis>=5.0.0
memray>=1.10.0
# Monitoring and logging
wandb>=0.16.0
mlflow>=2.8.0
tensorboard>=2.15.0
# Testing framework
pytest>=7.4.0
pytest-benchmark>=4.0.0
pytest-asyncio>=0.21.0
# Jupyter notebook support
jupyter>=1.0.0
ipywidgets>=8.0.0
notebook>=6.5.0
# Advanced visualization
streamlit>=1.28.0
gradio>=4.0.0
# Document processing
pypdf>=3.0.0
python-docx>=0.8.11
beautifulsoup4>=4.12.0
# Text processing and NLP
nltk>=3.8.0
spacy>=3.6.0
transformers>=4.30.0
# Performance optimization
numba>=0.57.0
cython>=0.29.0
# Development tools
black>=23.0.0
flake8>=6.0.0
mypy>=1.4.0
pre-commit>=3.3.0
# Optional: Advanced features (install as needed)
# deepspeed>=0.9.0 # For distributed training
# accelerate>=0.21.0 # For model acceleration
# bitsandbytes>=0.41.0 # For quantization

Xet Storage Details

Size:
1.92 kB
·
Xet hash:
9b515797bfabf1d60cd95a5586b2dded9993c89bdc921c06855b9c7e0aef85be

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.