Prompt Cache: Modular Attention Reuse for Low-Latency Inference
Paper • 2311.04934 • Published • 32
Victor Maricato
victormaricato
·
AI & ML interests
Drug Discovery, Genetics, Biomedical NLP, Transformers, Graph Neural Networks, NLP
Organizations
upvoted a paper about 2 years ago