Instructions to use batistado/MESI-KV with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use batistado/MESI-KV with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("batistado/MESI-KV", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
Yesterday
-
Publish MESI-KV coherence directory, taint tracker, and vLLM/LMCache hooks
Verified signatureb4300b2 -
Publish MESI-KV coherence directory, taint tracker, and vLLM/LMCache hooks
Verified signature645ce92
4 days ago
-
Publish MESI-KV coherence directory, taint tracker, and vLLM/LMCache hooks
Verified signatured53e4ea -
Publish MESI-KV coherence directory, taint tracker, and vLLM/LMCache hooks
Verified signatureeb57648 -
Publish MESI-KV coherence directory, taint tracker, and vLLM/LMCache hooks
Verified signature2b28173 -
initial commit
Verified signaturea60e482