(Trained with Unsloth) e1942d5 verified
Krishnan Palanisami commited on
How to use vkrishnan569/tinyllama_4Q with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("vkrishnan569/tinyllama_4Q", device_map="auto")