Transformers How to use DataIntelligenceTeam/llama_3_8b_4bitQ with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("DataIntelligenceTeam/llama_3_8b_4bitQ", device_map="auto") 
