Transformers How to use psachdeva/Qwen2.5-Coder-32B-4bit-Instruct-emergent-misaligned with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("psachdeva/Qwen2.5-Coder-32B-4bit-Instruct-emergent-misaligned", device_map="auto") 
