Transformers How to use mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8 with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM
processor = AutoProcessor.from_pretrained("mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8")
model = AutoModelForMultimodalLM.from_pretrained("mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8", device_map="auto") 
