Audio-Text-to-Text
Transformers
Safetensors
English
qwen2_audio
text2text-generation
multimodal
compressed-tensors
Instructions to use mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8") model = AutoModelForMultimodalLM.from_pretrained("mlinmg/Qwen-2-Audio-Instruct-dynamic-fp8", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 153 Bytes
ba2f2a3 | 1 2 3 4 5 6 7 | {
"audio_bos_token": "<|audio_bos|>",
"audio_eos_token": "<|audio_eos|>",
"audio_token": "<|AUDIO|>",
"processor_class": "Qwen2AudioProcessor"
}
|