Audio-Text-to-Text
Transformers
Safetensors
step_audio_2
text-generation
audio-reasoning
chain-of-thought
multi-modal
step-audio-r1
custom_code
8-bit precision
compressed-tensors
Instructions to use TransWithAI/Step-Audio-R1-NVFP4A16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TransWithAI/Step-Audio-R1-NVFP4A16 with Transformers:
# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("TransWithAI/Step-Audio-R1-NVFP4A16", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 165 Bytes
6082b06 | 1 2 3 4 5 6 7 | default_stage:
default_modifiers:
QuantizationModifier:
targets: [Linear]
ignore: [lm_head, 're:encoder.*', 're:adapter.*']
scheme: NVFP4A16
|