neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 152
Neural Magic
company
Verified
AI & ML interests
LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV
dsikka
updated a
model about 1 year ago
dsikka
published a
model about 1 year ago
Breaking change in transformers
1
#1 opened over 1 year ago
by 
maldv
nm-research
updated 3
models over 1 year ago
Update preprocessor_config.json
2
#4 opened over 1 year ago
by 
ManishThota
nm-research
updated 5
models over 1 year ago
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 73B • Updated • 1.18k • 8
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 1.5k • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
Image-Text-to-Text • 4B • Updated • 8.16k • 3
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
Image-Text-to-Text • 4B • Updated • 25.4k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 297 • 4
shubhrapandit
updated 6
models over 1 year ago
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 124B • Updated • 199
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
Image-Text-to-Text • 124B • Updated • 26
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text • 124B • Updated • 31 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 73B • Updated • 34
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 40
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 47