neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 389
Neural Magic
company
Verified
AI & ML interests
LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV
dsikka
updated a
model about 1 year ago
dsikka
published a
model about 1 year ago
Breaking change in transformers
1
#1 opened over 1 year ago
by 
maldv
nm-research
updated 3
models over 1 year ago
Update preprocessor_config.json
2
#4 opened over 1 year ago
by 
ManishThota
nm-research
updated 5
models over 1 year ago
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 305 • 8
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 4.42k • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
Image-Text-to-Text • 4B • Updated • 65.2k • 3
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
Image-Text-to-Text • 4B • Updated • 130k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 490 • 4
shubhrapandit
updated 6
models over 1 year ago
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 125B • Updated • 34
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
Image-Text-to-Text • 124B • Updated • 30
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text • 124B • Updated • 82 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 21
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 30
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 38