RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16 Text Generation • 238B • Updated Jan 12, 2025 • 69 • 1
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic Text Generation • 24B • Updated Jun 9 • 127k • 13
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 Text Generation • 24B • Updated Aug 5 • 246 • 2
RedHatAI/whisper-large-v2-W4A16-G128 Automatic Speech Recognition • 2B • Updated Jan 31, 2025 • 22 • 1
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 57 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 310 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic Text Generation • 15B • Updated Feb 27, 2025 • 570 • 3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic Text Generation • 33B • Updated Feb 27, 2025 • 1.42k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 309 • 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic Text Generation • 71B • Updated Feb 27, 2025 • 1.8k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 Text Generation • 71B • Updated Feb 27, 2025 • 201 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16 Text Generation • 15B • Updated Aug 5 • 103 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16 Text Generation • 33B • Updated Aug 5 • 10.3k • 6
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8 Text Generation • 33B • Updated Feb 27, 2025 • 124 • 15
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 119 • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8 Text Generation • 2B • Updated Feb 27, 2025 • 62 • 2