RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 1.01k • 21
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation • 71B • Updated • 130 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 372 • 7
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation • 71B • Updated • 217 • 3
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • 406B • Updated • 69 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation • 406B • Updated • 108 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • 406B • Updated • 307 • 11
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • 406B • Updated • 1.91k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 477 • 31
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation • Updated • 158
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 595 • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 115
RedHatAI/Llama-3.2-3B-quantized.w8a8
4B • Updated • 14.7k
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 184k • 6
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 7.09k • 8
RedHatAI/Llama-3.2-1B-FP8
1B • Updated • 4.93k • 1
RedHatAI/Llama-2-7b-chat-quantized.w8a8
Text Generation • 7B • Updated • 213 • 1
RedHatAI/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
Text Generation • 18B • Updated • 126
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-block
Text Generation • 561B • Updated • 2.48k
RedHatAI/Qwen3.8-27B
Image-Text-to-Text • 28B • Updated • 2.37k
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 80.5k • 4
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 2.72k • 11
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
Image-Text-to-Text • 24B • Updated • 1.57k • 5
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Text Generation • 561B • Updated • 9.09k • 5
RedHatAI/Mistral-Medium-3.5-128B
Image-Text-to-Text • 128B • Updated • 155
RedHatAI/diffusiongemma-26B-A4B-it-FP8-dynamic
Image-Text-to-Text • 26B • Updated • 46.6k • 12
RedHatAI/Qwen3-VL-30B-A3B-Instruct
Image-Text-to-Text • 31B • Updated • 119
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-dynamic
Text Generation • 561B • Updated • 706 • 1
RedHatAI/Qwen3.6-35B-A3B
Image-Text-to-Text • 36B • Updated • 3.63k • 1
RedHatAI/Qwen3.6-35B-A3B-FP8
Image-Text-to-Text • 36B • Updated • 11.3k