RedHatAI/gemma-2-9b-it-FP8
Text Generation • 9B • Updated • 12.3k • • 5
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 844 • 2
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation • 8B • Updated • 316 • 2
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 907 • 14
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF
Text Generation • 71B • Updated • 31 • 2
RedHatAI/Mixtral-8x7B-Instruct-v0.1
Text Generation • 47B • Updated • 5.95k • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic
Text Generation • 71B • Updated • 255 • 15
RedHatAI/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 1.79k • • 5
RedHatAI/Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 38 •
RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 8.87k • 1
RedHatAI/granite-3.1-8b-instruct
Text Generation • 8B • Updated • 96 • 2
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation • 8B • Updated • 608 • 1
RedHatAI/Llama-3.3-70B-Instruct
Text Generation • 71B • Updated • 1.43k •
RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 121k • 20
RedHatAI/phi-4-FP8-dynamic
Text Generation • 15B • Updated • 99.8k • 3
RedHatAI/phi-4-quantized.w8a8
Text Generation • 15B • Updated • 3.23k • 5
RedHatAI/phi-4-quantized.w4a16
Text Generation • 15B • Updated • 1.27k • 6
RedHatAI/phi-4
Text Generation • 15B • Updated • 58 • 1
RedHatAI/Mistral-Small-24B-Instruct-2501
Text Generation • 24B • Updated • 40
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8
Text Generation • 24B • Updated • 3.66k • 2
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic
Text Generation • 24B • Updated • 5.39k • 13
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503
Image-Text-to-Text • 24B • Updated • 2.74k • • 1
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8
Image-Text-to-Text • 402B • Updated • 118 • 2
RedHatAI/Llama-4-Maverick-17B-128E-Instruct
Image-Text-to-Text • 402B • Updated • 37 • 3
RedHatAI/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 2.15k
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text • 109B • Updated • 24.6k • 13
RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
Image-Text-to-Text • 109B • Updated • 2.63k • 31
RedHatAI/Qwen3-8B-speculator.peagle
2B • Updated • 95
RedHatAI/Ministral-3-14B-Instruct-2512-NVFP4
Text Generation • Updated • 173 • 3
RedHatAI/OmniCoder-9B-FP8-Dynamic
Text Generation • 9B • Updated • 70 • 1