Red Hat AI

company

Verified

https://www.redhat.com/en/products/ai

AI & ML interests

OpenSource and AI

Recent Activity

shanjiaz new activity about 20 hours ago

RedHatAI/GLM-5.2-speculator.dspark:Failed to run on 8xB200 - AssertionError: Tried to load weights of size torch.Size([6144, 30720])to a parameter of size torch.Size([6144, 18432])

krishnateja95 updated a model about 22 hours ago

RedHatAI/Mellum2-12B-A2.5B-Thinking-speculator.dflash

krishnateja95 updated a model about 22 hours ago

RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-speculator.dflash

View all activity

Papers

SNLP: Layer-Parallel Inference via Structured Newton Corrections

S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation

View all Papers

RedHatAI 's models 725

RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • 8B • Updated Jun 9 • 1.04k • 1

RedHatAI/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • 8B • Updated Jun 9 • 543 • 2

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 71B • Updated Jun 9 • 17.1k • 4

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Jun 9 • 9.11k • 14

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation • 71B • Updated Jun 9 • 21 • 2

RedHatAI/Mixtral-8x7B-Instruct-v0.1

Text Generation • 47B • Updated Jun 9 • 19.3k • 1

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 453 • 15

RedHatAI/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jun 9 • 3.83k • • 5

RedHatAI/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jun 9 • 31 •

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 30.2k • 1

RedHatAI/granite-3.1-8b-instruct

Text Generation • 8B • Updated Jun 9 • 266 • 1

RedHatAI/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 195 • 1

RedHatAI/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Jun 9 • 44 •

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 53.1k • 17

RedHatAI/phi-4-FP8-dynamic

Text Generation • 15B • Updated Jun 9 • 15.8k • 2

RedHatAI/phi-4-quantized.w8a8

Text Generation • 15B • Updated Jun 9 • 5.57k • 4

RedHatAI/phi-4-quantized.w4a16

Text Generation • 15B • Updated Jun 9 • 2.68k • 5

RedHatAI/phi-4

Text Generation • 15B • Updated Jun 9 • 138 • 1

RedHatAI/Mistral-Small-24B-Instruct-2501

Text Generation • 24B • Updated Jun 9 • 150

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8

Text Generation • 24B • Updated Jun 9 • 20k • 2

RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic

Text Generation • 24B • Updated Jun 9 • 1.85k • 13

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • 24B • Updated Jun 9 • 452 • • 1

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 24B • Updated Jun 9 • 48.6k • 10

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • 24B • Updated Jun 9 • 1.17k • 5

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated Jun 9 • 589 • 2

RedHatAI/Llama-4-Maverick-17B-128E-Instruct

Image-Text-to-Text • 402B • Updated Jun 9 • 56 • 3

RedHatAI/Llama-4-Scout-17B-16E-Instruct

Image-Text-to-Text • 109B • Updated Jun 9 • 9.93k

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 109B • Updated Jun 9 • 5.96k • 13

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • 109B • Updated Jun 9 • 9.19k • 30

RedHatAI/Qwen3-8B-speculator.peagle

2B • Updated Jun 9 • 82