RedHatAI/Qwen3-4B-Instruct-2507-quantized.w4a16
Text Generation • 4B • Updated • 551
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Qwen3-30B-A3B-Instruct-2507-quantized.w4a16
Text Generation • 5B • Updated • 3.54k • 3
RedHatAI/DeepSeek-R1-NVFP4-FP8-BLOCK
397B • Updated • 58 • 1
RedHatAI/GLM-4.6-NVFP4
Text Generation • 199B • Updated • 48
RedHatAI/GLM-4.6-quantized.w8a8
Text Generation • 353B • Updated • 29
RedHatAI/GLM-4.6-quantized.w4a16
Text Generation • 48B • Updated • 24
RedHatAI/GLM-4.6-FP8-dynamic
Text Generation • 353B • Updated • 31
RedHatAI/Qwen3-30B-A3B-Instruct-2507-speculator.eagle3
Text Generation • 0.5B • Updated • 940 • 2
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w8a8
Text Generation • 80B • Updated • 120
RedHatAI/Qwen3-Coder-Next-FP8-dynamic
Text Generation • 80B • Updated • 587k • 2
RedHatAI/nemotron-speech-streaming-en-0.6b
Automatic Speech Recognition • Updated • 15
RedHatAI/Voxtral-Mini-4B-Realtime-2602
Automatic Speech Recognition • 4B • Updated • 22
RedHatAI/granite-3.3-8b-instruct
Text Generation • 8B • Updated • 33 • 1
RedHatAI/granite-4.0-h-tiny
Text Generation • 7B • Updated • 103
RedHatAI/granite-4.0-h-small
Text Generation • 32B • Updated • 23
RedHatAI/Prithvi-EO-2.0-300M-BurnScars
Updated • 24
RedHatAI/Prithvi-EO-2.0-300M-TL-Sen1Floods11
Updated • 1
RedHatAI/Llama-Guard-4-12B-quantized.w8a8
12B • Updated • 33 • 1
RedHatAI/Llama-Guard-4-12B-FP8-dynamic
12B • Updated • 27
RedHatAI/Llama-Guard-4-12B-quantized.w4a16
4B • Updated • 227k
RedHatAI/granite-4.0-h-small-FP8-block
Text Generation • 32B • Updated • 243
RedHatAI/Ministral-3-14B-Instruct-2512-FP8-dynamic
Text Generation • 14B • Updated • 7.35k
RedHatAI/Voxtral-Small-24B-2507-FP8-dynamic
Automatic Speech Recognition • 24B • Updated • 378 • 2
RedHatAI/Phi-4-reasoning
Text Generation • 15B • Updated • 15
RedHatAI/Foundation-Sec-8B
Text Generation • 8B • Updated • 16
RedHatAI/Qwen3-Next-80B-A3B-Thinking-FP8-dynamic
Text Generation • 80B • Updated • 20
RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Text Generation • 12B • Updated • 33
RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-dynamic
Text Generation • 80B • Updated • 356 • 1
RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-block
Text Generation • 80B • Updated • 17
RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8
Text Generation • 81B • Updated • 5.65k