RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16
141B • Updated • 17
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic
Text Generation • 8B • Updated • 19 • 1
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic
Text Generation • 8B • Updated • 19
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic
Text Generation • 8B • Updated • 95 • 3
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16
Text Generation • 2B • Updated • 25
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16
Text Generation • 2B • Updated • 22 • 3
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16
Text Generation • 2B • Updated • 19
RedHatAI/Qwen2.5-3B-quantized.w4a16
Text Generation • 3B • Updated • 558 • 1
RedHatAI/Qwen2.5-1.5B-quantized.w4a16
Text Generation • 2B • Updated • 23
RedHatAI/Qwen2.5-0.5B-quantized.w4a16
Text Generation • 0.6B • Updated • 72
RedHatAI/Qwen2.5-14B-Instruct-quantized.w8a8
Text Generation • 15B • Updated • 107
RedHatAI/granite-3.1-8b-instruct-GGUF
8B • Updated • 8
RedHatAI/Sparse-Llama-3.1-8B-2of4
Text Generation • 8B • Updated • 246 • • 62
RedHatAI/Qwen2.5-Math-7B-Instruct-FP8-dynamic
8B • Updated • 22
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 434
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation • 73B • Updated • 32 • 1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation • 73B • Updated • 24
RedHatAI/Qwen2.5-14B-quantized.w8a8
Text Generation • 15B • Updated • 22 • 2
RedHatAI/Qwen2.5-14B-FP8-dynamic
Text Generation • 15B • Updated • 120 • 2
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation • 8B • Updated • 20 • 1
RedHatAI/Qwen2.5-3B-FP8-dynamic
Text Generation • 3B • Updated • 570
RedHatAI/Qwen2.5-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 49
RedHatAI/Qwen2.5-0.5B-FP8-dynamic
Text Generation • 0.6B • Updated • 114
RedHatAI/Qwen2.5-3B-quantized.w8a8
Text Generation • 3B • Updated • 21 • 1
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 902k • 4
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation • 0.6B • Updated • 426
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • 406B • Updated • 31 • 2
RedHatAI/Qwen2.5-14B-Instruct-FP8-dynamic
15B • Updated • 4.09k
RedHatAI/Qwen2.5-72B-Instruct-FP8-dynamic
73B • Updated • 445k • 3
RedHatAI/Qwen2.5-Coder-7B-FP8-dynamic
8B • Updated • 132