RedHatAI/gemma-2-27b-it-quantized.w8a16
Text Generation • 28B • Updated • 91
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/SmolLM-360M-Instruct-quantized.w8a8
Text Generation • 0.4B • Updated • 106
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
Text Generation • 0.2B • Updated • 126 • 1
RedHatAI/SmolLM-135M-Instruct-quantized.w8a16
Text Generation • 0.2B • Updated • 462
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 108 • 1
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation • 2B • Updated • 189
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 172
RedHatAI/Qwen2-72B-Instruct-quantized.w8a8
Text Generation • 73B • Updated • 146 • 2
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 260
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 211
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation • 8B • Updated • 67
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8
Text Generation • 4B • Updated • 195
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16
Text Generation • 4B • Updated • 108
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16
Text Generation • 4B • Updated • 178 • 1
RedHatAI/Phi-3-mini-128k-instruct-FP8
Text Generation • 4B • Updated • 71
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8
Text Generation • 14B • Updated • 102 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16
Text Generation • 14B • Updated • 96 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16
Text Generation • 14B • Updated • 1.24k • 3
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 60 • 5
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16
Text Generation • 12B • Updated • 115
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation • 12B • Updated • 1.56k • 4
RedHatAI/Mistral-Large-Instruct-2407-FP8
Text Generation • 123B • Updated • 193
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8
Text Generation • 7B • Updated • 126 • 2
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation • 8B • Updated • 5.75k • 5
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation • 8B • Updated • 146 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 11.8k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 718 • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 136k • 45
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation • 71B • Updated • 108
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation • 71B • Updated • 102