RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic
Text Generation • 1B • Updated • 1.59M • 4
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/gemma-2-9b-it-quantized.w8a8
Text Generation • 10B • Updated • 113 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8
Text Generation • 14B • Updated • 28 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16
Text Generation • 14B • Updated • 14 • 2
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 8 • 5
RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a16
33B • Updated • 4
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a16
8B • Updated • 1.39k
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a16
0.6B • Updated • 18
RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a8
73B • Updated • 389
RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a8
33B • Updated • 122
RedHatAI/Qwen2.5-32B-quantized.w8a8
33B • Updated • 7
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 390 • 31
RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8
3B • Updated • 97
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8
2B • Updated • 286
RedHatAI/SparseLlama-3-8B-pruned_50.2of4
Text Generation • 8B • Updated • 45 •
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic
Text Generation • 89B • Updated • 217 • 11
RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Text Generation • 4B • Updated • 16 • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16
Text Generation • 71B • Updated • 13 • 2
RedHatAI/SmolLM-135M-q
Updated
RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Text Generation • 141B • Updated • 6 • 3
RedHatAI/DeepSeek-Coder-V2-Base-FP8
Text Generation • 236B • Updated • 12
RedHatAI/DeepSeek-Coder-V2-Instruct-FP8
Text Generation • 236B • Updated • 3.67k • 7
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
Text Generation • 12B • Updated • 1.52k • 19
RedHatAI/Qwen2-57B-A14B-Instruct-FP8
Text Generation • 57B • Updated • 349 • 1
RedHatAI/Llama-2-7b-chat-hf-FP8
Text Generation • 7B • Updated • 45
RedHatAI/Mistral-7B-Instruct-v0.3-FP8
Text Generation • 7B • Updated • 4.69k • 3
RedHatAI/Qwen2-0.5B-Instruct-FP8
Text Generation • 0.5B • Updated • 908 • 3
RedHatAI/Qwen2-1.5B-Instruct-FP8
Text Generation • 2B • Updated • 37.8k
RedHatAI/Qwen2-7B-Instruct-FP8
Text Generation • 8B • Updated • 889 • 2
RedHatAI/Qwen2-72B-Instruct-FP8
Text Generation • 73B • Updated • 949 • 16