Inference Providers
Active filters: FP8
Text Generation • 18B • Updated • 269k
• 239
RedHatAI/phi-4-FP8-dynamic
Text Generation • 15B • Updated • 16.7k
• 3
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
Text Generation • 4B • Updated • 1.93k
• 1
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic
Image-Text-to-Text • 24B • Updated • 13.7k
• 10
RedHatAI/whisper-tiny-FP8-Dynamic
Automatic Speech Recognition • 57.8M • Updated • 34
RedHatAI/whisper-small-FP8-Dynamic
Automatic Speech Recognition • 0.3B • Updated • 36
RedHatAI/whisper-medium-FP8-dynamic
Automatic Speech Recognition • 0.8B • Updated • 56
• 3
RedHatAI/whisper-large-v2-FP8-Dynamic
Automatic Speech Recognition • 2B • Updated • 79
RedHatAI/whisper-large-v3-FP8-dynamic
Automatic Speech Recognition • 2B • Updated • 1.26k
• 6
RedHatAI/whisper-large-v3-turbo-FP8-dynamic
Automatic Speech Recognition • 0.9B • Updated • 1.19k
• 7
RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
Image-Text-to-Text • 109B • Updated • 4.78k
• 32
nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8
402B • Updated • 17
• 15
nvidia/Llama-4-Scout-17B-16E-Instruct-FP8
109B • Updated • 4.61k
• 18
RedHatAI/Qwen3-32B-FP8-dynamic
Text Generation • 33B • Updated • 998
• 15
RedHatAI/Qwen3-0.6B-FP8-dynamic
Text Generation • 0.8B • Updated • 1.16k
• 1
RedHatAI/Qwen3-4B-FP8-dynamic
Text Generation • 4B • Updated • 941
• 1
RedHatAI/Qwen3-14B-FP8-dynamic
Text Generation • 15B • Updated • 451
• 4
RedHatAI/Qwen3-1.7B-FP8-dynamic
Text Generation • 2B • Updated • 2.8k
RedHatAI/Qwen3-30B-A3B-FP8-dynamic
Text Generation • 31B • Updated • 1.17k
• 3
RedHatAI/Qwen3-235B-A22B-FP8-dynamic
Text Generation • 235B • Updated • 88
• 2
BCCard/Qwen3-32B-FP8-Dynamic
Text Generation • 33B • Updated • 20
• 1
BCCard/Qwen3-30B-A3B-FP8-Dynamic
Text Generation • 31B • Updated • 1.46k
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8
Image-Text-to-Text • 402B • Updated • 231
• 2
duydq12/Qwen2.5-Coder-7B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 26
duydq12/Qwen2.5-7B-Instruct-1M-FP8-dynamic
Text Generation • 8B • Updated • 12
• 1
duydq12/Qwen2.5-14B-Instruct-1M-FP8-dynamic
Text Generation • 15B • Updated • 11
duydq12/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation • 15B • Updated • 18
duydq12/QwQ-32B-FP8-dynamic
Text Generation • 33B • Updated • 8
duydq12/Qwen2.5-Coder-32B-Instruct-FP8-dynamic
Text Generation • 33B • Updated • 203
duydq12/GLM-4-32B-0414-FP8-dynamic
Text Generation • 33B • Updated • 12