Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15

Base only

Active filters: fp8-dynamic

just-add-ai/Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation • 71B • Updated Feb 7, 2025 • 6

ArtusDev/TheDrummer_Anubis-70B-v1.1-FP8-Dynamic

Text Generation • 71B • Updated Jun 28, 2025 • 232

brandonbeiler/InternVL3_5-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Aug 28, 2025 • 1.97k • 1

brandonbeiler/InternVL3_5-30B-A3B-FP8-Dynamic

Image-Text-to-Text • 31B • Updated Aug 28, 2025 • 177 • 3

Simplismart/InternVL3_5-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Feb 4 • 3

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-FP8-Dynamic

Text Generation • 27B • Updated Mar 30 • 480 • 2

LargitData/gemma-4-26b-a4b-it-fp8

Text Generation • 26B • Updated Apr 7 • 3k

LargitData/gemma-4-31b-it-fp8

Text Generation • 31B • Updated Apr 6 • 2.78k • 2

mconcat/Qwopus3.5-27B-v3-FP8-Dynamic

Text Generation • 27B • Updated Apr 8 • 44 • 3

Aysunner/gemma-4-31b-it-fp8

Text Generation • 31B • Updated Apr 9 • 20

Jamphus/gemma-4-31b-it-fp8

Text Generation • 31B • Updated Apr 12 • 37

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 26 • 2.22k

coolthor/Huihui-gemma-4-26B-A4B-it-abliterated-FP8-Dynamic

Image-Text-to-Text • 27B • Updated Jul 1 • 42

barryke/Ornith-1.0-9B-FP8-DYNAMIC

Image-Text-to-Text • 9B • Updated Jun 28 • 88.6k

auroter/Hy3-295B-A21B-FP8-Dynamic

Text Generation • 299B • Updated 14 days ago • 38 • 1