Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

34

Base only

Active filters: optimum-intel

nsbendre25/llama-3-8B-Instruct-ov-fp16-int4-sym

Text Generation • Updated Apr 30, 2024 • 17 • 1

nsbendre25/Phi-3-mini-128k-instruct-ov-fp16-int4-asym

Text Generation • Updated Apr 30, 2024 • 15

nsbendre25/llama-3-70B-Instruct-ov-fp16-int4-asym

Text Generation • Updated Apr 30, 2024 • 13

akkipro/e5-base-v2-ov-int8

Feature Extraction • Updated May 9, 2024 • 12

Mitchins/t5-base-artgen-multi-instruct-OpenVINO

Text Generation • Updated Sep 3, 2025 • 18

ahmedzk11/tiny-random-minicpm-o-2_6

14M • Updated Jan 7 • 9

hrithik-dev8/tiny-random-MiniCPM-o-2_6

Image-Text-to-Text • 21.8M • Updated Jan 4 • 7

notlikejoe/tiny-random-MiniCPM-o-2_6

Text Generation • 6.17M • Updated Jan 16 • 17

umaimaparveennineteen/tiny-random-MiniCPM-0-2_6

Text Generation • 2.95M • Updated Feb 3 • 13

umaimaparveennineteen/tiny-random-MiniCPM-o-2_6

Feature Extraction • 2.73M • Updated Feb 4 • 11

Nsan05/tiny-random-MiniCPM-o-2_6

5.02M • Updated Feb 11 • 15

Morteza89/gemma-4-26b-a4b-int4-ov

Image-Text-to-Text • Updated May 12 • 24 • 2

Morteza89/gemma-4-26b-a4b-it-int4-ov

Image-Text-to-Text • Updated May 12 • 18

Morteza89/gpt-oss-120b-int4-ov

Text Generation • Updated May 13 • 18

Morteza89/gpt-oss-120b-int8-ov

Text Generation • Updated May 13 • 15

Morteza89/qwen2-57b-a14b-int4-ov

Text Generation • Updated May 20 • 9

Morteza89/qwen3.6-35b-a3b-int4-ov

Image-Text-to-Text • Updated May 13 • 15

Morteza89/llama-3.3-70b-instruct-int4-ov

Text Generation • Updated May 14 • 5 • 1

Morteza89/DeepSeek-R1-Distill-Qwen-32B-int4-ov

Text Generation • Updated May 22 • 14

Morteza89/DeepSeek-R1-Distill-Llama-70B-int4-ov

Text Generation • Updated May 22 • 18

HelloSun/animagine-xl-4.0-Lightning-OpenVINO-INT4

Text-to-Image • Updated about 6 hours ago • 8

Irfanuruchi/Qwen3-4B-Computer-Science-Models

Text Generation • Updated Jul 25 • 1

aweussom/Muse-Glimmer-30B-int4-ov

Image-Text-to-Text • Updated Aug 12 • 20 • 1

Morteza89/qwen3.8-27b-int4-ov

Image-Text-to-Text • Updated Aug 28 • 712 • 1

Jeff98/MiniCPM5-2B-int4-gq-ov

Text Generation • Updated 18 days ago • 57

HelloSun/dreamshaper-xl-v2-turbo-OpenVINO-INT4

Text-to-Image • Updated about 6 hours ago • 93

HelloSun/dreamshaper-xl-lightning-OpenVINO-INT4

Text-to-Image • Updated about 6 hours ago • 91

HelloSun/Z-Image-Turbo-OpenVINO-INT4

Text-to-Image • Updated about 6 hours ago • 85

HelloSun/FLUX.2-klein-4B-OpenVINO-INT4

Text-to-Image • Updated about 6 hours ago

HelloSun/Qwen-Image-2.1-OpenVINO-INT4

Text-to-Image • Updated about 6 hours ago