Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,099

Base only

Active filters: compression

kacaforyah/Opti-27B

Image-Text-to-Text • 27B • Updated about 12 hours ago • 1.68k • 10

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

Text Generation • 23B • Updated Jan 28 • 27.2k • 276

Parda21/Qwen3-4B-NWC

Text Generation • 6B • Updated 6 days ago • 262 • 2

cyankiwi/GLM-4.7-Flash-REAP-23B-A3B-AWQ-8bit

Text Generation • 24B • Updated Jul 21 • 31 • 4

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ3.5

Text Generation • 23B • Updated Mar 30 • 56 • 1

turintech/GLM-5.2-MaxMin108-GGUF

Text Generation • 325B • Updated 9 days ago • 454 • 6

Jeesup/svd-safety-l3_swift_remove30_swapgapiter_evfront_b010

Text Generation • 8B • Updated 3 days ago • 460 • 1

Parda21/Qwen3-0.6B-NWC

Text Generation • 0.8B • Updated 6 days ago • 245 • 1

Parda21/Qwen3-4B-NWC-fp8

Text Generation • 4B • Updated 6 days ago • 46 • 1

Jeesup/svd-safety-gemma2_9b_it_swift_remove20

Text Generation • 9B • Updated 4 days ago • 183 • 1

RedHatAI/oBERT-teacher-squadv1

Updated Jul 31, 2022 • 20

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-squadv1

Updated Jul 31, 2022 • 14

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-squadv1

Updated Jul 31, 2022 • 19

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-squadv1

Updated Jul 31, 2022 • 27

RedHatAI/oBERT-teacher-mnli

Updated Jul 31, 2022 • 19

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-mnli

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-mnli

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-mnli

Updated Jul 31, 2022 • 20

RedHatAI/oBERT-teacher-qqp

Updated Jul 31, 2022 • 42

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-qqp

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-qqp

Updated Jul 31, 2022 • 25

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-qqp

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-upstream-pretrained-dense

Updated Jul 31, 2022 • 17

RedHatAI/oBERT-6-upstream-pretrained-dense

Updated Jul 31, 2022 • 16

RedHatAI/oBERT-3-upstream-pretrained-dense

Updated Jul 31, 2022 • 16

RedHatAI/oBERT-12-upstream-pruned-unstructured-90

Updated Jul 31, 2022 • 22

RedHatAI/oBERT-12-upstream-pruned-unstructured-97

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-squadv1

Updated Jul 31, 2022 • 21

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-mnli

Updated Jul 31, 2022 • 20