Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,284

Base only

Active filters: quantization

TiGa-RCE/Qwen3-Embedding-8B-MLX-BF16

Feature Extraction • 8B • Updated Jul 29 • 181

jacklarmer/GLM-5.2-Abliterated-MXFP8-NVFP4-NF3-Hybrid

Text Generation • 318B • Updated Jul 30 • 55 • 4

willfalco/GLM-5.2-EXL3-TR3-3.25bpw

Text Generation • 169B • Updated Aug 4 • 157 • 8

embedl/rf-detr-base-quantized-tensorrt

Object Detection • Updated Jul 30 • 2 • 1

rudrakshrakeshzodage/nllb-200-distilled-600M-fp32

Translation • 0.6B • Updated Aug 6 • 17

rudrakshrakeshzodage/nllb-200-distilled-600M-fp16

Translation • 0.6B • Updated Aug 6 • 15

FardoX/sasori-flux2-klein-9b-tq3p

Text-to-Image • 9B • Updated Jul 30 • 50

groxaxo/Nemotron-3-Embed-1B-oQ5-MLX

Feature Extraction • 1B • Updated Aug 22 • 66 • 1

ARotting/bitforge-1bit

btaskel/miaomiaoHarem-anima-v14-GGUF

Text-to-Image • Updated Jul 30

Strg-Alt-Entf-0x00/FireRedVAD-ESP32-P4

Voice Activity Detection • Updated Aug 22 • 1

ngoctham/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated Aug 5 • 107

groxaxo/Nemotron-3-Embed-1B-oQ2-MLX

Feature Extraction • 1B • Updated Aug 22 • 37 • 1

groxaxo/Nemotron-3-Embed-1B-oQ3-MLX

Feature Extraction • 1B • Updated Aug 22 • 36

groxaxo/Nemotron-3-Embed-1B-oQ4-MLX

Feature Extraction • 1B • Updated Aug 22 • 56

groxaxo/Nemotron-3-Embed-1B-oQ6-MLX

Feature Extraction • 1B • Updated Aug 22 • 150

ajh-code/Mage-Flow-Edit-Turbo-XPO3-NVFP4

Image-to-Image • Updated Jul 30 • 14 • 1

ajh-code/Mage-Flow-Edit-XPO3-NVFP4

Image-to-Image • Updated Jul 30 • 15

Jeesup/llama32-1B-mnli-bf16-lora-seed42

Updated Jul 30 • 5

Jeesup/llama32-1B-mnli-bf16-lora-seed43

Updated Jul 30 • 12

Jeesup/llama32-1B-mnli-bf16-lora-seed44

Updated Jul 30 • 5

Jeesup/llama32-1B-mnli-int8-lora-seed42

Updated Jul 30 • 9

Jeesup/llama32-1B-mnli-int8-lora-seed43

Updated Jul 30 • 11

Jeesup/llama32-1B-mnli-int8-lora-seed44

Updated Jul 30 • 5

Jeesup/llama32-1B-mnli-nf4-lora-seed42

Updated Jul 30 • 5

Jeesup/llama32-1B-mnli-nf4-lora-seed43

Updated Jul 30 • 4

Jeesup/llama32-1B-mnli-nf4-lora-seed44

Updated Jul 30 • 4

Jeesup/llama32-1B-qqp-bf16-lora-seed42

Updated Jul 30 • 5

Jeesup/llama32-1B-qqp-bf16-lora-seed43

Updated Jul 30 • 4

Jeesup/llama32-1B-qqp-bf16-lora-seed44

Updated Jul 30 • 5