Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

distributed-inference

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

108

Base only

Active filters: distributed-inference

forkjoin-ai/deepseek-r1-distill-qwen-1.5b-gguf

Text Generation • 2B • Updated Jun 7 • 39

ZYLIM/qwen3.5-0.8b-deapi-shards

powerpudu/Web-Petals-SmolLM2-1.7B

powerpudu/Web-Petals-SmolLM2-1.7B-q8

ilya-chak/gemma-4-12B-it-qat-GGUF-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated Jun 10 • 1.07k

forkjoin-ai/mamba-2.8b-safetensors

Text Generation • Updated Jun 9

forkjoin-ai/gemma-4-31b-it-gguf

Text Generation • 31B • Updated Jun 9 • 17

forkjoin-ai/falcon-mamba-7b-safetensors

Text Generation • Updated Jun 9

forkjoin-ai/flux-1-schnell

Text-to-Image • Updated Jun 9

forkjoin-ai/qwen2.5-72b-instruct-gguf

Text Generation • 73B • Updated Jun 8 • 33

meshllm/GLM-4.7-Flash-MTP-GGUF

Text Generation • 31B • Updated Jul 1 • 475

forkjoin-ai/loki-erotica-8b-gguf

Text Generation • 8B • Updated Jun 15 • 301 • 1

ashton25549/gemma-4-26B-A4B-it-UD-Q4_K_M-layers

Text Generation • 0.8B • Updated Jul 1 • 619

artivus-ai/DistMoE-Qwen3.5-35B-A3B

Text Generation • 36B • Updated Jul 21 • 22

forkjoin-ai/unlimited-ocr-gguf

Image-Text-to-Text • 3B • Updated Jul 3 • 132

hayulalab/fleet-strategy-paper

LucianoM39/Qwen3.6-35B-A3B-UD-Q4_K_XL-Mesh-LLM

Text Generation • 0.8B • Updated Jul 18 • 307

baselquant/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Jul 27

baselquant/inkling-UD-Q2_K_XL-layers-base

Image-Text-to-Text • 0.6B • Updated Jul 27

DaisyChainAI/DaisyChain-Infer

Updated 10 days ago

jerome-etienne/webai-at-home-qwen3-0.6b-shards

usterquant/Inkling-Small-UD-Q4_K_XL-layers

Image-Text-to-Text • 0.2B • Updated Aug 4

usterquant/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Aug 4

lyssquant/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Aug 9 • 487

lyssquant/Inkling-Small-UD-Q4_K_XL-layers

Image-Text-to-Text • 0.2B • Updated Aug 9 • 753

lyssquant/GLM-5.2-Q2_K-MTP-Q8-layers

Text Generation • 0.4B • Updated Aug 9 • 748

shaffhausen/inkling-UD-Q2_K_XL-layers

Image-Text-to-Text • 0.6B • Updated Aug 11 • 963

shaffhausen/Inkling-Small-UD-Q4_K_XL-layers

Image-Text-to-Text • 0.2B • Updated Aug 11 • 914

shaffhausenquant/Kimi-K2.7-Code-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Aug 11 • 687

namepd/Qwen3-VL-8B-Instruct-Q4_K_M-layers

Image-Text-to-Text • 0.2B • Updated Aug 12 • 759