Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

bigcode/commitpackft

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

191

Base only

Active filters: bigcode/commitpackft

mlx-community/granite-8b-code-instruct-4bit

Text Generation • 8B • Updated May 6, 2024 • 84

mlx-community/granite-8b-code-instruct-8bit

Text Generation • 8B • Updated May 6, 2024 • 55

mlx-community/granite-20b-code-instruct-4bit

Text Generation • 20B • Updated May 14, 2024 • 59

mlx-community/granite-20b-code-instruct-8bit

Text Generation • 20B • Updated May 14, 2024 • 54

mlx-community/granite-34b-code-instruct-4bit

Text Generation • 34B • Updated May 14, 2024 • 52 • 1

mlx-community/granite-34b-code-instruct-8bit

Text Generation • 34B • Updated May 14, 2024 • 42

YorkieOH10/granite-34b-code-instruct-Q8_0-GGUF

Text Generation • 34B • Updated May 6, 2024 • 34 • 5

NikolayKozloff/granite-3b-code-instruct-Q8_0-GGUF

Text Generation • 3B • Updated May 7, 2024 • 94 • 2

NikolayKozloff/granite-20b-code-instruct-Q4_0-GGUF

Text Generation • 20B • Updated May 7, 2024 • 52 • 2

NikolayKozloff/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • 8B • Updated May 7, 2024 • 48 • 2

jncraton/granite-3b-code-instruct-ct2-int8

Text Generation • Updated May 8, 2024 • 22

Wusul/granite-20b-code-instruct-Q5_K_M-GGUF

Text Generation • 20B • Updated May 8, 2024 • 32

YorkieOH10/granite-3b-code-instruct-Q8_0-GGUF

Text Generation • 3B • Updated May 9, 2024 • 27

YorkieOH10/granite-20b-code-instruct-Q8_0-GGUF

Text Generation • 20B • Updated May 9, 2024 • 18 • 3

SixOpen/granite-34b-code-instruct-Q5_K_M-GGUF

Text Generation • 34B • Updated May 10, 2024 • 14

newsletter/granite-3b-code-instruct-Q6_K-GGUF

Text Generation • 3B • Updated May 10, 2024 • 67

newsletter/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • 8B • Updated May 10, 2024 • 16

newsletter/granite-20b-code-instruct-Q6_K-GGUF

Text Generation • 20B • Updated May 10, 2024 • 50

upendrab/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated May 10, 2024 • 13

cobrakenji/granite-8b-code-instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated May 11, 2024 • 13

cobrakenji/granite-20b-code-instruct-Q5_K_M-GGUF

Text Generation • 20B • Updated Jun 10, 2024 • 19

cobrakenji/granite-34b-code-instruct-Q4_K_M-GGUF

Text Generation • 34B • Updated Jun 10, 2024 • 23 • 2

cpellens/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated May 11, 2024 • 22

cobrakenji/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated May 13, 2024 • 7

MoMonir/granite-8b-code-instruct-GGUF

Text Generation • 8B • Updated May 14, 2024 • 43

celek/granite-3b-code-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated May 16, 2024 • 28

mayank-mishra/granite-20b-code-instruct-Q4_K_M-GGUF

Text Generation • 20B • Updated May 19, 2024 • 47

bartowski/granite-34b-code-instruct-GGUF

Text Generation • 34B • Updated May 20, 2024 • 1.8k • 8

ibm-granite/granite-20b-code-instruct-8k-GGUF

Text Generation • 20B • Updated Apr 25 • 153 • 6

ibm-granite/granite-34b-code-instruct-8k-GGUF

Text Generation • 34B • Updated Apr 25 • 161 • 8