Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,301

Base only

Active filters: quantization

AvoCahDoe/llama-2-13b-rlmpq-balanced

Text Generation • 13B • Updated Jun 11 • 23

AvoCahDoe/llama-2-13b-rlmpq-conservative

Text Generation • 13B • Updated Jun 11 • 23

AvoCahDoe/llama-2-13b-rlmpq-extreme-survival

Text Generation • 13B • Updated Jun 11 • 23

AvoCahDoe/llama-2-13b-rlmpq-high-fidelity

Text Generation • 13B • Updated Jun 11 • 21

AvoCahDoe/mistral-7b-rlmpq-aggressive

Text Generation • 7B • Updated Jun 11 • 19

AvoCahDoe/mistral-7b-rlmpq-balanced

Text Generation • 7B • Updated Jun 11 • 21

AvoCahDoe/mistral-7b-rlmpq-conservative

Text Generation • 7B • Updated Jun 11 • 15

AvoCahDoe/mistral-7b-rlmpq-extreme-survival

Text Generation • 7B • Updated Jun 11 • 18

AvoCahDoe/mistral-7b-rlmpq-high-fidelity

Text Generation • 7B • Updated Jun 11 • 21

nakue/SmolLM2-1.7B-W4A16-wiki

Text Generation • 2B • Updated Jun 21 • 14 • 1

nakue/SmolLM2-1.7B-W4A16-instruct

Text Generation • 2B • Updated Jun 21 • 33 • 2

nakue/SmolLM2-1.7B-W8A8-instruct

Text Generation • 2B • Updated Jun 20 • 21 • 1

AvoCahDoe/gemma-2-9b-rlmpq-aggressive

Text Generation • 9B • Updated Jun 11 • 22

AvoCahDoe/gemma-2-9b-rlmpq-balanced

Text Generation • 9B • Updated Jun 11 • 25

AvoCahDoe/gemma-2-9b-rlmpq-conservative

Text Generation • 9B • Updated Jun 11 • 17

AvoCahDoe/gemma-2-9b-rlmpq-extreme-survival

Text Generation • 9B • Updated Jun 11 • 16

AvoCahDoe/gemma-2-9b-rlmpq-high-fidelity

Text Generation • 9B • Updated Jun 11 • 20

AvoCahDoe/qwen2-5-7b-rlmpq-aggressive

Text Generation • 8B • Updated Jun 11 • 17

AvoCahDoe/qwen2-5-7b-rlmpq-balanced

Text Generation • 8B • Updated Jun 11 • 16

AvoCahDoe/qwen2-5-7b-rlmpq-conservative

Text Generation • 8B • Updated Jun 11 • 18

AvoCahDoe/qwen2-5-7b-rlmpq-extreme-survival

Text Generation • 8B • Updated Jun 11 • 23

AvoCahDoe/qwen2-5-7b-rlmpq-high-fidelity

Text Generation • 8B • Updated Jun 11 • 22

Akash-Sakala/bert-phishing-classifier_student_4bit

Text Classification • 52.8M • Updated 5 days ago • 27

molbal/ideogram-4-gguf

Text-to-Image • 9B • Updated Jun 15 • 94.2k • 10

Shankara-A-S/sarvam-30b-silentmarlin

Text Generation • 6B • Updated Jun 14

AvoCahDoe/llama-3-1-8b-rlmpq-aggressive

Text Generation • 8B • Updated Jun 12 • 17

AvoCahDoe/llama-3-1-8b-rlmpq-balanced

Text Generation • 8B • Updated Jun 12 • 15

AvoCahDoe/llama-3-1-8b-rlmpq-conservative

Text Generation • 8B • Updated Jun 12 • 16

AvoCahDoe/llama-3-1-8b-rlmpq-extreme-survival

Text Generation • 8B • Updated Jun 12 • 19

AvoCahDoe/llama-3-1-8b-rlmpq-high-fidelity

Text Generation • 8B • Updated Jun 12 • 24