Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,680

Base only

Active filters: quantized

alokabhishek/Mistral-7B-Instruct-v0.2-5.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 5 • 1

alokabhishek/Llama-2-7b-chat-hf-5.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 5 • 1

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • 7B • Updated Mar 17, 2024 • 345 • 4

MaziyarPanahi/Calme-4x7B-MoE-v0.1-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 446

MaziyarPanahi/Yi-6B-200K-GGUF

Text Generation • 6B • Updated Mar 18, 2024 • 171

Lewdiculous/firefly-gemma-7b-GGUF-IQ-Imatrix

9B • Updated Mar 20, 2024 • 170 • 2

Lewdiculous/Elly_7B-GGUF-IQ-Imatrix

7B • Updated Mar 19, 2024 • 55 • 4

Lewdiculous/WestLake-10.7B-v2-GGUF-IQ-Imatrix

11B • Updated Mar 19, 2024 • 351 • 9

Lewdiculous/Eris_PrimeV3-Vision-7B-GGUF-IQ-Imatrix

7B • Updated Mar 21, 2024 • 1.01k • 14

Lewdiculous/Asherah_7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 353 • 7

Lewdiculous/Eris_PrimeV3.05-Vision-7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 298 • 5

Lewdiculous/RP_Vision_7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 442 • 7

Lewdiculous/DaturaCookie_7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 339 • 6

alokabhishek/Llama-2-7b-chat-hf-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 4 • 1

solidrust/Starling-LM-7B-beta-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 56 • 3

solidrust/Hyperion-3.0-Mistral-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 7 • 1

Lewdiculous/Erosumika-7B-v2-GGUF-IQ-Imatrix

Text Generation • 7B • Updated Mar 26, 2024 • 80 • 4

Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix

7B • Updated Mar 25, 2024 • 503 • 4

Lewdiculous/flammen13-mistral-7B-GGUF-IQ-Imatrix

7B • Updated Mar 25, 2024 • 113 • 3

afrideva/tau-0.5B-GGUF

Text Generation • 0.6B • Updated Mar 25, 2024 • 62

afrideva/tau-0.5B-instruct-GGUF

Text Generation • 0.6B • Updated Mar 25, 2024 • 93

solidrust/Mistral-7B-v0.2-OpenHermes-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4

Lewdiculous/Eris_PrimeV4-Vision-7B-GGUF-IQ-Imatrix

7B • Updated Mar 26, 2024 • 241 • 5

afrideva/NeuralReyna-Mini-1.8B-v0.3-GGUF

Text Generation • 2B • Updated Mar 25, 2024 • 276 • 1

solidrust/Tess-7B-v2.0-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5 • 1

solidrust/LewdMistral-7B-0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 7

solidrust/WhiteRabbitNeo-7B-v1.5a-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

solidrust/mistral-7b-v0.2-layla-v4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 6

MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Text Generation • 11B • Updated Mar 26, 2024 • 145 • 4