Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,685

Base only

Active filters: quantized

solidrust/dolphin-2.8-mistral-7b-v02-AWQ

Text Generation • 7B • Updated Sep 4, 2024 • 291 • 2

ilsp/Meltemi-7B-Instruct-v1-AWQ

Text Generation • 7B • Updated Apr 8, 2024 • 8 • 6

MaziyarPanahi/Starling-LM-7B-beta-GPTQ

Text Generation • 7B • Updated Mar 29, 2024 • 4 • 4

DisOOM/Faro-Yi-9B-200k-GGUF

Text Generation • 9B • Updated Mar 30, 2024 • 127 • 1

MaziyarPanahi/OgnoExperiment27-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 267

MaziyarPanahi/ShadowYam-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 170

MaziyarPanahi/Experiment27Neuralsirkrishna-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 189

MaziyarPanahi/YamShadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 533 • 1

MaziyarPanahi/NeuralsirkrishnaExperiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 258

MaziyarPanahi/Strangemerges_32Yamshadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 31

MaziyarPanahi/Experiment26Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 31

MaziyarPanahi/YamStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 34

MaziyarPanahi/Experiment28Experiment29-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 285

MaziyarPanahi/Experiment26Experiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 16

MaziyarPanahi/NeuralsirkrishnaExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 241

MaziyarPanahi/AlloyingotneoyExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 69

MaziyarPanahi/Experiment26M7-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 51

MaziyarPanahi/Strangemerges_32Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 39

MaziyarPanahi/Inex12Strangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 670

MaziyarPanahi/Experiment26T3q-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 30

MaziyarPanahi/Strangemerges_32M7-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 67

MaziyarPanahi/Experiment26Inex12-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 65

MaziyarPanahi/YamExperiment24-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 84

MaziyarPanahi/ShadowNeuralsirkrishna-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 323

MaziyarPanahi/M7Alloyingotneoy-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 39

MaziyarPanahi/Experiment24Experiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 22

MaziyarPanahi/YamExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 73

MaziyarPanahi/ShadowStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 589

MaziyarPanahi/Experiment26Pastiche-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 125

MaziyarPanahi/Experiment26Strangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 38