Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

18,682

Base only

Active filters: quantized

solidrust/Magic-Dolphin-7b-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 18

solidrust/DPOpenHermes-7B-v2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 14

solidrust/dolphin-2.8-experiment26-7b-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 18 • 1

MaziyarPanahi/Calme-7B-Instruct-v0.1.1-GGUF

Text Generation • 7B • Updated Mar 5, 2024 • 2.21k • 6

solidrust/MonarchLake-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 23

solidrust/Mistral-7B-Instruct-v0.2-Neural-Story-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 22

solidrust/OmniCorso-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 18

solidrust/MBX-7B-v3-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 17

alokabhishek/Llama-2-7b-chat-hf-bnb-4bit

Text Generation • 7B • Updated Mar 16, 2024 • 14 • 2

solidrust/merlinite-7b-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 33

alokabhishek/falcon-7b-instruct-bnb-4bit

Text Generation • 7B • Updated Mar 16, 2024 • 33 • 1

Lewdiculous/Layris_9B-GGUF-IQ-Imatrix

Text Generation • 9B • Updated May 4, 2024 • 561 • 20

solidrust/Flora-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 22

solidrust/Luna-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 17

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • 13B • Updated Mar 11, 2024 • 2.11k • 12

alokabhishek/Mistral-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Mar 24, 2024 • 69 • 2

alokabhishek/Llama-2-7b-chat-hf-GGUF

Text Generation • 7B • Updated Mar 16, 2024 • 93 • 1

solidrust/Mewthree-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 22 • 1

solidrust/Flora-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 16

solidrust/NeuralHermes-2.5-Mistral-7B-laser-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 16

solidrust/Monarch-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 19

solidrust/NeuralMonarch-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 26

solidrust/AlphaMonarch-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 16

solidrust/Darewin-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 15

solidrust/Eris-Remix-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 17

MaziyarPanahi/merlinite-7b-GGUF

Text Generation • 7B • Updated Mar 7, 2024 • 468 • 5

MaziyarPanahi/Yi-9B-GGUF

Text Generation • 9B • Updated Mar 14, 2024 • 760 • 15

MaziyarPanahi/phi-2-super-GGUF

Text Generation • 3B • Updated Mar 7, 2024 • 604 • 5

MaziyarPanahi/zephyr-7b-gemma-v0.1-GGUF

Text Generation • 9B • Updated Mar 7, 2024 • 863 • 6

MaziyarPanahi/zephyr-7b-gemma-sft-v0.1-GGUF

Text Generation • 9B • Updated Mar 7, 2024 • 1.26k • 2