Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

18,434

Base only

Active filters: quantized

afrideva/llama-160m-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 359

afrideva/phi-1_5_dolly_instruction_polish-GGUF

Text Generation • 1B • Updated Dec 22, 2023 • 250 • 2

afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 694 • 2

afrideva/phi-2_LogiCoT_finetuned-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 480

afrideva/open-llama-3b-v2-instruct-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 625 • 1

afrideva/phi-2_dolly_instruction_polish-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 794 • 1

afrideva/smol-3b-GGUF

Text Generation • 3B • Updated Dec 25, 2023 • 302

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • 3B • Updated Dec 26, 2023 • 189 • 3

afrideva/MiniChat-2-3B-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 363 • 1

afrideva/Mixtral-GQA-400m-v2-GGUF

Text Generation • 2B • Updated Dec 27, 2023 • 301 • 1

afrideva/smol_llama-220M-GQA-GGUF

Text Generation • 0.2B • Updated Dec 27, 2023 • 663

afrideva/tinycodellama-1.3b-3k-GGUF

Text Generation • 1B • Updated Dec 27, 2023 • 495

afrideva/RocketZephyr-3b-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 279 • 1

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 748 • 1

afrideva/tinycodellama-1.3b-5k-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 154

afrideva/gpt2-turkish-128-token-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 178 • 2

afrideva/gpt2-small-danish-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 778

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 804

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • 0.1B • Updated Dec 29, 2023 • 632 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 939 • 2

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 131

solidrust/Noromaid-7B-0.4-DPO-AWQ

Text Generation • 7B • Updated Mar 2, 2024 • 25 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 23 • 1

ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ

Text Generation • Updated Mar 5, 2024 • 23 • 6

MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 20 • 1

MaziyarPanahi/dolphin-2.1-mistral-7b-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 21 • 1

MaziyarPanahi/komt-mistral-7b-v1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 19

MaziyarPanahi/OpenHermes-2-Mistral-7B-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 15 • 1

MaziyarPanahi/WizardLM-70B-V1.0-GPTQ

Text Generation • 10B • Updated Jan 15, 2024 • 18 • 1

MaziyarPanahi/distilabeled-Hermes-2.5-Mistral-7B-GPTQ

Text Generation • 1B • Updated Jan 14, 2024 • 26