Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,602

Base only

Active filters: quantized

afrideva/phi-2-GGUF

Text Generation • 3B • Updated Dec 18, 2023 • 229 • 4

afrideva/Marx-3B-V2-GGUF

Text Generation • 3B • Updated Dec 18, 2023 • 296 • 1

afrideva/phi-2-arxiv-physics-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2023 • 186 • 1

afrideva/minima-3b-layla-v2-GGUF

Text Generation • 3B • Updated Dec 19, 2023 • 223 • 4

afrideva/palmer-002-GGUF

Text Generation • 1B • Updated Dec 19, 2023 • 197 • 2

afrideva/palmer-x-002-GGUF

Text Generation • 1B • Updated Dec 19, 2023 • 55 • 1

afrideva/phi-2-sft-alpaca_gpt4_en-ep1-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 234 • 4

afrideva/phi2-oasst-guanaco-bf16-custom-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 91

afrideva/phine-2-v0-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 211

afrideva/phi-2-meditron-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 119 • 3

afrideva/phi-2-uncensored-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 666 • 13

afrideva/llama2_xs_460M_uncensored-GGUF

Text Generation • 0.5B • Updated Dec 21, 2023 • 191 • 1

afrideva/phi-2-chat-turkish-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 266 • 3

afrideva/phi-2-chat-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 231 • 1

afrideva/LMCocktail-phi-2-v1-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 231

afrideva/Llama-160M-Chat-v1-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 184 • 2

afrideva/llama-160m-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 86

afrideva/phi-1_5_dolly_instruction_polish-GGUF

Text Generation • 1B • Updated Dec 22, 2023 • 131 • 2

afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 288 • 2

afrideva/phi-2_LogiCoT_finetuned-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 118

afrideva/open-llama-3b-v2-instruct-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 200 • 1

afrideva/phi-2_dolly_instruction_polish-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 220 • 1

afrideva/smol-3b-GGUF

Text Generation • 3B • Updated Dec 25, 2023 • 76

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • 3B • Updated Dec 26, 2023 • 114 • 3

afrideva/MiniChat-2-3B-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 221 • 1

afrideva/Mixtral-GQA-400m-v2-GGUF

Text Generation • 2B • Updated Dec 27, 2023 • 169 • 1

afrideva/smol_llama-220M-GQA-GGUF

Text Generation • 0.2B • Updated Dec 27, 2023 • 159

afrideva/tinycodellama-1.3b-3k-GGUF

Text Generation • 1B • Updated Dec 27, 2023 • 64

afrideva/RocketZephyr-3b-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 99 • 1

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 77 • 1