Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,735

Base only

Active filters: quantized

MaziyarPanahi/Yi-1.5-9B-Chat-GGUF

Text Generation • 9B • Updated May 12, 2024 • 468 • 4

MaziyarPanahi/Yi-1.5-34B-Chat-GGUF

Text Generation • 34B • Updated May 12, 2024 • 166 • 5

afrideva/TeenyTinyLlama-160m-GGUF

Text Generation • 0.2B • Updated May 12, 2024 • 122 • 2

afrideva/TeenyTinyLlama-460m-GGUF

Text Generation • 0.5B • Updated May 12, 2024 • 103 • 1

afrideva/TeenyTinyLlama-460m-Chat-GGUF

Text Generation • 0.5B • Updated May 12, 2024 • 281

afrideva/GIST-all-MiniLM-L6-v2-GGUF

Text Generation • 22.6M • Updated May 13, 2024 • 160

afrideva/llama3_8b_chat_brainstorm-GGUF

Text Generation • 8B • Updated May 13, 2024 • 13 • 1

afrideva/pip-code-bandit-GGUF

Text Generation • 1B • Updated May 13, 2024 • 113 • 1

afrideva/pip-library-etl-1.3b-GGUF

Text Generation • 1B • Updated May 13, 2024 • 130 • 1

afrideva/pip-sql-1.3b-GGUF

Text Generation • 1B • Updated May 13, 2024 • 84 • 4

afrideva/Morph-Caller-GGUF

Text Generation • 8B • Updated May 13, 2024 • 64

afrideva/llama3-instrucTrans-enko-8b-GGUF

Text Generation • 8B • Updated May 13, 2024 • 10 • 1

afrideva/Llama-2-7b-chat-igbo-yoruba-2024-04-12_23-35-37-GGUF

Text Generation • 7B • Updated May 14, 2024 • 241

afrideva/yoruba-embedding-model-GGUF

Text Generation • 0.1B • Updated May 14, 2024 • 124

afrideva/Buzz-8b-Large-v0.5-GGUF

Text Generation • 8B • Updated May 14, 2024 • 50

afrideva/Meta-Llama-3-8B-conceptnet_UsedFor_en_en-GGUF

Text Generation • 8B • Updated May 14, 2024 • 76

FallenMerick/Space-Whale-Lite-13B-GGUF

Text Generation • 13B • Updated May 17, 2024 • 14

afrideva/Mermaid-Llama-3-5B-Pruned-GGUF

Text Generation • 5B • Updated May 17, 2024 • 39

afrideva/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • 4B • Updated May 17, 2024 • 87

afrideva/Mermaid-Llama-6.7B-RAG-Code-Instruct-GGUF

Text Generation • 7B • Updated May 17, 2024 • 447

afrideva/Llama-3-8B-Synthia-v3.5-GGUF

Text Generation • 8B • Updated May 17, 2024 • 38

legraphista/RoLlama2-7b-Instruct-GGUF

Text Generation • 7B • Updated May 23, 2024 • 145 • 1

legraphista/RoLlama2-7b-Chat-GGUF

Text Generation • 7B • Updated May 23, 2024 • 35 • 1

legraphista/RoLlama2-7b-Base-GGUF

Text Generation • 7B • Updated May 23, 2024 • 38 • 1

legraphista/RoMistral-7b-Instruct-GGUF

Text Generation • 7B • Updated May 23, 2024 • 174 • 2

afrideva/refusal-GGUF

Text Generation • 1B • Updated May 17, 2024 • 78

afrideva/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • 4B • Updated May 18, 2024 • 316 • 1

afrideva/Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2-GGUF

Text Generation • 4B • Updated May 18, 2024 • 215 • 2

MaziyarPanahi/Llama-3-70B-Instruct-v0.1-GGUF

Text Generation • 71B • Updated May 19, 2024 • 50 • 1

MaziyarPanahi/T3qm7Mergerix-7B-GGUF

Text Generation • 7B • Updated May 20, 2024 • 299