Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45

Base only

Active filters: batiai

batiai/Qwen3-Reranker-0.6B-GGUF

Text Ranking • 0.6B • Updated Apr 17 • 258 • 1

batiai/Gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated May 4 • 803 • 3

batiai/Qwen3.5-9B-GGUF

Text Generation • 9B • Updated May 4 • 213

batiai/gemma-4-E2B-it-GGUF

Text Generation • 5B • Updated Apr 18 • 22.4k • 2

batiai/gemma-4-E4B-it-GGUF

Text Generation • 8B • Updated Apr 18 • 6.96k • 5

batiai/gemma-4-31B-it-GGUF

Text Generation • 31B • Updated Apr 18 • 412

batiai/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated Aug 16 • 74

batiai/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated May 4 • 72

batiai/MiniMax-M2.7-GGUF

Text Generation • 229B • Updated Apr 15 • 82

batiai/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated May 4 • 1.75k • 6

batiai/Qwen3-VL-Embedding-2B-GGUF

Sentence Similarity • 2B • Updated Apr 17 • 126

batiai/Qwen3-Reranker-4B-GGUF

Text Ranking • 4B • Updated Apr 17 • 126 • 1

batiai/Qwen3-Reranker-8B-GGUF

Text Ranking • 8B • Updated Apr 17 • 122

batiai/Qwen3-VL-Embedding-8B-GGUF

Sentence Similarity • 8B • Updated Jun 5 • 738 • 7

batiai/Qwen3-Embedding-0.6B-GGUF

Sentence Similarity • 0.6B • Updated Apr 19 • 338 • 1

batiai/Qwen3-Embedding-4B-GGUF

Sentence Similarity • 4B • Updated Apr 19 • 138

batiai/Qwen3-Embedding-8B-GGUF

Sentence Similarity • 8B • Updated Apr 19 • 277

batiai/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated Aug 16 • 159k • 8

batiai/Kimi-K2.6-GGUF

Text Generation • 1T • Updated Aug 15 • 96

batiai/Nemotron-3-Super-120B-A12B-GGUF

Text Generation • 121B • Updated Apr 30 • 100 • 1

batiai/Nemotron-3-Nano-30B-A3B-GGUF

Text Generation • 32B • Updated May 4 • 136

batiai/Nemotron-3-Nano-Omni-30B-Text-Only-GGUF

Text Generation • 32B • Updated May 9 • 118

batiai/Granite-4.1-8B-GGUF

Text Generation • 9B • Updated May 4 • 224

batiai/Mistral-Medium-3.5-128B-GGUF

Text Generation • 125B • Updated Jun 16 • 90

batiai/DeepSeek-V4-Pro-GGUF

Text Generation • 1.6T • Updated Jun 1 • 124 • 2

batiai/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text • 108B • Updated Aug 17 • 574

batiai/Fara-7B-GGUF

Image-Text-to-Text • 8B • Updated May 23 • 397

batiai/batisay-ko-base

Automatic Speech Recognition • 0.8B • Updated Aug 1 • 40 • 1

batiai/LFM2.5-8B-A1B-GGUF

Text Generation • 8B • Updated Aug 17 • 351

batiai/gemma-4-12B-it-GGUF

Image-Text-to-Text • 12B • Updated Aug 17 • 749