Inference Providers
Active filters: marlin
GreyArea128/Qwen3.8-27B-Heretic-GPTQ-W4A16-G128-Marlin
Text Generation • 27B • Updated • 2
Twu31/Qwen3.6-35B-A3B-GPTQ-INT4-W4A16-LowLatency
Image-Text-to-Text • 6B • Updated • 415
• 4
TyroneNel/Orca-Qwen3.8-27B-Uncensored-W4A16-fast
Image-Text-to-Text • 4B • Updated • 195
• 1
bradshaw-ai/Swift-1.5-27B-6.3bpw-RCO-SAR-Marlin-MTP
Text Generation • 3B • Updated • 158
• 1
Beling86/Ornith-1.5-122B-AutoRound-W3W4
Text Generation • 16B • Updated • 102
• 1
RedHatAI/llama-2-7b-chat-marlin
Text Generation • 1B • Updated • 17
robertgshaw2/llama-2-7b-chat-marlin
Text Generation • 1B • Updated • 7
• 1
robertgshaw2/llama-2-13b-chat-marlin
Text Generation • 2B • Updated • 4
RedHatAI/zephyr-7b-beta-marlin
Text Generation • 1B • Updated • 73
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation • 0.3B • Updated • 2.58k
• 2
RedHatAI/OpenHermes-2.5-Mistral-7B-marlin
Text Generation • 1B • Updated • 21
• 2
RedHatAI/Nous-Hermes-2-Yi-34B-marlin
Text Generation • 5B • Updated • 28
• 5
vilsonrodrigues/OpenHermes-2.5-Mistral-7B-Pruned50-GPTQ-Marlin
Text Generation • 1B • Updated • 10
softmax/Llama-2-70b-chat-hf-marlin
Text Generation • 10B • Updated • 4
softmax/falcon-180B-chat-marlin
Text Generation • 26B • Updated • 18
mgoin/Meta-Llama-3-8B-Instruct-Marlin
Text Generation • Updated • 22
tachyphylaxis/opus-v1.2-70b-marlin
Text Generation • 10B • Updated • 6
ControlNet/marlin_vit_small_ytf
Feature Extraction • 22.5M • Updated • 19
ControlNet/marlin_vit_base_ytf
Feature Extraction • 87.4M • Updated • 46
• 1
ControlNet/marlin_vit_large_ytf
Feature Extraction • 0.3B • Updated • 7
thehighnotes/vllm-jetson-orin
Text Generation • Updated • 1
tacodevs/Cydonia-24B-v4.3-W4A16-GPTQ
Text Generation • 4B • Updated • 29
groxaxo/lukey03-Qwen3.5-9B-abliterated-gptq-pro-w4g128
Text Generation • 9B • Updated • 133
• 3
caiovicentino1/Qwen3.5-9B-HLWQ-Q5
Text Generation • 9B • Updated • 42
• 3
caiovicentino1/Qwen3.5-27B-HLWQ-Q5
Text Generation • 27B • Updated • 54
• 10
caiovicentino1/Qwen3.5-9B-Claude-Opus-HLWQ-Q5
Text Generation • 9B • Updated • 27
• 5
caiovicentino1/Qwen3.5-27B-Claude-Opus-HLWQ-Q5
Text Generation • 27B • Updated • 15
caiovicentino1/Qwopus3.5-9B-v3-HLWQ-Q5
Text Generation • 3B • Updated • 39
• 9
caiovicentino1/Harmonic-27B-HLWQ-Q5
Text Generation • 26B • Updated • 13
caiovicentino1/Huihui-Qwopus3.5-27B-v3-abliterated-HLWQ-Q5
Text Generation • 26B • Updated • 60
• 15