cyankiwi/granite-4.0-h-micro-AWQ-8bit
Text Generation • 3B • Updated • 60
AI & ML interests
LLM inference, open models
Recent Activity
View all activity
cyankiwi/granite-4.0-h-micro-AWQ-4bit
Text Generation • 3B • Updated • 1.01k
cyankiwi/Qwen3-VL-30B-A3B-Thinking-AWQ-8bit
Image-Text-to-Text • 10B • Updated • 41 • 4
cyankiwi/Qwen3-VL-30B-A3B-Instruct-AWQ-8bit
Image-Text-to-Text • 10B • Updated • 79 • 3
cyankiwi/Qwen3-VL-30B-A3B-Thinking-AWQ-4bit
Image-Text-to-Text • 6B • Updated • 66 • 5
cyankiwi/Qwen3-VL-30B-A3B-Instruct-AWQ-4bit
Image-Text-to-Text • 6B • Updated • 56k • 10
cyankiwi/Apriel-1.5-15b-Thinker-AWQ-8bit
Image-Text-to-Text • 5B • Updated • 35 • 1
cyankiwi/Apriel-1.5-15b-Thinker-AWQ-4bit
Image-Text-to-Text • 3B • Updated • 42 • 2
cyankiwi/cwm-AWQ-8bit
10B • Updated • 29
cyankiwi/cwm-AWQ-4bit
6B • Updated • 59 • 1
cyankiwi/KAT-Dev-AWQ-8bit
Text Generation • 10B • Updated • 32
cyankiwi/KAT-Dev-AWQ-4bit
Text Generation • 6B • Updated • 37
cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-8bit
Text Generation • 81B • Updated • 53 • 4
cyankiwi/Qwen3-Next-80B-A3B-Thinking-AWQ-8bit
Text Generation • 81B • Updated • 53 • 5
cyankiwi/Magistral-Small-2509-AWQ-4bit
5B • Updated • 185 • 3
cyankiwi/Tongyi-DeepResearch-30B-A3B-AWQ-8bit
Text Generation • 9B • Updated • 45 • 4
cyankiwi/Tongyi-DeepResearch-30B-A3B-AWQ-4bit
Text Generation • 5B • Updated • 175 • 4
cyankiwi/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit
Text Generation • 81B • Updated • 524 • 23
cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit
Text Generation • 81B • Updated • 15.9k • 68
cyankiwi/Jan-v1-2509-AWQ-4bit
Text Generation • 4B • Updated • 41 • 1
cyankiwi/ERNIE-4.5-21B-A3B-Thinking-AWQ-4bit
Text Generation • 5B • Updated • 183 • 4
cyankiwi/ERNIE-4.5-21B-A3B-Thinking-AWQ-8bit
Text Generation • 7B • Updated • 47 • 4
cyankiwi/Hermes-4-14B-AWQ-8bit
Text Generation • 5B • Updated • 31
cyankiwi/Hermes-4-14B-AWQ-4bit
Text Generation • 4B • Updated • 758 • 4
cyankiwi/NVIDIA-Nemotron-Nano-9B-v2-AWQ-8bit
Text Generation • 3B • Updated • 58
cyankiwi/NVIDIA-Nemotron-Nano-12B-v2-AWQ-8bit
Text Generation • 4B • Updated • 1.52k • 1
cyankiwi/NVIDIA-Nemotron-Nano-12B-v2-AWQ-4bit
Text Generation • 3B • Updated • 1.33k • 4
cyankiwi/NVIDIA-Nemotron-Nano-9B-v2-AWQ-4bit
Text Generation • 2B • Updated • 211 • 3
cyankiwi/Hermes-4-70B-AWQ-8bit
Text Generation • 21B • Updated • 33 • 1
cyankiwi/Hermes-4-70B-AWQ-4bit
Text Generation • 13B • Updated • 225 • 7