Run on ~6GB VRAM (full/partial offload) for various use cases.
-
bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF
Text Generation • 4B • Updated • 45k • 142 -
lmstudio-community/gemma-3-4b-it-GGUF
Image-Text-to-Text • 4B • Updated • 79.3k • 33 -
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF
Text Generation • 15B • Updated • 84.5k • 264 -
bartowski/open-r1_OlympicCoder-7B-GGUF
Text Generation • 8B • Updated • 2.36k • 11