Post
44
🦙 llama.cpp hit v1.0.0, so I built it a party
juiceb0xc0de/BYOGGUF: Bring Your Own GGUF. Paste any public model repo, pick a quant, and chat with it on an RTX PRO 6000 Blackwell through ZeroGPU, on the minutes your account already has (5 a day free, 40 on PRO).
If you don’t have a GGUF, the Space will make you one. Sign in, point it at any public safetensors or GGUF repo, pick your quant types, and it converts and quantizes on CPU, so it costs you no GPU quota. The finished quants land in your own account with a model card, and one button takes them straight into the chat room. Something the size of Qwen3.8-27B is fine.
Anything up to 48 GB runs on half the card at the normal rate; bigger models get the full 96 GB and burn minutes twice as fast. Public, ungated repos only. Native CUDA 13 binaries for Blackwell, built on the first stable llama.cpp.
juiceb0xc0de/BYOGGUF: Bring Your Own GGUF. Paste any public model repo, pick a quant, and chat with it on an RTX PRO 6000 Blackwell through ZeroGPU, on the minutes your account already has (5 a day free, 40 on PRO).
If you don’t have a GGUF, the Space will make you one. Sign in, point it at any public safetensors or GGUF repo, pick your quant types, and it converts and quantizes on CPU, so it costs you no GPU quota. The finished quants land in your own account with a model card, and one button takes them straight into the chat room. Something the size of Qwen3.8-27B is fine.
Anything up to 48 GB runs on half the card at the normal rate; bigger models get the full 96 GB and burn minutes twice as fast. Public, ungated repos only. Native CUDA 13 binaries for Blackwell, built on the first stable llama.cpp.