GGUF
conversational

license: PolyForm Small Business 1.0.0 + BottleCap personal-use grant

Prompt: Code me a HTML5 page of a rotating Tesseract, apply a 4D projection matrix to it and make it customizable and cool.. use minimal thought and just do it.

image

Settings used:

./build/bin/llama-server
-m Qwen-3.8-27B-thinkingcap-Q2-Q3.gguf
-c 30000 -ngl 999
--host 0.0.0.0 --port 8080
--cache-type-k q5_0 --cache-type-v q5_0 --jinja --temp 0.8 --top-p 0.9 --min-p 0.05 --top-k 40

This will fit on a 12GB card with context 30,000 and q5_0 KV quantization.

Downloads last month
389
GGUF
Model size
27B params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support