Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Ternii 
posted an update 2 days ago
Post
3,843
Published TR Quantisation versions of Qwen3.6-27B, Qwen3.6-35B-A3B and Qwen3.8-Flash-Next: weights packed into trits (2.25-3 per weight), no retraining.

- Mac: Qwen3.6-35B-A3B in a 16.5 GB GGUF that fits a 24 GB Mac, ~120 tok/s sustained on an M5 Max. Needs our llama.cpp build (ready-built for macOS and Linux arm64).
- vLLM on one DGX Spark: 35B at 180.9 tok/s for 1 user vs 128.0 for NVIDIA's NVFP4, 17.4 vs 21.1 GiB, no significant accuracy difference on the core benchmarks.
- Trade-offs on each card: slower prompt processing, lower multilingual maths, and 4-bit GGUF stays closer to the original text.

https://huggingface.co/collections/Ternii/tr-quantisation

Hi Wai.

Given that Ternii translates standard FP16/BF16 weights down to variable trit densities (TR2.25 to TR3) without retraining, I wanted to reach out and share a highly relevant optimization from my pipeline that could directly address the multilingual and mathematical regressions noted in your model cards.

I introduced a Symbolic Lattice Algebraic Solver that uses an exact algebraic pinning strategy to drop net DC bias (mean error shift) within quantized blocks to absolute zero.

Because ternary integer codes are inherently symmetric, my DC pinning method can surely be used by your pipeline.

By forcing the residual error vector to be perfectly orthogonal to the intercept vector, you can eliminate the subtle, accumulating distortion that degrades deep reasoning tasks in low-bit states.

·

Hi CompressedGemma,

Thank you for the interest, the work you are working on sounds good, would you like to contact me on email hello@ternii.com? Hope to hear from you soon!

In this post