nithin
nithin12342
AI & ML interests
Aspiring Software Developer | 🌐 Full-Stack Explorer | 🤖 AI Engineer-in-Progress Passionate about building scalable apps, automating workflows, and craft
Recent Activity
updated a collection about 3 hours ago
Efficient ai reacted to mike-ravkine's post with 🔥 2 days ago
I went into this expecting to find a ~Q2 garbage dumpster but https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf is a slick feat of QAT engineering.
It is weaker then FP16 on a handful of tasks where quants usually degrade, as per their own paper the loss is "concentrated on sustained chains of reasoning / agentic" and in ReasonScape this bites on Sort, Shuffle and Dates, but counter-acting this are some noticeable improvements to thinking length without accuracy loss on several other tasks (Shapes, Cars).
I haven't had a chance to run the Binary yet, but PQ2 + Bonsai QAT are confirmed to be pretty darn impressive. upvoted a paper 3 days ago
CoLT: Teaching Multi-Modal Models to Think with Chain of Latent ThoughtsOrganizations
