amazing model
#1
by Cyronius - opened
this is really useful -- even beyond embeddings. I have an experimental agentic harness/model combo that I'm working on. It had need of an encoder to turn tool definitions and the user's request into vectors, because the next stage of the model doesn't understand english requests at all. I started with bge-small, then wrote my own. Neither of them had the level of intelligence I required. Then dropped in ternlight, and even without fine-tuning, it outperformed everything. This repo is out of date with my local, but you can see what I'm doing here: https://github.com/Cyronius/covenant-agent
thanks for the awesome work here. I hope to have an upload and something demoable at reasonable quality soon. When I get there, I'll post back.