distinct / distinct_agent /server_runner.py

Commit History

Give the grammar one branch per tool, and say out loud when llama.cpp refuses it
41c2320

User1342 commited on

Hold the sampler to the action schema, so a small model calls the tool instead of describing it
7a2798b

User1342 commited on

Measure the GPU offload instead of estimating it, and keep the development scratch out of the repository
9f85661

User1342 commited on

Offload what the card can hold, survive a dropped connection, and stop sending prompts the model cannot read
95200a7

User1342 commited on

initial commit
2aa8b3a

aaxaxax commited on