Give the grammar one branch per tool, and say out loud when llama.cpp refuses it 41c2320 User1342 commited on Sep 2
Hold the sampler to the action schema, so a small model calls the tool instead of describing it 7a2798b User1342 commited on Sep 2
Measure the GPU offload instead of estimating it, and keep the development scratch out of the repository 9f85661 User1342 commited on Sep 2
Offload what the card can hold, survive a dropped connection, and stop sending prompts the model cannot read 95200a7 User1342 commited on Sep 2