# PhysisML in ollama. # # python3 scripts/export_gguf.py \ # --checkpoint models/checkpoints/it/level_12/final_dreamed.pt \ # --tokenizer models/checkpoints/it/level_12/tokenizer.json \ # --output models/physisml.gguf # ollama create physisml -f Modelfile && ollama run physisml # # TEMPLATE is the bare prompt: the model was taught single-turn question/answer # lines, so any chat wrapper is out of distribution. Greedy because the margin # is thin and the published scores are measured that way. # # No stop strings: the model emits <|EOS|> on its own since the corpus started # carrying it (P(EOS) after a finished answer went from 0.00004 to 0.85-1.00). # It used to need `PARAMETER stop . ! ?` , which also ate the final punctuation. # # `ollama run` INTERACTIVELY sends the accumulated conversation back as context. # With a 128-token window and no multi-turn training, three exchanges are enough # to crowd out the question: 'cosa fa la mamma?' answers 'la mamma mangia' alone # and 'il cane' with the previous turns prepended. Use /clear, one-shot # `ollama run physisml "..."`, or the API — all three are stateless. FROM ./physisml.gguf TEMPLATE {{ .Prompt }} PARAMETER temperature 0 PARAMETER top_k 1 PARAMETER num_predict 48 PARAMETER num_ctx 128 PARAMETER repeat_penalty 1