- Clone llama.cpp shallow repo instead of downloading single script;
its bundled gguf-py is always in sync with convert_hf_to_gguf.py,
fixing MistralTokenizerType import error against PyPI gguf 0.17.1
- Add PYTHONPATH override so convert picks up llama.cpp's gguf-py
- Modelfile FROM now points to 7b-q4_k_m.gguf (4683 MB, Q4_K_M)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Add Ollama Modelfile for soci-agent local deployment
Supports two modes:
- Option A (commented): fine-tuned GGUF exported from Linux/Colab
- Option B (default): qwen2.5:0.5b from Ollama registry with Soci system prompt
Run: ollama create soci-agent -f Modelfile
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
