inference / Dockerfile

Commit History

  1. update custom llama cpp support

    5c0d1a4

  1. some experimental

    57426fb
  2. Add LangSearch web search tool for small model knowledge augmentation

    c459436
  3. Copy llama.cpp shared libraries into runtime image

    18a5c35
  4. Speed up build (ccache) and fix /data permissions: create appuser and run downloader/server as appuser

    c5437e1
  5. Use Python venv in runtime to avoid PEP 668 pip install error

    3d3f603
  6. Fix llama.cpp math compiler flags

    85f2f8b
  7. Fix llama.cpp Debian slim build deps

    63aa2ad
  8. Add optimized llama.cpp CPU inference backend

    8ebf335