Rune-Goblin / deploy

Commit History

  1. fix: update smoke test command in modal_vision_gguf-L4.py for clarity

    Unverified signature
    1facd7b
  2. feat: add new GGUF vision model server implementation and update smoke test configuration

    Unverified signature
    597cd8b
  3. feat: add GGUF vision model server and smoke test for endpoint

    Unverified signature
    945a6a6
  4. feat: update app name to include GPU support and enable GPU snapshotting

    Unverified signature
    2f8fbb0

  1. feat: update GPU type to L4 and pin vLLM version to 0.22.0 in modal_vision.py

    Unverified signature
    ea83b4c
  2. feat: add modal_vision.py to serve Rune Goblin vision model on Modal

    Unverified signature
    90465af