AstheralPlus / gguf_runtime.py

Commit History

4 days ago

  1. Allow 4096-token replies and 110-second generation with 180-second quota reserve

    Verified signature
    7244dd9
  2. Add private GGUF upload, model selection and quota-guarded CUDA inference

    Verified signature
    b66be8b