Commit History

  1. Add markdown rendering (marked.js + highlight.js)

    Verified signature
    d6e8ac2
  2. Add chat UI (mirror 27B space)

    Verified signature
    8948dd0
  3. Switch to Q8_K_P, add chat.html

    Verified signature
    f0b913c
  4. Update MODEL_PATH to Q8_K_P, add threading + reasoning flags

    Verified signature
    c9e75fc
  5. Update proxy to match 27B space (chat UI, hop-by-hop headers, api-info)

    Verified signature
    f348ff6
  6. Update title to Q8, update README

    Verified signature
    f1242e0

  1. Use wget instead of deprecated huggingface-cli

    Verified signature
    1322b24
  2. Fix pip install with --break-system-packages for Ubuntu 24.04

    Verified signature
    719a2cd

  1. Set app_port to 8000

    Verified signature
    e80d9f2
  2. Use local pre-downloaded model and start uvicorn proxy

    Verified signature
    86793e1
  3. Robust proxy with lifespan-based llama-server readiness check

    Verified signature
    9cc8b76
  4. Pre-download model in Dockerfile and fix proxy startup

    Verified signature
    c6da401

  1. Upload Dockerfile

    Verified signature
    17634fa
  2. Upload Dockerfile

    Verified signature
    c40fcb8
  3. Upload Dockerfile

    Verified signature
    e82ef45
  4. Upload entrypoint.sh

    Verified signature
    5c72459
  5. Upload README.md

    Verified signature
    4d2738e
  6. Upload proxy.py

    Verified signature
    dbd8120
  7. Upload Dockerfile

    Verified signature
    1bbe746

  1. Update to 131K context with parallel 1

    Verified signature
    86549b6
  2. Upload README.md

    Verified signature
    667e650
  3. Fix Dockerfile - use ENTRYPOINT with correct binary path

    Verified signature
    83b881d
  4. Add README with API docs

    Verified signature
    ae1e39d
  5. Add Dockerfile for llama.cpp server

    Verified signature
    3250d9f
  6. initial commit

    Verified signature
    83eef65