Commit History

  1. add storage indicator

    cc91a1a
  2. improve model management

    0813164
  3. improve storage management

    37ee1f3
  4. fix yaml error

    3190ad6
  5. provide more models, secure memory usage

    cd26609
  6. increase context length to 2048

    56919fd
  7. update readme for 7b

    f746942
  8. switch to 7b model

    ea7adad

  1. switch to 3b q2 model

    88b1f39
  2. Update README.md

    Verified signature
    b5ee7db
  3. adjust thread numbers

    4443d46
  4. switch to 1.5b

    4d633ef
  5. fix model id

    8287454
  6. Add app.py & requirements.txt

    0ff6c39
  7. initial commit

    Verified signature
    ef1afaf