Commit History

  1. add 2 more models

    f7a541f
  2. apply new settings on duckduck search

    d9421eb
  3. tune llama paramters

    20484f3
  4. increase max_chars_per_result to 600

    1155897
  5. increase max results to 6 for better web search

    0c2fe1d
  6. increase ctx lenght to 2k

    9ba47d1
  7. increase timeout to 5min

    71d28c5
  8. Code simplification

    248f5a7
  9. Enable speculattive decoding

    a7fdfe6
  10. fix role disorder error in history

    06a162a
  11. Add internet search feature

    4e60755
  12. fix reasonning model's thought process display

    9d3ca6c
  13. bugfix

    4522453
  14. fix for multi-turn conv.

    6c77ec7
  15. bugfix for think tag handling

    14564aa
  16. support reasoning tag

    5db22d5
  17. add missing part of app.py

    afa19a3
  18. fix readme error due to short description length

    1bd76fd
  19. add 4 new models

    d554072
  20. fix error : ValueError: Conversation roles must alternate user/assistant/user/assistant

    3e4847c
  21. upgrade llamacpp version

    b6129d9
  22. fault-free model loading

    6e8312c
  23. add storage indicator

    cc91a1a
  24. improve model management

    0813164
  25. improve storage management

    37ee1f3
  26. fix yaml error

    3190ad6
  27. provide more models, secure memory usage

    cd26609
  28. increase context length to 2048

    56919fd
  29. update readme for 7b

    f746942
  30. switch to 7b model

    ea7adad

  1. switch to 3b q2 model

    88b1f39
  2. Update README.md

    Verified signature
    b5ee7db
  3. adjust thread numbers

    4443d46
  4. switch to 1.5b

    4d633ef
  5. fix model id

    8287454
  6. Add app.py & requirements.txt

    0ff6c39
  7. initial commit

    Verified signature
    ef1afaf