Commit History

  1. trying fa2 again

    3831a9c
  2. trying again w/ torch in pre-requirements.txt

    484081f

  1. print message

    c48336f
  2. hf version doesn't like concurrency_limit

    e314ae3
  3. add link

    5b2ea5a
  4. back to this prompt

    89eb83f
  5. updated prompt

    8014467
  6. remove streamer - threads causing weird issues

    9dfa458
  7. limit responses

    f929d3a
  8. flash attention not happy camper

    82d8190
  9. trouble building w/ torch?

    99d00ea
  10. add flash attention, reorder examples

    bd17394
  11. add flash_attn

    39c14f3
  12. better chat rebuild, added system prompt, load_in_4bit

    22b3942

  1. Update README.md

    82777d3

  1. Update app.py

    1a6b000

  1. Updated settings

    lhl
    d259634
  2. switch to gradio

    lhl
    1def3a1

  1. try to fit on T4 (16GB RAM)

    lhl
    d387874
  2. swap models, examples, check for multigpu, example

    f00ac1d
  3. working streaming interface

    0e02ca5
  4. Update app.py

    lhl
    4a8282c
  5. Update app.py

    lhl
    45c171e
  6. switch to pipelines

    5835e21
  7. Update app.py

    lhl
    bc897bf
  8. Update requirements.txt

    lhl
    9cacdb6
  9. Update requirements.txt

    lhl
    fd7cabe
  10. Create requirements.txt

    lhl
    dada0c3
  11. testing pipelines

    lhl
    812f70a
  12. mostly working

    764f34e
  13. switch to gradio

    ba913e7
  14. first app

    c6bb1bc
  15. initial commit

    c8d8112