Hugging Face's logo

Spaces:
EsoCode
/
hf-llm-api
Running

App Files Community
hf-llm-api

Commit History

  1. :hammer: [Test] Enable deployment in vercel Running

    Hansimov
    fdc9940

  1. :zap: [Enhance] Set min and max for top_p

    Hansimov
    64645f0

  2. :gem: [Feature] Add top_p and set 0.95 as default

    Hansimov
    403b8cf

  3. :gem: [Feature] Add use_cache parameter, and set default temperature to 0.5

    Hansimov
    e2b245b

  1. :boom: [Fix] Missing system message for original mistral models

    Hansimov
    395e196

  2. :zap: [Enhance] Display schema of /api/v1 for user-friendly compatibility

    Hansimov
    a2d3414

  3. :gem: [Feature] ChatAPIApp: New /readme route

    Hansimov
    6e2fad5

  4. :pencil: [Doc] New model, and prettify formats

    Hansimov
    37be019

  5. :zap: [Enhance] ChatAPIApp: Only include schema for non-prefix route

    Hansimov
    06a233d

  6. :gem: [Feature] New model enabled: nous-mixtral-8-7b

    Hansimov
    4a28ca5

  1. :zap: [Enhance] Align /models response with openai format

    Hansimov
    245d9fd

  1. :pencil: [Doc] Update available models

    Hansimov
    acbd8bf

  2. :zap: [Enhance] add /api/v1 prefix for hf banning and ui compatability

    Hansimov
    6d3fdc0

  3. :zap: [Enhance] Remove openchat-3.5 from available models

    Hansimov
    06c8d58

  1. :boom: [Fix] inputs_tokens + max_new_tokens must <= 32768

    Hansimov
    fa3bfb0

  2. :boom: [Fix] temperature must be strictly positive

    Hansimov
    eb00725

  1. :boom: [Fix] Error 500 when temperature is null

    Hansimov
    8ba223c

  2. :boom: [Fix] Error 422 when max_tokens is null

    Hansimov
    a54e7a6

  3. :zap: [Enhance] Auto calculate max_tokens if not set

    Hansimov
    1b9f698

  1. :zap: [Enhance] Remove leading whitespaces of first response

    Hansimov
    c95d47e

  2. :boom: [Fix] Ignore invalid HF Token

    Hansimov
    8ab8ca6

  3. :pencil: [Doc] Available models: More comments on dropped models

    Hansimov
    85354a9

  1. :pencil: [Doc] Readme: New models, api key and no-stream mode, and models to support

    Hansimov
    cec776f

  2. :gem: [Feature] MessageComposer: Support openchat-3.5, and generalize preprocessing stages

    Hansimov
    30421b7

  3. :gem: [Feature] MessageStreamer: Support stop sequence and auto removal

    Hansimov
    4ba2ca6

  4. :zap: [Enhance] Update available models description

    Hansimov
    c769be6

  5. :zap: [Enhance] Support provide api_key with os env HF_TOKEN

    Hansimov
    bc384a3

  6. :gem: [Feature] Support call hf api with api_key via HTTP Bearer

    Hansimov
    2da6968

  1. :gem: [Feature] Support no-stream mode with dict response

    Hansimov
    d2b20f2

  1. :boom: [Fix] Suppress ping message by increasing ping interval

    Hansimov
    489b65b

  1. :pencil: [Doc] Readme for features, and comments for references

    Hansimov
    e820e51

  2. :zap: [Enhance] Cleaner logger output

    Hansimov
    b96cef7

  3. :zap: [Enhance] New models: mistral-7b and openchat-3.5

    Hansimov
    e916990

  4. :zap: [Enhance] OSLogger: Re-wrap for better syntax check, and move stream log to debug

    Hansimov
    047008b

  5. :pencil: [Comment] References of requests params

    Hansimov
    395ee29

  6. :zap: [Enhance] Default models and max_new_tokens

    Hansimov
    6aa8b86

  1. :zap: [Enhance] API: Ensure temperature to be positive

    Hansimov
    3dfcb72

  2. :gem: [Feature] New ArgParser: Specify server ip, port and running mode

    Hansimov
    e28221f

  3. :boom: [Fix] Module apis not found

    Hansimov
    937bc45

  4. :gem: [Feature] New Github Actions: Sync to huggingface hub spaces

    Hansimov
    b1de8a0

  5. :pencil: [Doc] Readme: Features, deployment, api usage examples, and huggingface space configs

    Hansimov
    a16695d

  6. :gem: [Feature] New examples: chat with openai and post

    Hansimov
    f3b1386

  7. :gem: [Feature] Enable Docker deployment, and add requirements

    Hansimov
    5a836c3

  8. :gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call

    Hansimov
    3a09006

  9. :gem: [Feature] New MessageOutputer: Support Openai Stream format

    Hansimov
    eb3e513

  10. :gem: [Feature] New MessageStreamer: Enable requests inference api with requests

    Hansimov
    9f341cc

  11. :gem: [Feature] New enver: set_envs()

    Hansimov
    9bc229a

  12. :gem: [Feature] New MessageComposer: Merge and split messages in mixtral-instruct format

    Hansimov
    9e62d8e

  13. :gem: [Feature] New enver and logger system

    Hansimov
    5b642ff