Hugging Face's logo

Spaces:
ColamanAI
/
hf-llm-api
Runtime error

App Files Community
hf-llm-api / apis

Commit History

  1. :zap: [Enhance] Add new model yi-1.5-34b, and remove unavailable models

    Hansimov
    b9a642a

  1. :gem: [Feature] New auth_api_key, and catch Exception and response

    Hansimov
    97b108f

  1. :zap: [Enhance] Use nous-mixtral-8x7b as default model

    Hansimov
    214fb7b

  2. :gem: [Feature] ChatAPIApp: Enable chat with pro models

    Hansimov
    06e3150

  1. :recycle: [Refactor] Rename gpt-3.5 to gpt-3.5-turbo

    Hansimov
    d36d623

  2. :gem: [Feature] Enable gpt-3.5 in chat_api

    Hansimov
    cd6b52a

  3. :recycle: [Refactor] Rename message_streamer to huggingface_streamer

    Hansimov
    3125c87

  4. :recycle: [Refactor] Configure api info with config.json

    Hansimov
    deca16d

  5. :recycle: [Refactor] Use tclogger, and configure envs better

    Hansimov
    babcd78

  1. :recycle: [Refactor] Move AVAILABLE_MODELS(_DICTS) to constants

    Hansimov
    40ba0ea

  2. :gem: [Feature] Support new model: openchat-3.5-0106

    Hansimov
    9f5d69c

  1. :gem: [Feature] New model enabled: gemma-7b

    Hansimov
    77b5a47

  1. :gem: [Feature] Add top_p and set 0.95 as default

    Hansimov
    403b8cf

  2. :gem: [Feature] Add use_cache parameter, and set default temperature to 0.5

    Hansimov
    e2b245b

  1. :zap: [Enhance] Display schema of /api/v1 for user-friendly compatibility

    Hansimov
    a2d3414

  2. :gem: [Feature] ChatAPIApp: New /readme route

    Hansimov
    6e2fad5

  3. :zap: [Enhance] ChatAPIApp: Only include schema for non-prefix route

    Hansimov
    06a233d

  4. :gem: [Feature] New model enabled: nous-mixtral-8-7b

    Hansimov
    4a28ca5

  1. :zap: [Enhance] Align /models response with openai format

    Hansimov
    245d9fd

  1. :zap: [Enhance] add /api/v1 prefix for hf banning and ui compatability

    Hansimov
    6d3fdc0

  2. :zap: [Enhance] Remove openchat-3.5 from available models

    Hansimov
    06c8d58

  1. :boom: [Fix] Error 422 when max_tokens is null

    Hansimov
    a54e7a6

  2. :zap: [Enhance] Auto calculate max_tokens if not set

    Hansimov
    1b9f698

  1. :boom: [Fix] Ignore invalid HF Token

    Hansimov
    8ab8ca6

  1. :zap: [Enhance] Update available models description

    Hansimov
    c769be6

  2. :zap: [Enhance] Support provide api_key with os env HF_TOKEN

    Hansimov
    bc384a3

  3. :gem: [Feature] Support call hf api with api_key via HTTP Bearer

    Hansimov
    2da6968

  1. :gem: [Feature] Support no-stream mode with dict response

    Hansimov
    d2b20f2

  1. :boom: [Fix] Suppress ping message by increasing ping interval

    Hansimov
    489b65b

  1. :zap: [Enhance] New models: mistral-7b and openchat-3.5

    Hansimov
    e916990

  2. :zap: [Enhance] Default models and max_new_tokens

    Hansimov
    6aa8b86

  1. :gem: [Feature] New ArgParser: Specify server ip, port and running mode

    Hansimov
    e28221f

  2. :gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call

    Hansimov
    3a09006