Commit History

  1. flagging AIDC-ai-business models

    Nathan Habib
    2ef734a

  1. updated caching to include size of models

    Clémentine
    5933808
  2. Updated model info to get number of parameters in almost all cases, even without safetensors

    Clémentine
    301c384

  1. Fix merge

    Nathan Habib
    5da3025
  2. Merge branch 'main' of https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

    Nathan Habib
    bc44e71
  3. use cache for model metadata

    Nathan Habib
    0799cf8
  4. fixes display for model params that are 0

    Clémentine
    6e79cea
  5. type updated

    Clémentine
    1d49827

  1. fix list of finished models to include models waiting for new eval

    Nathan Habib
    eed1ccd

  1. Fix sorting of model files by date, added extra fields if we need the info later

    Clémentine
    5228101

  1. Added rate limiting system to the leaderboard to prevent abuse

    Clémentine
    3777786

  1. flagged gaodrew/gaodrew-gorgonzola-13b

    clefourrier HF Staff
    77c51de
  2. fix bug in metadata display

    Clémentine
    e0b891a
  3. fix of the model type display

    Clémentine
    9e0f1e6
  4. Update src/display_models/model_metadata_type.py⁠

    clefourrier HF Staff
    6d1329a

  1. Flagging TigerResearch/tigerbot-7b-sft-v1

    clefourrier HF Staff
    ff09f56

  1. fix submit different revisions

    Clémentine
    49a4ed6

  1. Flagging Fredithefish/ReasonixPajama-3B-HF

    clefourrier HF Staff
    bbd101d

  1. Update src/display_models/model_metadata_type.py⁠

    clefourrier HF Staff
    8541f99

  1. Cleaned and refactored the code, improved filtering, added selection of deleted models

    Clémentine
    8c49cb6

  1. do not display models with an empty metric result

    Clémentine
    ba25d90

  1. Set to 0 if metric not found (#220)⁠

    osanseviero +1: Xenova
    c6b775f
  2. Add a model size filter ✨ (#218)⁠

    clefourrier +1: multimodalart HF Staff
    d2179b0

  1. added 'forbidden models' submission, to allow orgs to request their models to not be submitted in case of contamination

    Clémentine
    ed1fdef
  2. simplified header text

    Clémentine
    6fefae4
  3. Flagged model per discussion

    Clémentine
    6e039c4
  4. removed need for tokens in the leaderboard + removed skull in flagged models

    Clémentine
    a40c960
  5. Adding flagging systemi, removing changelog

    Clémentine
    699e8ff

  1. Adding link to detailed results and evals (#203)⁠

    clefourrier HF Staff
    6254b87

  1. Update src/auto_leaderboard/model_metadata_type.py⁠

    clefourrier HF Staff
    1108259

  1. Update src/auto_leaderboard/model_metadata_type.py (#199)⁠

    clefourrier +1: stellaathena HF Staff
    0ba9d60
  2. Small update and reorg of text (#198)⁠

    clefourrier HF Staff
    d313dbd
  3. look at model info if not in request file

    Clémentine
    a33e66d

  1. typo fix

    Clémentine
    1b7afb7
  2. Updated model metadata according to #162

    Clémentine
    a5023e4
  3. Re-labelled model types (#162)⁠

    clefourrier +1: jaspercatapang HF Staff
    16a8ecc
  4. clarified how to get MMLU average

    Clémentine
    6095833

  1. rm lighteval sha from id

    Clémentine
    2bb5ded
  2. added precision

    Clémentine
    6eaad72

  1. fix rounding

    Clémentine
    d350941
  2. corrected display of symbols

    Clémentine
    35763fc

  1. Merge branch 'main' into link_requests_and_results

    Nathan Habib
    a79408c
  2. get model type info from request file

    Nathan Habib
    80f4eeb

  1. added more nuance in ft models

    Clémentine
    95f85ed
  2. Update src/auto_leaderboard/model_metadata_type.py (#159)⁠

    clefourrier +1: stellaathena HF Staff
    eedc0f1
  3. corrected finetuned mentions

    Clémentine
    0f4a719

  1. Update newcomers (#153)⁠

    multimodalart HF Staff
    d7daa68
  2. look for model type in request file

    Nathan Habib
    d295afa

  1. Update new model types (#150)⁠

    multimodalart HF Staff
    9977ce1
  2. Fix Typo (#144)⁠

    clefourrier +1: aliabid94 HF Staff
    6ddee3c