Commit History

  1. Remove intro text

    Martin Jurkovic
    49eec5b
  2. Update dataset names

    Martin Jurkovic
    7891337
  3. Remove "demo" from name

    Martin Jurkovic
    6daea60
  4. Update method names

    Martin Jurkovic
    0a65444
  5. Code cleanup

    Martin Jurkovic
    9446fe5
  6. Update cardinality score and C2ST naming

    Martin Jurkovic
    56140d5
  7. Update citation

    Martin Jurkovic
    5acb894
  8. Update about section

    Martin Jurkovic
    a41edef
  9. Update leaderboard

    Martin Jurkovic
    5909269

  1. Add citation

    Martin Jurkovic
    11ddffe
  2. Add single column leaderboard

    Martin Jurkovic
    370d5a0
  3. Allow missing metric

    Martin Jurkovic
    385e405
  4. Add singletable metrics

    Martin Jurkovic
    5f7fcf4
  5. Add first version of syntherela leaderboard

    Martin Jurkovic
    3b86dfc

  1. Apply CSS to the model name column (#14)⁠

    clefourrier +1: t0-0 HF Staff
    fc32710

  1. os.isfile --> os.path.isfile (#12)⁠

    clefourrier +1: meg HF Staff
    abf5a88

  1. Minimal edit for directory structure assumption. (#11)⁠

    clefourrier +1: meg HF Staff
    1e9865f

  1. Update src/display/utils.py

    clefourrier HF Staff
    f867bb5

  1. Update src/envs.py

    clefourrier HF Staff
    30da67d

  1. added leaderboard component to simplify main script

    Clémentine
    4103566

  1. doc

    Clémentine
    5fe3b95
  2. simplified the template

    Clémentine
    bbd72ab

  1. CPU, TOKEN, env variables (#4)⁠

    clefourrier +1: meg HF Staff
    4d3bd61

  1. Update src/submission/check_validity.py

    clefourrier HF Staff
    0767925

  1. made token a requirement

    Clémentine
    0df3db8
  2. test

    Clémentine
    16837ad

  1. fix

    Clémentine
    6be74f5
  2. removed quantization to simplify

    Clémentine
    32b707a
  3. now with a functionning backend

    Clémentine
    01ea22b

  1. update read

    Clémentine
    4f3c2a8
  2. fixs

    Clémentine
    91e8a06
  3. updated leaderboard

    Clémentine
    29546b4
  4. Simplified leaderboard v0

    Clémentine
    2a860f6
  5. simplified some parts of the code + updated requirements

    Clémentine
    3d8dbe8
  6. Added check on tokenizer to prevent submissions which won't run

    Clémentine
    06b0c2d
  7. Update benchmark count and fix typo (`inetuning->finetuning`) (#395)⁠

    clefourrier +1: alvarobartt HF Staff
    71f3e62

  1. fix order of request file vs request file list, to avoid resubmitting issues

    Clémentine
    54eae7e
  2. cache

    Clémentine
    a983535
  3. update for caching

    Clémentine
    29efd58
  4. add model architecture as column

    Clémentine
    1ba1924
  5. Simplify About

    Clémentine
    a6eaff8

  1. Refactor 2 - added plotting back⁠

    Clémentine
    ceb2102
  2. fix value error in param size

    Clémentine
    76a47ce
  3. Fix requirements for mistral models - to change once transformers gets updated.⁠

    Clémentine
    c875275

  1. fix col width

    Clémentine
    16a06c4
  2. refacto style + rate limit

    Clémentine
    3b3db42
  3. Fix TruthfulQA NaN scores to 0

    Clémentine
    992b592

  1. refacto part 1

    Clémentine
    8b1f7a0

  1. add new evals to the leaderboard

    Nathan Habib
    2a73df7

  1. token for checking gated base models

    Clémentine
    8f3a3ec