Commit History
-
Merge branch #jbnayahu/bluebench' into 'ibm-research/bluebench'
Verified signature8524940 -
Add support for model display names
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>44caf2c
-
update to ibm-research org
Verified signature45bc88b
-
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>a6a0e86
-
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>3ee3ca7
-
Updated execution guide
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>0650525
-
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>bc7425f
-
Ignore non-json files
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>5dc0fc8
-
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>382809d
-
Cleanup
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>460efe2
-
Remove model links.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>6066b5d -
Switch to read local results only.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>3a4f28e
-
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>57da4d5 -
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>98eb96a -
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>b2373ad
-
updated adout content
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>6ff409b
-
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>50cdce4
-
Updated list of bluebench tasks (with contributions by omer.bnayahu@gmail.com)
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>ab870dd -
.
Unverified signatureSigned-off-by: Jonathan Bnayahu <bnayahu@il.ibm.com>d83a397
-
Apply CSS to the model name column (#14)
- Apply CSS to the model name column (e5f0365777f9f167164b69a0afcb561fe083b075) Co-authored-by: Takumi Okamoto <t0-0@users.noreply.huggingface.co>fc32710
-
os.isfile --> os.path.isfile (#12)
- os.isfile --> os.path.isfile (5b12d1ec95fbe51d25ef7875807960b493df2a46) Co-authored-by: Margaret Mitchell <meg@users.noreply.huggingface.co>abf5a88
-
Minimal edit for directory structure assumption. (#11)
- Minimal edit for directory structure assumption. (6513f2eccd9fc6e003944c90c2ada29a2576a10b) Co-authored-by: Margaret Mitchell <meg@users.noreply.huggingface.co>1e9865f
-
Update src/display/utils.py
f867bb5
-
Update src/envs.py
30da67d
-
added leaderboard component to simplify main script
Clémentine4103566
-
doc
Clémentine5fe3b95 -
simplified the template
Clémentinebbd72ab
-
CPU, TOKEN, env variables (#4)
- Suggesting change for accidentally hard-coded environment variable (8d208b520eea9413d6513b14ce2198e0fe0dca18) - Adds CPU/Float32 support; adds user access Token passing; fixes hard-coded environment variable. (53820335700fc97ce312f7f9fbc7a36325e0aef9) - Just trying to open a PR without access to the org through the command line. (df50a1a673c11d256fdc3d782644a9b1fea0c27a) - Creating branch of changes through command line. (d3ce128251987516e6d2c37d6c2c85db6e9a7934) - Test (90f11e5b611eb9474f877b99c832a5bc7c30f59a) - Remove tmp file (67d160e129e6b3ccdb2cb54ba6c161ce82ff7501) - Undo 1 change; keeping 'eval-queue' hard-coded. (5866f269eb67d1d65c2839651bf7be1ff7e245a6) - Undo 1 change; keeping 'eval-queue' hard-coded. (1e36a73ac445fc2cc60200b39a5f31361107a283) Co-authored-by: Margaret Mitchell <meg@users.noreply.huggingface.co>4d3bd61
-
Update src/submission/check_validity.py
0767925
-
made token a requirement
Clémentine0df3db8 -
test
Clémentine16837ad
-
fix
Clémentine6be74f5 -
removed quantization to simplify
Clémentine32b707a -
now with a functionning backend
Clémentine01ea22b
-
update read
Clémentine4f3c2a8 -
fixs
Clémentine91e8a06 -
updated leaderboard
Clémentine29546b4 -
Simplified leaderboard v0
Clémentine2a860f6 -
simplified some parts of the code + updated requirements
Clémentine3d8dbe8 -
Added check on tokenizer to prevent submissions which won't run
Clémentine06b0c2d -
Update benchmark count and fix typo (`inetuning->finetuning`) (#395)
- Update benchmark count and fix typo (`inetuning->finetuning`) (cdeea55b7621c0b1fa7515a40bf2fb50df62d5d7) Co-authored-by: Alvaro Bartolome <alvarobartt@users.noreply.huggingface.co>71f3e62
-
fix order of request file vs request file list, to avoid resubmitting issues
Clémentine54eae7e -
cache
Clémentinea983535 -
update for caching
Clémentine29efd58 -
add model architecture as column
Clémentine1ba1924 -
Simplify About
Clémentinea6eaff8
-
Refactor 2 - added plotting back
ClémentineOnly takes into account last submissions, but we have no way to go back at eval date apart from loading info from git commit of results files. Also updated speed with gradio concurrency limit paramceb2102 -
fix value error in param size
Clémentine76a47ce -
Fix requirements for mistral models - to change once transformers gets updated.
ClémentineWe need hf_hub >= 0.18 for collections, transformers >= 4.34 for mistral, and both depend on uncompatible versions of tokenizers. Installing transformers from a fork for nowc875275
-
fix col width
Clémentine16a06c4