Spaces:
Running
Running
Commit History
-
Add `frozen=True` to dataclasses
Verified signatureThis should hopefully fix the crash which currently happens when opening the app. I am unable to test locally due to a 403 error.0c108e8
-
Separate zero-shot & few-shot results.
17ca318
-
ACL 2025 paper citation.
d088b76
-
Model output submission.
236bb17
-
Hugging Face Hub check fix for PEFT models.
f171a05 -
Field customisations.
2caaddf
-
Leaderboard configuration & descriptions.
1b780de
-
Apply CSS to the model name column (#14)
- Apply CSS to the model name column (e5f0365777f9f167164b69a0afcb561fe083b075) Co-authored-by: Takumi Okamoto <t0-0@users.noreply.huggingface.co>fc32710
-
os.isfile --> os.path.isfile (#12)
- os.isfile --> os.path.isfile (5b12d1ec95fbe51d25ef7875807960b493df2a46) Co-authored-by: Margaret Mitchell <meg@users.noreply.huggingface.co>abf5a88
-
Minimal edit for directory structure assumption. (#11)
- Minimal edit for directory structure assumption. (6513f2eccd9fc6e003944c90c2ada29a2576a10b) Co-authored-by: Margaret Mitchell <meg@users.noreply.huggingface.co>1e9865f
-
Update src/display/utils.py
f867bb5
-
Update src/envs.py
30da67d
-
added leaderboard component to simplify main script
Clémentine4103566
-
doc
Clémentine5fe3b95 -
simplified the template
Clémentinebbd72ab
-
CPU, TOKEN, env variables (#4)
- Suggesting change for accidentally hard-coded environment variable (8d208b520eea9413d6513b14ce2198e0fe0dca18) - Adds CPU/Float32 support; adds user access Token passing; fixes hard-coded environment variable. (53820335700fc97ce312f7f9fbc7a36325e0aef9) - Just trying to open a PR without access to the org through the command line. (df50a1a673c11d256fdc3d782644a9b1fea0c27a) - Creating branch of changes through command line. (d3ce128251987516e6d2c37d6c2c85db6e9a7934) - Test (90f11e5b611eb9474f877b99c832a5bc7c30f59a) - Remove tmp file (67d160e129e6b3ccdb2cb54ba6c161ce82ff7501) - Undo 1 change; keeping 'eval-queue' hard-coded. (5866f269eb67d1d65c2839651bf7be1ff7e245a6) - Undo 1 change; keeping 'eval-queue' hard-coded. (1e36a73ac445fc2cc60200b39a5f31361107a283) Co-authored-by: Margaret Mitchell <meg@users.noreply.huggingface.co>4d3bd61
-
Update src/submission/check_validity.py
0767925
-
made token a requirement
Clémentine0df3db8 -
test
Clémentine16837ad
-
fix
Clémentine6be74f5 -
removed quantization to simplify
Clémentine32b707a -
now with a functionning backend
Clémentine01ea22b
-
update read
Clémentine4f3c2a8 -
fixs
Clémentine91e8a06 -
updated leaderboard
Clémentine29546b4 -
Simplified leaderboard v0
Clémentine2a860f6 -
simplified some parts of the code + updated requirements
Clémentine3d8dbe8 -
Added check on tokenizer to prevent submissions which won't run
Clémentine06b0c2d -
Update benchmark count and fix typo (`inetuning->finetuning`) (#395)
- Update benchmark count and fix typo (`inetuning->finetuning`) (cdeea55b7621c0b1fa7515a40bf2fb50df62d5d7) Co-authored-by: Alvaro Bartolome <alvarobartt@users.noreply.huggingface.co>71f3e62
-
fix order of request file vs request file list, to avoid resubmitting issues
Clémentine54eae7e -
cache
Clémentinea983535 -
update for caching
Clémentine29efd58 -
add model architecture as column
Clémentine1ba1924 -
Simplify About
Clémentinea6eaff8
-
Refactor 2 - added plotting back
ClémentineOnly takes into account last submissions, but we have no way to go back at eval date apart from loading info from git commit of results files. Also updated speed with gradio concurrency limit paramceb2102 -
fix value error in param size
Clémentine76a47ce -
Fix requirements for mistral models - to change once transformers gets updated.
ClémentineWe need hf_hub >= 0.18 for collections, transformers >= 4.34 for mistral, and both depend on uncompatible versions of tokenizers. Installing transformers from a fork for nowc875275
-
fix col width
Clémentine16a06c4 -
refacto style + rate limit
Clémentine3b3db42 -
Fix TruthfulQA NaN scores to 0
Clémentine992b592
-
refacto part 1
Clémentine8b1f7a0
-
add new evals to the leaderboard
Nathan Habib2a73df7
-
token for checking gated base models
Clémentine8f3a3ec
-
Fix BibTex author ordering (#342)
- Fix BibTex author ordering (2edeb5ab568075636e23b5ecfd11c297c4425330) Co-authored-by: Lewis Tunstall <lewtun@users.noreply.huggingface.co>bdabf34 -
fix disapearing models
Nathan Habib3817014
-
Merge branch 'main' of https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Nathan Habibcc5299c -
fix model display when fething metadata
Nathan Habib95eba41
-
reorg to simplify nav in code base
Clémentinec0da33d
-
should update index in collection as it goes
Clémentine238e793 -
Creating functions for plotting results over time (#295)
- Creating functions for plotting results over time (319b0b7936fb504f9017c3c4ce9f10466ad55202) - Added graphs tab (1d6addaf6050a163efb58af4eb6bc6346adfeaac) - Changed to Plotly for interactive graphs! (65fc294da6b2789e87fd20d916732b3f91391843) - Updated main to include title in the graph function parameters (e872e8a162076990e64ef65a05611bc0d042848a) - Added y-axis range to make graph more aesthetically pleasing (02700b60517a1e28b27cdc57ffea040f9e6cf830) - Fixing bug that messes up the order of models (75297e78c74b787229e69009b2ab9dfd3a339e20) - Updated app.py to fix conflict and changed name of tab per Clémentine Fourrier's request (8e47868563c084edcd00b0f8cb696872404003b1) - Updated plotted models to exclude flagged models (36bf409eccd16b3db35bd48882cf4b27cb73c832) - Merge branch 'main' into pr/295 (81c331307b066857e513829a0ab9372421e315ca) Co-authored-by: Christopher Canal <chriscanal@users.noreply.huggingface.co>7e8ac0e
