ziyuzhou02 commited on
Commit
7ce86b7
Β·
verified Β·
1 Parent(s): e086bda

Deploy Space: update src

Browse files
Files changed (1) hide show
  1. src/about.py +5 -3
src/about.py CHANGED
@@ -5,8 +5,8 @@ INTRODUCTION_TEXT = """
5
  real-world data** with **zero-shot API inference** via [TSFM.ai](https://tsfm.ai/).
6
  Following [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the leaderboard
7
  reports **absolute metric values** and **per-dataset ranks**. The Overall tab also reports
8
- the cumulative **up-to-now live result** with MSE, RMSE, MAPE, quantile CRPS, RTG,
9
- temporal Stability, Kendall Improvement, Average Rank, Win Rate, and Elo. The
10
  **GIFT-style Aggregates** tab provides Seasonal-Naive-normalized MSE, CRPS,
11
  and mean CRPS rank grouped by actual prediction length, domain, and frequency. Each
12
  subsequent domain tab retains the original absolute per-dataset results.
@@ -41,7 +41,9 @@ on future live releases.
41
  - **RTG** β€” normalized real-time MSE gain over causal Seasonal-Naive (higher is better)
42
  - **Stability** β€” standard deviation of release-level MSE (lower is better)
43
  - **Improvement** β€” Kendall trend statistic over release-level MSE (more negative is better)
44
- - **Average Rank / Win Rate / Elo** β€” paired summaries over shared future releases
 
 
45
  - **RankScore** β€” Elo-style aggregate from per-dataset MSE and CRPS ranks (higher is better)
46
  - **MSE_Rank** / **CRPS_Rank** β€” per-dataset rank (lower is better)
47
  - **Grouped MSE / CRPS** β€” geometric mean after per-configuration normalization against
 
5
  real-world data** with **zero-shot API inference** via [TSFM.ai](https://tsfm.ai/).
6
  Following [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the leaderboard
7
  reports **absolute metric values** and **per-dataset ranks**. The Overall tab also reports
8
+ the latest overall snapshot plus full 24-hour, 7-day, and 30-day metric tables and
9
+ dataset-balanced **pairwise historical rankings** over shared releases. The
10
  **GIFT-style Aggregates** tab provides Seasonal-Naive-normalized MSE, CRPS,
11
  and mean CRPS rank grouped by actual prediction length, domain, and frequency. Each
12
  subsequent domain tab retains the original absolute per-dataset results.
 
41
  - **RTG** β€” normalized real-time MSE gain over causal Seasonal-Naive (higher is better)
42
  - **Stability** β€” standard deviation of release-level MSE (lower is better)
43
  - **Improvement** β€” Kendall trend statistic over release-level MSE (more negative is better)
44
+ - **Pairwise Win Rate** β€” dataset-balanced MSE/CRPS wins over shared future releases;
45
+ official ranks require sufficient shared releases, datasets, time span, opponents,
46
+ and membership in the main comparison component
47
  - **RankScore** β€” Elo-style aggregate from per-dataset MSE and CRPS ranks (higher is better)
48
  - **MSE_Rank** / **CRPS_Rank** β€” per-dataset rank (lower is better)
49
  - **Grouped MSE / CRPS** β€” geometric mean after per-configuration normalization against