Read model metadata from the fev repo instead of a local dict

Model attributes (organization, link, type, zero-shot, commercial use) now
come from benchmarks/fev_bench/models.yaml in autogluon/fev, where the
submitter declares them, so adding a model to the leaderboard is a pure
data refresh: `uv run python save_tables.py [commit]`.

- save_tables.py fetches one fev commit and takes results, metadata and
compute logic from that single checkout (results and compute could
previously come from different commits). Records the commit in
tables/source.json and vendors the compute module into src/vendor/.
- The sidebar lets readers include `system` and `closed-api` models, which
are excluded by default. Win rate and skill score depend on the included
set, so the app now computes leaderboard/pairwise per (task group, metric,
included types) and caches them, replacing the 17 precomputed
tables/<group>/ directories.
- Models flagged `hidden` in models.yaml are dropped before metrics are
computed, matching the paper figures; previously they were dropped after,
so they influenced the win rates on display.
- Adds Commercial use and Type columns to the leaderboard.

.claude/skills/add-model/SKILL.md

@@ -1,64 +1,46 @@
 ---
 name: add-model
-description: Add a new forecasting model to the fev-bench leaderboard. Use when asked to add/register a model, regenerate tables for a new model, or when given a model name plus its HuggingFace/org/type metadata. Regenerates tables from the latest autogluon/fev commit, adds the MODEL_CONFIG entry, commits, and previews the app.
+description: Refresh the fev-bench leaderboard after a model was merged into autogluon/fev. Use when asked to add/register a model, pull in new results, or regenerate the leaderboard tables. Regenerates everything from a fev commit, commits, and previews the app.
 ---
 
 # Add a new model to the leaderboard
 
-Adds a model to the fev-bench leaderboard. The model's results must already be
-merged into `autogluon/fev` (its rows appear in the benchmark result CSVs) —
-this skill pulls those in and wires up the display metadata.
+Models reach the leaderboard by being merged into `autogluon/fev`: their results CSV lands in
+`benchmarks/fev_bench/results/` and their display metadata (organization, link, model type,
+zero-shot, commercial use) in `benchmarks/fev_bench/models.yaml`. This repo holds no model metadata
+of its own, so adding a model is a data refresh.
 
-See commit `7924574` ("Add TimesFM-3.0") for a canonical example.
+## Inputs
 
-## Inputs (collect from the user)
+- **commit**: `autogluon/fev` commit SHA or branch to generate from. Default `main`.
 
-Required:
-- **model_name**: the key used in the benchmark summaries (matches `model_name`
-  in the fev result CSVs), e.g. `timesfm-3`. This is the dict key in `MODEL_CONFIG`.
-- **url**: HuggingFace repo id (e.g. `google/timesfm-3.0-pytorch`) for pretrained
-  models, or a project URL for task-specific/statistical models.
-- **organization**: e.g. `Google`. Use `—` for library-provided baselines.
-
-Optional (with sensible defaults):
-- **is_zero_shot**: `True` for pretrained/zero-shot models, `False` otherwise. Default `True`.
-- **model_type**: one of `pretrained`, `task-specific`, `statistical`. Default `pretrained`.
-- **display_name**: optional 5th tuple element, only when the auto-derived
-  display name from the key is wrong (see `citras-fm` → `CITRAS-FM`).
-- **commit**: `autogluon/fev` commit SHA or branch to regenerate from. Default `main`.
-
-If the user hasn't given the required fields, ask for them before proceeding.
+Nothing else. If the user supplies metadata (org, URL, type), it belongs in `models.yaml` in the fev
+repo, not here — say so and point them at `models/README.md` there.
 
 ## Steps
 
-1. **Regenerate tables** from the target commit:
+1. **Regenerate** everything from the target commit:
    ```bash
    uv run python save_tables.py [commit]
    ```
-   (omit `[commit]` to use `main`). This rewrites `tables/**` including the new
-   model's rows. Confirm the run reported the expected number of tasks and no errors.
+   This rewrites `tables/**` and re-vendors `src/vendor/fev_bench_compute.py`. It fails loudly if a
+   results file has no `models.yaml` entry, so a missing-metadata problem surfaces here.
 
-2. **Add the MODEL_CONFIG entry** in `src/utils.py`. Add one line to the
-   `MODEL_CONFIG` dict under the appropriate section comment (create a new
-   comment group if the org is new). The tuple is
-   `(url, organization, is_zero_shot, model_type[, display_name])`:
-   ```python
-   "timesfm-3": ("google/timesfm-3.0-pytorch", "Google", True, "pretrained"),
+2. **Verify**: `git status` should show `tables/**` (and possibly `src/vendor/**`) changed. Check
+   `tables/source.json` records the expected commit, and that the new model appears in
+   `tables/models.csv` and `tables/summaries.csv`:
+   ```bash
+   cut -d, -f1 tables/models.csv
    ```
-   Keep the 4-tuple form unless a `display_name` override is needed.
-
-3. **Verify** the model shows up: `git status` should show `src/utils.py` plus
-   many `tables/**` CSVs changed. The new `model_name` should be present in
-   `tables/full/leaderboard_SQL.csv`.
 
-4. **Commit** with a message matching the existing convention:
+3. **Commit**:
    ```bash
    git add -A && git commit -m "Add <ModelDisplayName>"
    ```
-   Branch off `main` first if the repo policy requires it.
 
-5. **Preview** the app locally so the user can eyeball the new entry:
+4. **Preview** the app so the user can eyeball the new entry:
    ```bash
    uv run streamlit run fev-leaderboard-app.py --server.port=8501 --server.address=0.0.0.0
    ```
-   Run it in the background and share the URL, or use the `run` skill.
+   Run it in the background and share the URL, or use the `run` skill. A `system` or `closed-api`
+   model only appears after enabling its toggle in the sidebar.

CLAUDE.md

@@ -12,8 +12,9 @@ fev-bench Leaderboard is a Streamlit web application displaying time series fore
 # Run the Streamlit app locally
 uv run streamlit run fev-leaderboard-app.py --server.port=8501 --server.address=0.0.0.0
 
-# Regenerate leaderboard tables from autogluon/fev repo (defaults to main branch)
-uv run python save_tables.py [commit]  # e.g., uv run python save_tables.py abc123
+# Refresh all data from the autogluon/fev repo (defaults to latest main)
+uv run python save_tables.py [commit]        # e.g., uv run python save_tables.py abc123
+uv run python save_tables.py --fev-repo ../fev   # use an existing local checkout
 
 # Docker build and run
 docker build -t fev-leaderboard .
@@ -28,29 +29,33 @@ No test or lint frameworks are configured.
 
 ```
 fev-leaderboard-app.py     # Main entry point (Streamlit multi-page router)
-save_tables.py             # Generates pre-computed CSV tables from raw summaries
+save_tables.py             # Refreshes tables/ and src/vendor/ from a single fev commit
 pages/
-├── fev_bench.py           # Main leaderboard (100 tasks, loads from tables/)
-├── chronos_bench_ii.py    # Alternative leaderboard (27 tasks, fetches from GitHub)
+├── fev_bench.py           # Main leaderboard: computes leaderboard/pairwise, renders them
 └── about.py               # Help page with links
 src/
-├── utils.py               # Visualization, formatting, MODEL_CONFIG, color palette
+├── utils.py               # Visualization, formatting, model metadata lookups, color palette
 ├── strings.py             # UI text, metric descriptions, paper citations
-└── task_groups.py         # Task groupings by frequency and domain
-tables/                    # Pre-generated CSVs
-├── pivot_*.csv            # Full pivot tables (filtered in app by task group)
-├── summaries.csv          # Raw evaluation summaries
-└── {group}/               # Subdirectories for each task group (full, mini, frequency_*, domain_*)
-    ├── leaderboard_*.csv  # Leaderboard tables per metric
-    └── pairwise_*.csv     # Pairwise comparison tables per metric
+├── task_groups.py         # Task groupings by frequency and domain
+└── vendor/                # GENERATED: compute logic copied from the fev repo, do not edit
+    └── fev_bench_compute.py
+tables/                    # GENERATED by save_tables.py, do not edit
+├── summaries.csv          # Raw evaluation summaries (leaderboards are computed from these)
+├── models.csv             # Display metadata, from the fev repo's benchmarks/fev_bench/models.yaml
+├── pivot_*.csv            # Per-task error matrices (+ `_baseline_imputed` / `_leakage_imputed`)
+└── source.json            # Which fev commit the tables came from
 ```
 
-**Data flow**: GitHub (autogluon/fev) → `save_tables.py` → pre-computed tables → `fev_bench.py` visualization
+**Data flow**: GitHub (autogluon/fev) → `save_tables.py` → `tables/` + vendored compute → `fev_bench.py`
+
+Leaderboard and pairwise tables are **not** precomputed. Win rate and skill score depend on which
+models are included, and the sidebar lets readers include/exclude model types, so `fev_bench.py`
+computes them per (task group, metric, included types) and caches with `st.cache_data`.
 
 ## Key Modules
 
 **`src/utils.py`**: Core module containing:
-- `MODEL_CONFIG`: Dict mapping model names to (huggingface_url, organization, is_zero_shot, model_type)
+- `get_model_metadata()`: Model attributes loaded from `tables/models.csv` (organization, url, model_type, zero_shot, commercial_use, display_name)
 - `ALL_METRICS`: Dict with SQL, MASE, WQL, WAPE definitions
 - `format_leaderboard()`, `construct_bar_chart()`, `construct_pairwise_chart()`, `construct_pivot_table()`: Styling functions
 - `COLORS`: Custom palette (purple, gold, silver, bronze)
@@ -68,7 +73,13 @@ tables/                    # Pre-generated CSVs
 
 ## Model Types
 
-Models are categorized as DL (deep learning) or ST (statistical) in `MODEL_CONFIG`. This affects color-coding in visualizations (blue vs. orange).
+Each submission declares a `model_type` in `benchmarks/fev_bench/models.yaml` in the fev repo:
+`pretrained`, `task-specific`, `statistical`, `system`, or `closed-api`. This drives the name color
+on the leaderboard. `system` and `closed-api` models are hidden until the reader opts in from the
+sidebar, because their results cannot be reproduced independently or compared to single models.
+
+Model metadata is never edited here: it is declared by submitters in the fev repo and pulled in by
+`save_tables.py`. Models flagged `hidden: true` there are dropped before any metric is computed.
 
 ## Imputation Strategy
 

pages/fev_bench.py

@@ -21,15 +21,29 @@ from src.task_groups import (
 )
 from src.utils import (
     COLORS,
-    HIDDEN_MODELS,
+    DEFAULT_VISIBLE_MODEL_TYPES,
+    MODEL_TYPE_LABELS,
+    OPT_IN_MODEL_TYPES,
     construct_pairwise_chart,
-    filter_hidden_models,
     format_leaderboard,
     format_metric_name,
     get_metric_description,
     get_model_display_name,
+    model_names_of_types,
     validate_model_metadata,
 )
+
+# Leaderboard computation vendored from the fev repo by save_tables.py, so the numbers shown here are
+# produced by the same code as the paper figures.
+from src.vendor.fev_bench_compute import (
+    AVAILABLE_METRICS,
+    BASELINE_MODEL,
+    LEAKAGE_IMPUTATION_MODEL,
+    SORT_COL,
+    TOP_K_MODELS_TO_PLOT,
+    compute_leaderboard,
+    compute_pairwise,
+)
 from streamlit.elements.lib.column_types import ColumnConfig
 
 st.set_page_config(
@@ -37,8 +51,14 @@ st.set_page_config(
 )
 
 TITLE = "<h1 style='text-align: center; font-size: 350%;'>fev-bench</h1>"
-SORT_COL = "win_rate"
-AVAILABLE_METRICS = ["SQL", "MASE", "WQL", "WAPE"]
+
+# Labels for the opt-in model types in the sidebar, with a hint about why they are opt-in.
+OPT_IN_TYPE_HELP = {
+    "system": "Pipelines that combine or select several models, e.g. AutoML frameworks and ensembles. "
+    "Not directly comparable to single models.",
+    "closed-api": "Models served through a closed API, or with unavailable weights. "
+    "Their results cannot be reproduced independently.",
+}
 
 # Group type options
 GROUP_TYPES = [
@@ -72,36 +92,47 @@ def get_subset_description(
     return f"{base} {subset_desc}, as described in {paper_link}."
 
 
-# Mapping from UI selections to table directory names
-GROUP_DIR_MAPPING = {
-    "Full (100 tasks)": "full",
-    "Mini (20 tasks)": "mini",
-    "Sub-hourly": "frequency_sub_hourly",
-    "Hourly": "frequency_hourly",
-    "Daily": "frequency_daily",
-    "Weekly": "frequency_weekly",
-    "Monthly+": "frequency_monthly_plus",
-    "Energy": "domain_energy",
-    "Nature": "domain_nature",
-    "Cloud": "domain_cloud",
-    "Mobility": "domain_mobility",
-    "Econ": "domain_econ",
-    "Health": "domain_health",
-    "Retail": "domain_retail",
-    "Univariate": "task_type_univariate",
-    "Covariate-informed": "task_type_covariate_informed",
-    "Multivariate": "task_type_multivariate",
-}
+@st.cache_data()
+def get_summaries() -> pd.DataFrame:
+    return pd.read_csv("tables/summaries.csv")
 
 
 @st.cache_data()
-def get_leaderboard(metric_name: str, group_dir: str) -> pd.DataFrame:
-    return pd.read_csv(f"tables/{group_dir}/leaderboard_{metric_name}.csv")
+def get_leaderboard(
+    metric_name: str, task_list: tuple[str, ...], model_names: tuple[str, ...]
+) -> pd.DataFrame:
+    """Leaderboard for the selected tasks and models.
+
+    Win rate and skill score depend on which models are included, so these are computed here rather
+    than precomputed: including an extra model type changes every row.
+    """
+    return compute_leaderboard(_filter_summaries(metric_name, task_list, model_names), metric_name)
 
 
 @st.cache_data()
-def get_pairwise(metric_name: str, group_dir: str) -> pd.DataFrame:
-    return pd.read_csv(f"tables/{group_dir}/pairwise_{metric_name}.csv")
+def get_pairwise(
+    metric_name: str, task_list: tuple[str, ...], model_names: tuple[str, ...]
+) -> pd.DataFrame:
+    summaries = _filter_summaries(metric_name, task_list, model_names)
+    leaderboard_df = get_leaderboard(metric_name, task_list, model_names)
+    top_k_models = (
+        leaderboard_df.sort_values(by=SORT_COL, ascending=False)
+        .head(TOP_K_MODELS_TO_PLOT)["model_name"]
+        .tolist()
+    )
+    return compute_pairwise(summaries, metric_name, top_k_models)
+
+
+def _filter_summaries(
+    metric_name: str, task_list: tuple[str, ...], model_names: tuple[str, ...]
+) -> pd.DataFrame:
+    summaries = get_summaries()
+    # The baseline and leakage-imputation models must stay in the data for imputation to work, even
+    # if the reader excluded their type.
+    included = set(model_names) | {BASELINE_MODEL, LEAKAGE_IMPUTATION_MODEL}
+    return summaries[
+        summaries["task_name"].isin(task_list) & summaries["model_name"].isin(included)
+    ]
 
 
 @st.cache_data()
@@ -127,14 +158,12 @@ with st.sidebar:
     elif selected_group_type == "By task type":
         selected_subgroup = st.selectbox("Task type", options=TASK_TYPE_OPTIONS)
 
-    # Determine the directory to load tables from
+    # Determine the tasks making up the selected subset
     if selected_group_type in ["Full (100 tasks)", "Mini (20 tasks)"]:
-        group_dir = GROUP_DIR_MAPPING[selected_group_type]
         task_list = (
             ALL_TASKS if selected_group_type == "Full (100 tasks)" else MINI_TASKS
         )
     else:
-        group_dir = GROUP_DIR_MAPPING[selected_subgroup]
         if selected_group_type == "By frequency":
             task_list = FREQUENCY_GROUPS[selected_subgroup]
         elif selected_group_type == "By task type":
@@ -151,21 +180,30 @@ with st.sidebar:
     )
     st.caption(get_metric_description(selected_metric))
 
+    st.divider()
+
+    st.markdown("**Also include**")
+    included_model_types = list(DEFAULT_VISIBLE_MODEL_TYPES)
+    for model_type in OPT_IN_MODEL_TYPES:
+        if st.checkbox(
+            MODEL_TYPE_LABELS[model_type], value=False, help=OPT_IN_TYPE_HELP[model_type]
+        ):
+            included_model_types.append(model_type)
+    included_models = tuple(model_names_of_types(included_model_types))
+    st.caption(f"{len(included_models)} models")
+
 cols = st.columns(spec=[0.025, 0.95, 0.025])
 
 with cols[1] as main_container:
     st.markdown(TITLE, unsafe_allow_html=True)
 
-    metric_df = get_leaderboard(selected_metric, group_dir).sort_values(
+    task_names = tuple(task_list)
+    metric_df = get_leaderboard(selected_metric, task_names, included_models).sort_values(
         by=SORT_COL, ascending=False
     )
-    metric_df = filter_hidden_models(metric_df, "model_name")
     validate_model_metadata(metric_df["model_name"])
 
-    pairwise_df = get_pairwise(selected_metric, group_dir)
-    pairwise_df = filter_hidden_models(
-        filter_hidden_models(pairwise_df, "model_1"), "model_2"
-    )
+    pairwise_df = get_pairwise(selected_metric, task_names, included_models)
 
     st.markdown("## :material/trophy: Leaderboard", unsafe_allow_html=True)
     st.markdown(
@@ -197,6 +235,8 @@ with cols[1] as main_container:
                 label="Failed tasks (%)", format="%.0f"
             ),
             "zero_shot": ColumnConfig(label="Zero-shot", alignment="center"),
+            "commercial_use": ColumnConfig(label="Commercial use", alignment="center"),
+            "model_type": ColumnConfig(label="Type", alignment="left"),
             "org": ColumnConfig(label="Organization", alignment="left"),
             "link": st.column_config.LinkColumn(label="Link", display_text="🔗"),
         },
@@ -239,11 +279,11 @@ with cols[1] as main_container:
         baseline_imputed = baseline_imputed.set_index("Task name")
         leakage_imputed = leakage_imputed.set_index("Task name")
 
-        # Drop columns for models hidden from the leaderboard
-        hidden_cols = [c for c in pivot_df.columns if c in HIDDEN_MODELS]
-        pivot_df = pivot_df.drop(columns=hidden_cols)
-        baseline_imputed = baseline_imputed.drop(columns=hidden_cols)
-        leakage_imputed = leakage_imputed.drop(columns=hidden_cols)
+        # Keep only the models included by the sidebar toggles
+        excluded_cols = [c for c in pivot_df.columns if c not in included_models]
+        pivot_df = pivot_df.drop(columns=excluded_cols)
+        baseline_imputed = baseline_imputed.drop(columns=excluded_cols)
+        leakage_imputed = leakage_imputed.drop(columns=excluded_cols)
 
         # Filter pivot table to only show tasks in the selected group
         available_tasks = [t for t in task_list if t in pivot_df.index]

save_tables.py

@@ -1,97 +1,118 @@
 #!/usr/bin/env python3
+"""Refresh the leaderboard's data from the autogluon/fev repo.
 
-import argparse
-import importlib.util
-import io
-import sys
-from pathlib import Path
+One command regenerates everything the app needs from a single fev commit:
 
-import requests
+    uv run python save_tables.py            # latest main
+    uv run python save_tables.py abc123     # a specific commit
+    uv run python save_tables.py --fev-repo ../fev   # an existing local checkout
 
-sys.path.append(str(Path(__file__).parent))
+Writes into ``tables/``:
 
-import fev
-import pandas as pd
+    summaries.csv              raw evaluation summaries (the app computes leaderboards from these)
+    models.csv                 display metadata, from the fev repo's benchmarks/fev_bench/models.yaml
+    pivot_<metric>.csv         per-task error matrix (+ `_baseline_imputed` / `_leakage_imputed` masks)
+    source.json               which fev commit the tables came from
 
-from src.task_groups import ALL_TASKS, DOMAIN_GROUPS, FREQUENCY_GROUPS, MINI_TASKS, TASK_TYPE_GROUPS
+and vendors the fev repo's leaderboard computation into ``src/vendor/`` so the app's win rates and
+pairwise comparisons are produced by exactly the code at that commit (the same code that generates
+the paper figures). Leaderboard and pairwise tables are *not* precomputed: they depend on which
+model types the reader includes, so the app computes them on the fly and caches the result.
+"""
 
-GITHUB_REPO = "autogluon/fev"
-RESULTS_PATH = "benchmarks/fev_bench/results"
+from __future__ import annotations
+
+import argparse
+import importlib.util
+import json
+import shutil
+import subprocess
+import sys
+import tempfile
+from datetime import datetime, timezone
+from pathlib import Path
+from types import ModuleType
 
-# Default location of the local fev clone (sibling of this repo); override with --fev-repo
-DEFAULT_FEV_REPO = Path(__file__).resolve().parent.parent / "core"
+import pandas as pd
 
+GITHUB_REPO = "https://github.com/autogluon/fev.git"
+TABLES_DIR = Path(__file__).parent / "tables"
+# Modules copied out of the fev repo so the app runs the same compute logic as the pinned commit.
+VENDOR_DIR = Path(__file__).parent / "src" / "vendor"
+VENDORED_MODULES = {"fev_bench_compute.py": "scripts/generate_fev_bench_figures.py"}
+VENDOR_HEADER = """# Generated file - do not edit.
+# Vendored from {source} in autogluon/fev at commit {commit} by save_tables.py.
+# Regenerate with: uv run python save_tables.py [commit]
+"""
+
+
+def clone_fev_repo(commit: str, dest: Path) -> None:
+    """Shallow-fetch a single fev commit (works for both branch names and SHAs)."""
+    print(f"Fetching {GITHUB_REPO} at {commit}...")
+    run = lambda *args: subprocess.run(args, cwd=dest, check=True, stdout=subprocess.DEVNULL)  # noqa: E731
+    run("git", "init", "--quiet")
+    run("git", "remote", "add", "origin", GITHUB_REPO)
+    run("git", "fetch", "--depth", "1", "--quiet", "origin", commit)
+    run("git", "checkout", "--quiet", "FETCH_HEAD")
+
+
+def resolved_commit(fev_repo: Path) -> str:
+    """Short SHA of the checkout, so the generated tables record their exact source."""
+    result = subprocess.run(
+        ["git", "rev-parse", "--short", "HEAD"], cwd=fev_repo, capture_output=True, text=True, check=True
+    )
+    return result.stdout.strip()
 
-def load_fev_bench_module(fev_repo: Path):
-    """Load shared compute logic from the fev repo's figure-generation script.
 
-    This keeps the leaderboard and the fev paper-figure script using a single source of truth for
-    the benchmark config (baseline/leakage models, metrics) and the leaderboard/pairwise compute.
-    """
-    script_path = fev_repo / "scripts" / "generate_fev_bench_figures.py"
-    if not script_path.exists():
-        raise FileNotFoundError(
-            f"Could not find the fev figure script at {script_path}. "
-            "Clone autogluon/fev next to this repo, or pass --fev-repo with your local fev checkout."
-        )
-    spec = importlib.util.spec_from_file_location("fev_bench_figures", script_path)
+def load_module_from(path: Path, name: str) -> ModuleType:
+    """Import a module from a file path, with its directory importable (for sibling imports)."""
+    sys.path.insert(0, str(path.parent))
+    spec = importlib.util.spec_from_file_location(name, path)
     module = importlib.util.module_from_spec(spec)
     spec.loader.exec_module(module)
     return module
 
 
-# All task groups to generate tables for
-TASK_GROUPS = {
-    "full": ALL_TASKS,
-    "mini": MINI_TASKS,
-    "frequency_sub_hourly": FREQUENCY_GROUPS["Sub-hourly"],
-    "frequency_hourly": FREQUENCY_GROUPS["Hourly"],
-    "frequency_daily": FREQUENCY_GROUPS["Daily"],
-    "frequency_weekly": FREQUENCY_GROUPS["Weekly"],
-    "frequency_monthly_plus": FREQUENCY_GROUPS["Monthly+"],
-    "domain_energy": DOMAIN_GROUPS["Energy"],
-    "domain_nature": DOMAIN_GROUPS["Nature"],
-    "domain_cloud": DOMAIN_GROUPS["Cloud"],
-    "domain_mobility": DOMAIN_GROUPS["Mobility"],
-    "domain_econ": DOMAIN_GROUPS["Econ"],
-    "domain_health": DOMAIN_GROUPS["Health"],
-    "domain_retail": DOMAIN_GROUPS["Retail"],
-    "task_type_univariate": TASK_TYPE_GROUPS["Univariate"],
-    "task_type_covariate_informed": TASK_TYPE_GROUPS["Covariate-informed"],
-    "task_type_multivariate": TASK_TYPE_GROUPS["Multivariate"],
-}
-
-
-def get_csv_files_from_github(commit: str) -> list[str]:
-    """Get list of CSV file paths from the GitHub repo at a specific commit."""
-    api_url = f"https://api.github.com/repos/{GITHUB_REPO}/contents/{RESULTS_PATH}?ref={commit}"
-    response = requests.get(api_url)
-    response.raise_for_status()
-
-    files = response.json()
-    csv_files = [f["path"] for f in files if f["name"].endswith(".csv")]
-
+def vendor_compute_modules(fev_repo: Path, commit: str) -> None:
+    """Copy the fev repo's compute logic into src/vendor/ with a generated-file header."""
+    VENDOR_DIR.mkdir(parents=True, exist_ok=True)
+    (VENDOR_DIR / "__init__.py").write_text("")
+    for target, source in VENDORED_MODULES.items():
+        source_path = fev_repo / source
+        if not source_path.exists():
+            raise FileNotFoundError(f"Expected {source} in the fev checkout at {fev_repo}")
+        header = VENDOR_HEADER.format(source=source, commit=commit)
+        (VENDOR_DIR / target).write_text(header + "\n" + source_path.read_text())
+        print(f"Vendored: src/vendor/{target} (from {source})")
+
+
+def load_model_metadata(fev_repo: Path) -> pd.DataFrame:
+    """Load benchmarks/fev_bench/models.yaml, validated against the results files."""
+    metadata_module = load_module_from(fev_repo / "scripts" / "fev_bench_metadata.py", "fev_bench_metadata")
+    metadata = metadata_module.load_model_metadata(
+        fev_repo / "benchmarks" / "fev_bench" / "results",
+        fev_repo / "benchmarks" / "fev_bench" / "models.yaml",
+    )
+    columns = [
+        "model_name",
+        "display_name",
+        "organization",
+        "url",
+        "model_type",
+        "zero_shot",
+        "commercial_use",
+        "hidden",
+        "results_file",
+    ]
+    return pd.DataFrame(metadata.values())[columns].sort_values("model_name")
+
+
+def load_summaries(results_dir: Path) -> pd.DataFrame:
+    csv_files = sorted(results_dir.glob("*.csv"))
     if not csv_files:
-        raise FileNotFoundError(f"No CSV files found in {RESULTS_PATH} at commit {commit}")
-
-    return csv_files
-
-
-def load_summaries_from_github(commit: str) -> pd.DataFrame:
-    """Load and concatenate all CSV summaries from the GitHub repo at a specific commit."""
-    csv_files = get_csv_files_from_github(commit)
-    print(f"Found {len(csv_files)} CSV files")
-
-    dfs = []
-    for file_path in csv_files:
-        raw_url = f"https://raw.githubusercontent.com/{GITHUB_REPO}/{commit}/{file_path}"
-        response = requests.get(raw_url)
-        response.raise_for_status()
-        df = pd.read_csv(io.StringIO(response.text))
-        dfs.append(df)
-        print(f"  Loaded: {Path(file_path).name}")
-
-    return pd.concat(dfs, ignore_index=True)
+        raise FileNotFoundError(f"No CSV files found in {results_dir}")
+    print(f"Loading {len(csv_files)} result files from {results_dir}")
+    return pd.concat([pd.read_csv(f) for f in csv_files], ignore_index=True)
 
 
 def compute_pivot_table(
@@ -100,6 +121,8 @@ def compute_pivot_table(
     baseline_model: str,
     leakage_imputation_model: str,
 ) -> tuple[pd.DataFrame, pd.DataFrame, pd.DataFrame]:
+    import fev
+
     errors = fev.pivot_table(summaries=summaries, metric_column=metric_name, task_columns=["task_name"])
     train_overlap = (
         fev.pivot_table(summaries=summaries, metric_column="trained_on_this_dataset", task_columns=["task_name"])
@@ -120,122 +143,96 @@ def compute_pivot_table(
     is_imputed_baseline = is_imputed_baseline[errors.columns]
     is_leakage_imputed = is_leakage_imputed[errors.columns]
 
-    errors.index.rename("Task name", inplace=True)
-    is_imputed_baseline.index.rename("Task name", inplace=True)
-    is_leakage_imputed.index.rename("Task name", inplace=True)
+    for df in (errors, is_imputed_baseline, is_leakage_imputed):
+        df.index.rename("Task name", inplace=True)
 
     return errors.reset_index(), is_imputed_baseline.reset_index(), is_leakage_imputed.reset_index()
 
 
-def load_summaries_from_local(path: Path) -> pd.DataFrame:
-    """Load and concatenate all CSV summaries from a local directory."""
-    csv_files = sorted(path.glob("*.csv"))
-    if not csv_files:
-        raise FileNotFoundError(f"No CSV files found in {path}")
-
-    print(f"Found {len(csv_files)} CSV files")
-    dfs = []
-    for f in csv_files:
-        df = pd.read_csv(f)
-        dfs.append(df)
-        print(f"  Loaded: {f.name}")
-
-    return pd.concat(dfs, ignore_index=True)
-
-
-def main():
-    parser = argparse.ArgumentParser(description="Generate leaderboard tables from CSV summaries in the fev repo")
+def main() -> int:
+    parser = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter)
     parser.add_argument(
         "commit",
         nargs="?",
         default="main",
-        help=f"Git commit SHA or branch name in the {GITHUB_REPO} repository (default: main)",
-    )
-    parser.add_argument(
-        "--local",
-        type=Path,
-        help="Path to a local directory containing result CSV files (skips GitHub fetching)",
+        help="Commit SHA or branch in autogluon/fev to generate the tables from (default: main)",
     )
     parser.add_argument(
         "--fev-repo",
         type=Path,
-        default=DEFAULT_FEV_REPO,
-        help=f"Path to a local clone of the fev repo, used for shared compute logic (default: {DEFAULT_FEV_REPO})",
+        default=None,
+        help="Use an existing local fev checkout instead of fetching from GitHub (ignores `commit`)",
     )
     args = parser.parse_args()
 
-    # Load shared benchmark config + compute layer from the fev repo (single source of truth)
-    fev_bench = load_fev_bench_module(args.fev_repo)
-    baseline_model = fev_bench.BASELINE_MODEL
-    leakage_imputation_model = fev_bench.LEAKAGE_IMPUTATION_MODEL
-    sort_col = fev_bench.SORT_COL
-    top_k_models_to_plot = fev_bench.TOP_K_MODELS_TO_PLOT
-    available_metrics = fev_bench.AVAILABLE_METRICS
-    compute_leaderboard = fev_bench.compute_leaderboard
-    compute_pairwise = fev_bench.compute_pairwise
-
-    # Create tables directory
-    tables_dir = Path("tables")
-    tables_dir.mkdir(exist_ok=True)
-
-    if args.local:
-        print(f"Loading summaries from local path: {args.local}")
-        summaries = load_summaries_from_local(args.local)
-    else:
-        print(f"Loading summaries from {GITHUB_REPO} at commit {args.commit}...")
-        summaries = load_summaries_from_github(args.commit)
-
-    # Save raw summaries for on-the-fly subset computation
-    summaries.to_csv(tables_dir / "summaries.csv", index=False)
-    print("Saved: summaries.csv")
-
-    # Generate pivot tables (full version only, at root level)
-    for metric in available_metrics:
-        print(f"Processing pivot table for {metric}...")
+    with tempfile.TemporaryDirectory() as tmp_dir:
+        if args.fev_repo is not None:
+            fev_repo = args.fev_repo.resolve()
+            print(f"Using local fev checkout: {fev_repo}")
+        else:
+            fev_repo = Path(tmp_dir)
+            clone_fev_repo(args.commit, fev_repo)
+        commit = resolved_commit(fev_repo)
+
+        summaries = load_summaries(fev_repo / "benchmarks" / "fev_bench" / "results")
+        models = load_model_metadata(fev_repo)
+        vendor_compute_modules(fev_repo, commit)
+        compute = load_module_from(VENDOR_DIR / "fev_bench_compute.py", "fev_bench_compute")
+
+    # Models hidden from the leaderboard are dropped before any metric is computed, so that they do
+    # not influence other models' win rates (same as the paper figures).
+    hidden_models = models.loc[models["hidden"], "model_name"].tolist()
+    if hidden_models:
+        print(f"Dropping {len(hidden_models)} hidden models: {hidden_models}")
+        summaries = summaries[~summaries["model_name"].isin(hidden_models)]
+    # `hidden` is not written out: the app only ever sees models it is meant to display.
+    models = models[~models["hidden"]].drop(columns="hidden")
+
+    missing_metadata = sorted(set(summaries["model_name"]) - set(models["model_name"]))
+    if missing_metadata:
+        raise ValueError(f"Summaries contain models without metadata: {missing_metadata}")
+
+    TABLES_DIR.mkdir(exist_ok=True)
+    summaries.to_csv(TABLES_DIR / "summaries.csv", index=False)
+    print(f"Saved: summaries.csv ({summaries['model_name'].nunique()} models, {summaries['task_name'].nunique()} tasks)")
+    models.to_csv(TABLES_DIR / "models.csv", index=False)
+    print(f"Saved: models.csv ({len(models)} models)")
+
+    for metric in compute.AVAILABLE_METRICS:
         pivot_df, baseline_imputed, leakage_imputed = compute_pivot_table(
-            summaries, metric, baseline_model, leakage_imputation_model
+            summaries, metric, compute.BASELINE_MODEL, compute.LEAKAGE_IMPUTATION_MODEL
         )
-        pivot_df.to_csv(tables_dir / f"pivot_{metric}.csv", index=False)
-        baseline_imputed.to_csv(tables_dir / f"pivot_{metric}_baseline_imputed.csv", index=False)
-        leakage_imputed.to_csv(tables_dir / f"pivot_{metric}_leakage_imputed.csv", index=False)
-        print(f"  Saved: pivot_{metric}.csv")
-
-    # Generate leaderboard and pairwise tables for each task group
-    for group_name, task_list in TASK_GROUPS.items():
-        print(f"\nProcessing group: {group_name} ({len(task_list)} tasks)...")
-
-        # Create subdirectory for this group
-        group_dir = tables_dir / group_name
-        group_dir.mkdir(exist_ok=True)
-
-        # Filter summaries to only include tasks in this group
-        group_summaries = summaries[summaries["task_name"].isin(task_list)]
-
-        if group_summaries.empty:
-            print(f"  WARNING: No matching tasks found for group {group_name}")
-            continue
-
-        actual_tasks = group_summaries["task_name"].nunique()
-        print(f"  Found {actual_tasks} tasks in summaries")
-
-        for metric in available_metrics:
-            # Compute leaderboard for this group
-            leaderboard_df = compute_leaderboard(group_summaries, metric)
-            leaderboard_df.to_csv(group_dir / f"leaderboard_{metric}.csv", index=False)
-
-            # Get top models for pairwise comparison
-            top_k_models = (
-                leaderboard_df.sort_values(by=sort_col, ascending=False).head(top_k_models_to_plot)["model_name"].tolist()
-            )
-
-            # Compute pairwise comparison
-            pairwise_df = compute_pairwise(group_summaries, metric, top_k_models)
-            pairwise_df.to_csv(group_dir / f"pairwise_{metric}.csv", index=False)
+        pivot_df.to_csv(TABLES_DIR / f"pivot_{metric}.csv", index=False)
+        baseline_imputed.to_csv(TABLES_DIR / f"pivot_{metric}_baseline_imputed.csv", index=False)
+        leakage_imputed.to_csv(TABLES_DIR / f"pivot_{metric}_leakage_imputed.csv", index=False)
+        print(f"Saved: pivot_{metric}.csv")
+
+    (TABLES_DIR / "source.json").write_text(
+        json.dumps(
+            {
+                "repo": GITHUB_REPO,
+                "commit": commit,
+                "requested": args.commit if args.fev_repo is None else str(args.fev_repo),
+                "generated_at": datetime.now(timezone.utc).isoformat(timespec="seconds"),
+            },
+            indent=2,
+        )
+        + "\n"
+    )
+    print(f"Saved: source.json (fev commit {commit})")
 
-            print(f"  Saved: {group_name}/leaderboard_{metric}.csv, {group_name}/pairwise_{metric}.csv")
+    # Leaderboard and pairwise tables used to be precomputed per task group; the app now computes
+    # them so the reader can include/exclude model types. Clean up anything left from older runs.
+    for stale in sorted(p for p in TABLES_DIR.iterdir() if p.is_dir()):
+        shutil.rmtree(stale)
+        print(f"Removed stale table directory: {stale.name}/")
+    for stale in sorted(TABLES_DIR.glob("leaderboard_*.csv")) + sorted(TABLES_DIR.glob("pairwise_*.csv")):
+        stale.unlink()
+        print(f"Removed stale table: {stale.name}")
 
-    print(f"\nAll tables saved to {tables_dir}/")
+    print(f"\nAll tables written to {TABLES_DIR}/")
+    return 0
 
 
 if __name__ == "__main__":
-    main()
+    raise SystemExit(main())

src/strings.py

@@ -10,7 +10,7 @@ LEGEND = """
 TABLE_INFO = f"""
 The leaderboard summarizes the performance of all models evaluated on the 100 tasks comprising **fev-bench**. More details available in the [paper](https://arxiv.org/abs/2509.26468).
 
-Model names are colored by type: <span style='color: {COLORS["pretrained_text"]}; font-weight: bold;'>Pretrained</span>, <span style='color: {COLORS["task_specific_text"]}; font-weight: bold;'>Task-specific</span>, and <span style='color: {COLORS["statistical_text"]}; font-weight: bold;'>Statistical</span>.
+Model names are colored by type: <span style='color: {COLORS["pretrained_text"]}; font-weight: bold;'>Pretrained</span>, <span style='color: {COLORS["task_specific_text"]}; font-weight: bold;'>Task-specific</span>, <span style='color: {COLORS["statistical_text"]}; font-weight: bold;'>Statistical</span>, <span style='color: {COLORS["system_text"]}; font-weight: bold;'>System</span>, and <span style='color: {COLORS["closed_api_text"]}; font-weight: bold;'>Closed API</span>. Systems (AutoML frameworks and ensembles) and closed-API models are excluded by default and can be included from the sidebar; including them changes the win rates of all other models.
 
 The full matrix $E_{{rj}}$ with the error of each model $j$ on task $r$ is available at the bottom of the page.
 
@@ -29,6 +29,12 @@ The full matrix $E_{{rj}}$ with the error of each model $j$ on task $r$ is avail
 * **Failed tasks (%)**: Percentage of tasks where the model failed to produce a forecast. Results for failed tasks are replaced with Seasonal Naive performance.
 
 * **Zero-shot**: Indicates whether the model can make predictions without task-specific training (✓ = zero-shot, × = task-specific).
+
+* **Commercial use**: Whether the model's license permits commercial use (✓ = permitted, × = not permitted). Follow the model's link to check its license.
+
+* **Type**: How the model was obtained: **Pretrained** (applied to each task as-is), **Task-specific** (trained or tuned per task), **Statistical** (classical method fit per task), **System** (pipeline combining or selecting several models), or **Closed API** (served behind a closed API, or weights unavailable).
+
+All model attributes above are declared by whoever submitted the model in [`benchmarks/fev_bench/models.yaml`](https://github.com/autogluon/fev/blob/main/benchmarks/fev_bench/models.yaml) and are not independently verified.
 """
 
 CHRONOS_BENCHMARK_BASIC_INFO = f"""

src/utils.py

@@ -1,3 +1,6 @@
+import functools
+from pathlib import Path
+
 import altair as alt
 import fev
 import pandas as pd
@@ -9,6 +12,8 @@ COLORS = {
     "pretrained_text": "#5A7FA5",
     "task_specific_text": "#7B5A9A",
     "statistical_text": "#A5795A",
+    "system_text": "#4F8A6E",
+    "closed_api_text": "#9A5A5A",
     "bar_fill": "#8d5eb7",
     "error_bar": "#222222",
     "point": "#111111",
@@ -23,127 +28,55 @@ COLORS = {
 }
 HEATMAP_COLOR_SCHEME = "purplegreen"
 
-# Model configuration: (url, org, zero_shot, model_type)
-MODEL_CONFIG = {
-    # Chronos Models
-    "chronos_tiny": ("amazon/chronos-t5-tiny", "AWS", True, "pretrained"),
-    "chronos_mini": ("amazon/chronos-t5-mini", "AWS", True, "pretrained"),
-    "chronos_small": ("amazon/chronos-t5-small", "AWS", True, "pretrained"),
-    "chronos_base": ("amazon/chronos-t5-base", "AWS", True, "pretrained"),
-    "chronos_large": ("amazon/chronos-t5-large", "AWS", True, "pretrained"),
-    "chronos_bolt_tiny": ("amazon/chronos-bolt-tiny", "AWS", True, "pretrained"),
-    "chronos_bolt_mini": ("amazon/chronos-bolt-mini", "AWS", True, "pretrained"),
-    "chronos_bolt_small": ("amazon/chronos-bolt-small", "AWS", True, "pretrained"),
-    "chronos_bolt_base": ("amazon/chronos-bolt-base", "AWS", True, "pretrained"),
-    "chronos-bolt": ("amazon/chronos-bolt-base", "AWS", True, "pretrained"),
-    "chronos-2": ("amazon/chronos-2", "AWS", True, "pretrained"),
-    # Moirai Models
-    "moirai_large": ("Salesforce/moirai-1.1-R-large", "Salesforce", True, "pretrained"),
-    "moirai_base": ("Salesforce/moirai-1.1-R-base", "Salesforce", True, "pretrained"),
-    "moirai_small": ("Salesforce/moirai-1.1-R-small", "Salesforce", True, "pretrained"),
-    "moirai-2.0": ("Salesforce/moirai-2.0-R-small", "Salesforce", True, "pretrained"),
-    # TimesFM Models
-    "timesfm": ("google/timesfm-1.0-200m-pytorch", "Google", True, "pretrained"),
-    "timesfm-2.0": ("google/timesfm-2.0-500m-pytorch", "Google", True, "pretrained"),
-    "timesfm-2.5": ("google/timesfm-2.5-200m-pytorch", "Google", True, "pretrained"),
-    "timesfm-3": ("google/timesfm-3.0-pytorch", "Google", True, "pretrained"),
-    # Toto Models
-    "toto-1.0": ("Datadog/Toto-Open-Base-1.0", "Datadog", True, "pretrained"),
-    "toto-2.0-2.5b": ("Datadog/Toto-2.0-2.5B", "Datadog", True, "pretrained"),
-    "toto-2.0-22m": ("Datadog/Toto-2.0-22m", "Datadog", True, "pretrained"),
-    # Other Models
-    "tirex": ("NX-AI/TiRex", "NX-AI", True, "pretrained"),
-    "tirex-2": ("NX-AI/TiRex-2-fevbench", "NX-AI", True, "pretrained"),
-    "tabpfn-ts": ("Prior-Labs/TabPFN-v2-reg", "Prior Labs", True, "pretrained"),
-    "tabpfn-ts-3": ("Prior-Labs/TabPFN-2.5-reg", "Prior Labs", True, "pretrained"),
-    "sundial-base": (
-        "thuml/sundial-base-128m",
-        "Tsinghua University",
-        True,
-        "pretrained",
-    ),
-    "ttm-r2": ("ibm-granite/granite-timeseries-ttm-r2", "IBM", True, "pretrained"),
-    "flowstate": (
-        "ibm-granite/granite-timeseries-flowstate-r1",
-        "IBM",
-        True,
-        "pretrained",
-    ),
-    "citras-fm": ("hitachi-nlp/citras-fm", "Hitachi", True, "pretrained", "CITRAS-FM"),
-    "ts-icl": ("taharnbl/TS-ICL", "EDF-Lab", True, "pretrained", "TS-ICL"),
-    "t0-beta": (
-        "theforecastingcompany/t0-beta",
-        "The Forecasting Company",
-        True,
-        "pretrained",
-    ),
-    # GluonTS Models
-    "deepar": ("https://github.com/awslabs/gluonts", "—", False, "task-specific"),
-    "tft": ("https://github.com/awslabs/gluonts", "—", False, "task-specific"),
-    "patchtst": ("https://github.com/awslabs/gluonts", "—", False, "task-specific"),
-    # MLForecast Models
-    "lightgbm": (
-        "https://nixtlaverse.nixtla.io/mlforecast",
-        "—",
-        False,
-        "task-specific",
-    ),
-    "catboost": (
-        "https://nixtlaverse.nixtla.io/mlforecast",
-        "—",
-        False,
-        "task-specific",
-    ),
-    # Statistical models
-    "stat. ensemble": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "autoarima": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "autotheta": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "autoets": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "seasonalnaive": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "seasonal naive": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "drift": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
-    "naive": (
-        "https://nixtlaverse.nixtla.io/statsforecast/",
-        "—",
-        False,
-        "statistical",
-    ),
+# Display metadata for every model on the leaderboard. Generated by save_tables.py from
+# benchmarks/fev_bench/models.yaml in the fev repo, where submitters declare it themselves.
+MODELS_CSV = Path(__file__).resolve().parent.parent / "tables" / "models.csv"
+
+# Model types a submission can declare, and the text color used for each on the leaderboard.
+MODEL_TYPE_COLORS = {
+    "pretrained": "pretrained_text",
+    "task-specific": "task_specific_text",
+    "statistical": "statistical_text",
+    "system": "system_text",
+    "closed-api": "closed_api_text",
 }
+# Human-readable labels for the model types.
+MODEL_TYPE_LABELS = {
+    "pretrained": "Pretrained",
+    "task-specific": "Task-specific",
+    "statistical": "Statistical",
+    "system": "System",
+    "closed-api": "Closed API",
+}
+# Types shown unless the reader opts into more. Results for the others either cannot be reproduced
+# independently (closed-api) or are not comparable to single models (system).
+DEFAULT_VISIBLE_MODEL_TYPES = ("pretrained", "task-specific", "statistical")
+OPT_IN_MODEL_TYPES = ("system", "closed-api")
+
+
+@functools.lru_cache(maxsize=1)
+def get_model_metadata() -> dict[str, dict]:
+    """Display metadata for each model, keyed by the `model_name` used in the results."""
+    df = pd.read_csv(MODELS_CSV)
+    return {row["model_name"]: row for row in df.to_dict("records")}
+
+
+def validate_model_metadata(model_names) -> None:
+    """Raise if any displayed model lacks metadata, so the app never shows blank attributes."""
+    metadata = get_model_metadata()
+    missing = sorted({m for m in model_names if m not in metadata})
+    if missing:
+        raise ValueError(
+            f"Missing metadata (organization, link, type) for models: {missing}. "
+            "Add an entry to benchmarks/fev_bench/models.yaml in the fev repo, "
+            "then regenerate the tables with `uv run python save_tables.py`."
+        )
+
+
+def model_names_of_types(model_types) -> list[str]:
+    """Names of all models whose declared type is in `model_types`."""
+    model_types = set(model_types)
+    return sorted(name for name, entry in get_model_metadata().items() if entry["model_type"] in model_types)
 
 
 ALL_METRICS = {
@@ -174,69 +107,44 @@ def get_metric_description(metric_name: str):
     return ALL_METRICS[metric_name][1]
 
 
-# Models excluded from the leaderboard display (redundant Toto-2.0 sizes; keep 2.5B and 22m)
-HIDDEN_MODELS = ["Toto-2.0-1B", "Toto-2.0-313m", "Toto-2.0-4m"]
-
-
-def filter_hidden_models(
-    df: pd.DataFrame, model_column: str = "model_name"
-) -> pd.DataFrame:
-    """Drop rows for models in HIDDEN_MODELS based on the given model-name column."""
-    return df[~df[model_column].isin(HIDDEN_MODELS)]
+def get_model_link(model_name):
+    return get_model_metadata()[model_name]["url"]
 
 
-def validate_model_metadata(model_names) -> None:
-    """Raise if any displayed model lacks a MODEL_CONFIG entry (organization, link, type, etc.)."""
-    missing = sorted({m for m in model_names if MODEL_CONFIG.get(m.lower()) is None})
-    if missing:
-        raise ValueError(
-            f"Missing MODEL_CONFIG metadata (organization, link, type) for models: {missing}. "
-            "Add entries to MODEL_CONFIG in src/utils.py."
-        )
+def get_model_organization(model_name):
+    return get_model_metadata()[model_name]["organization"]
 
 
-def get_model_link(model_name):
-    config = MODEL_CONFIG.get(model_name.lower())
-    if not config or not config[0]:
-        return ""
-    url = config[0]
-    return url if url.startswith("https:") else f"https://huggingface.co/{url}"
+def _check_mark(value: bool) -> str:
+    return "✓" if value else "×"
 
 
-def get_model_organization(model_name):
-    config = MODEL_CONFIG.get(model_name.lower())
-    return config[1] if config else "—"
+def get_zero_shot_status(model_name):
+    return _check_mark(get_model_metadata()[model_name]["zero_shot"])
 
 
-def get_zero_shot_status(model_name):
-    config = MODEL_CONFIG.get(model_name.lower())
-    return "✓" if config and config[2] else "×"
+def get_commercial_use_status(model_name):
+    return _check_mark(get_model_metadata()[model_name]["commercial_use"])
 
 
 def get_model_type(model_name):
-    config = MODEL_CONFIG.get(model_name.lower())
-    return config[3] if config else "—"
+    return get_model_metadata()[model_name]["model_type"]
 
 
-def get_model_display_name(model_name):
-    """Return the display-name override from MODEL_CONFIG if present, else the CSV name."""
-    config = MODEL_CONFIG.get(model_name.lower())
-    if config and len(config) > 4 and config[4]:
-        return config[4]
-    return model_name
+def get_model_type_label(model_name):
+    return MODEL_TYPE_LABELS[get_model_type(model_name)]
 
 
-MODEL_TYPE_COLORS = {
-    "pretrained": "pretrained_text",
-    "task-specific": "task_specific_text",
-    "statistical": "statistical_text",
-}
+def get_model_display_name(model_name):
+    """Display name declared in models.yaml, falling back to the name used in the results."""
+    entry = get_model_metadata().get(model_name)
+    return entry["display_name"] if entry else model_name
 
 
 def highlight_model_type_color(cell):
-    config = MODEL_CONFIG.get(cell.lower())
-    if config:
-        color_key = MODEL_TYPE_COLORS.get(config[3], "text_default")
+    entry = get_model_metadata().get(cell)
+    if entry:
+        color_key = MODEL_TYPE_COLORS.get(entry["model_type"], "text_default")
         return f"font-weight: bold; color: {COLORS[color_key]}"
     return "font-weight: bold"
 
@@ -255,6 +163,8 @@ def format_leaderboard(df: pd.DataFrame):
         ),
         axis=1,
     )
+    df["commercial_use"] = df["model_name"].apply(get_commercial_use_status)
+    df["model_type"] = df["model_name"].apply(get_model_type_label)
     df["link"] = df["model_name"].apply(get_model_link)
     df["org"] = df["model_name"].apply(get_model_organization)
     df = df[
@@ -266,13 +176,15 @@ def format_leaderboard(df: pd.DataFrame):
             "training_corpus_overlap",
             "num_failures",
             "zero_shot",
+            "commercial_use",
+            "model_type",
             "org",
             "link",
         ]
     ]
     return (
         df.style.map(highlight_model_type_color, subset=["model_name"])
-        .map(lambda x: "font-weight: bold", subset=["zero_shot"])
+        .map(lambda x: "font-weight: bold", subset=["zero_shot", "commercial_use"])
         .apply(
             lambda x: [
                 "background-color: #f8f9fa" if i % 2 == 1 else "" for i in range(len(x))

src/vendor/fev_bench_compute.py

@@ -0,0 +1,378 @@
+# Generated file - do not edit.
+# Vendored from scripts/generate_fev_bench_figures.py in autogluon/fev at commit 48bab72 by save_tables.py.
+# Regenerate with: uv run python save_tables.py [commit]
+
+# /// script
+# requires-python = ">=3.10"
+# dependencies = [
+#     "fev",
+#     "altair",
+#     "vl-convert-python",
+#     "pandas",
+#     "pyyaml",
+#     "requests",
+# ]
+# ///
+"""Generate consistent leaderboard tables and pairwise-comparison figures from fev summaries.
+
+This produces the same leaderboard and pairwise-comparison numbers shown on the fev leaderboard
+(https://huggingface.co/spaces/autogluon/fev-leaderboard), so authors can drop consistent figures
+into papers and reports. The numbers come straight from ``fev.analysis.leaderboard`` /
+``fev.analysis.pairwise_comparison`` (the same functions the leaderboard uses). The pairwise
+figures are publication-quality Altair heatmaps (large fonts, color legend, inline 95% CIs);
+``construct_pairwise_chart`` also accepts flags to reproduce the leaderboard's interactive look.
+
+Run with ``uv run`` so the inline dependencies above are installed automatically:
+
+    # Full benchmark, every metric, from the committed summaries
+    uv run scripts/generate_fev_bench_figures.py
+
+    # A single metric, restricted to the fev-bench-mini subset
+    uv run scripts/generate_fev_bench_figures.py --metric SQL \\
+        --benchmark benchmarks/fev_bench/tasks_mini.yaml
+
+    # Restrict to an explicit list of tasks
+    uv run scripts/generate_fev_bench_figures.py --tasks ETT_1H solar_1D walmart
+
+    # Make the pairwise heatmaps larger
+    uv run scripts/generate_fev_bench_figures.py --metric SQL --fig-width 1100
+
+By default summaries are read from ``benchmarks/fev_bench/results``. Outputs land in
+``--out-dir`` (default ``figures/``) as vector PDFs:
+
+    leaderboard_<metric>.csv           leaderboard table (raw values)
+    leaderboard_<metric>.tex           leaderboard table (paper-style LaTeX)
+    pairwise_win_rate_<metric>.pdf     pairwise win-rate heatmap
+    pairwise_skill_score_<metric>.pdf  pairwise skill-score heatmap
+"""
+
+from __future__ import annotations
+
+import argparse
+from pathlib import Path
+
+import pandas as pd
+
+import fev
+
+# --- Benchmark configuration (kept in sync with the fev leaderboard) ------------------------
+
+BASELINE_MODEL = "Seasonal Naive"
+LEAKAGE_IMPUTATION_MODEL = "Chronos-Bolt"
+AVAILABLE_METRICS = ["SQL", "MASE", "WQL", "WAPE"]
+SORT_COL = "win_rate"
+N_RESAMPLES_FOR_CI = 1000
+TOP_K_MODELS_TO_PLOT = 15
+
+# --- Figure curation ------------------------------------------------------------------------
+
+# Models flagged `hidden: true` in benchmarks/fev_bench/models.yaml are dropped by default, so the
+# figures and the leaderboard hide the same models (currently redundant Toto-2.0 checkpoint sizes).
+# Override with --exclude or disable with --keep-all-models.
+
+DEFAULT_RESULTS_DIR = Path(__file__).resolve().parent.parent / "benchmarks" / "fev_bench" / "results"
+
+# --- Plotting -------------------------------------------------------------------------------
+
+HEATMAP_COLOR_SCHEME = "purplegreen"
+
+# Per-metric heatmap config: (colorbar label, color domain, midpoint, white-text condition)
+PAIRWISE_CHART_CONFIG = {
+    "win_rate": ("Win Rate", [0, 100], 50, "abs(datum.{col} - 50) > 30"),
+    "skill_score": ("Skill Score", [-30, 30], 0, "abs(datum.{col}) > 20"),
+}
+
+
+def _format_ci_value(val: float) -> str:
+    """Compact CI number: drop decimals once the magnitude needs 3+ digits."""
+    return f"{int(round(val))}" if abs(int(val)) >= 100 else f"{val:.1f}"
+
+
+def construct_pairwise_chart(
+    df: pd.DataFrame,
+    col: str,
+    *,
+    title: str | None = None,
+    width: int = 900,
+    inline_ci: bool = True,
+    show_legend: bool = True,
+):
+    """Altair heatmap of pairwise win rate / skill score.
+
+    Defaults produce a publication-quality static figure (large fonts, color legend, inline 95% CI
+    text under each value, square aspect ratio). The same function powers the interactive
+    leaderboard view by passing ``inline_ci=False`` (CI shown via tooltip) and ``title=<metric>``.
+
+    Parameters
+    ----------
+    df
+        Output of ``fev.analysis.pairwise_comparison(...).reset_index()`` with ``model_1``,
+        ``model_2``, ``<col>``, ``<col>_lower``, ``<col>_upper`` columns.
+    col
+        Either ``"win_rate"`` or ``"skill_score"``.
+    title
+        Optional chart title. Omitted by default (papers use a figure caption instead).
+    width
+        Chart width in pixels; height is derived to keep the matrix square.
+    inline_ci
+        If True, render the 95% CI under each cell value (best for static figures). If False,
+        the CI is only available via the hover tooltip (best for the interactive leaderboard).
+    show_legend
+        Whether to draw the color legend.
+    """
+    import altair as alt
+
+    cbar_label, domain, domain_mid, text_condition_tmpl = PAIRWISE_CHART_CONFIG[col]
+    text_condition = text_condition_tmpl.format(col=col)
+
+    df = df.copy()
+    for c in [col, f"{col}_lower", f"{col}_upper"]:
+        df[c] *= 100
+    df["ci_text"] = df.apply(
+        lambda row: f"({_format_ci_value(row[f'{col}_lower'])}, {_format_ci_value(row[f'{col}_upper'])})",
+        axis=1,
+    )
+
+    model_order = df.groupby("model_1")[col].mean().sort_values(ascending=False).index.tolist()
+    n_rows, n_cols = df["model_1"].nunique(), df["model_2"].nunique()
+
+    tooltip = [
+        alt.Tooltip("model_1:N", title="Model 1"),
+        alt.Tooltip("model_2:N", title="Model 2"),
+        alt.Tooltip(f"{col}:Q", title=cbar_label.split(" ")[0], format=".1f"),
+        alt.Tooltip(f"{col}_lower:Q", title="95% CI Lower", format=".1f"),
+        alt.Tooltip(f"{col}_upper:Q", title="95% CI Upper", format=".1f"),
+    ]
+
+    base = alt.Chart(df).encode(
+        x=alt.X("model_2:N", sort=model_order, title="", axis=alt.Axis(orient="top", labelAngle=-90)),
+        y=alt.Y("model_1:N", sort=model_order, title=""),
+    )
+
+    legend = alt.Legend(title=f"{cbar_label} (%)", direction="vertical") if show_legend else None
+    heatmap = base.mark_rect().encode(
+        color=alt.Color(
+            f"{col}:Q",
+            legend=legend,
+            scale=alt.Scale(scheme=HEATMAP_COLOR_SCHEME, domain=domain, domainMid=domain_mid, clamp=True),
+        ),
+        tooltip=tooltip,
+    )
+
+    text_color = alt.condition(text_condition, alt.value("white"), alt.value("black"))
+    text_main = base.mark_text(dy=-8, fontSize=10, baseline="top", yOffset=0).encode(
+        text=alt.Text(f"{col}:Q", format=".1f"), color=text_color, tooltip=tooltip
+    )
+    layers = heatmap + text_main
+    if inline_ci:
+        text_ci = base.mark_text(dy=-8, fontSize=7.5, baseline="top", yOffset=10).encode(
+            text=alt.Text("ci_text:N"), color=text_color, tooltip=tooltip
+        )
+        layers = layers + text_ci
+
+    chart = layers.properties(height=int(width * n_rows / n_cols), width=width)
+    if title is not None:
+        chart = chart.properties(title={"text": title, "fontSize": 18})
+    return (
+        chart.configure_axis(titleFontSize=16, labelFontSize=14)
+        .configure_title(fontSize=18)
+        .configure_legend(gradientLength=90)
+        .resolve_scale(color="independent")
+    )
+
+
+# --- Summary loading and metric computation -------------------------------------------------
+
+
+def load_summaries(results_dir: Path) -> pd.DataFrame:
+    """Load and concatenate all summary CSVs from a directory."""
+    csv_files = sorted(results_dir.glob("*.csv"))
+    if not csv_files:
+        raise FileNotFoundError(f"No CSV files found in {results_dir}")
+    print(f"Loading {len(csv_files)} summary files from {results_dir}")
+    return pd.concat([pd.read_csv(f) for f in csv_files], ignore_index=True)
+
+
+def resolve_task_filter(benchmark: str | None, tasks: list[str] | None) -> list[str] | None:
+    """Return the list of task_names to keep, or None to keep all tasks."""
+    if benchmark is not None:
+        task_names = [t.task_name for t in fev.Benchmark.from_yaml(benchmark).tasks]
+        print(f"Filtering to {len(task_names)} tasks from benchmark: {benchmark}")
+        return task_names
+    if tasks:
+        print(f"Filtering to {len(tasks)} explicitly provided tasks")
+        return tasks
+    return None
+
+
+def filter_summaries(summaries: pd.DataFrame, task_names: list[str] | None) -> pd.DataFrame:
+    if task_names is None:
+        return summaries
+    missing = sorted(set(task_names) - set(summaries["task_name"]))
+    if missing:
+        raise ValueError(f"{len(missing)} requested tasks not found in summaries: {missing}")
+    filtered = summaries[summaries["task_name"].isin(task_names)]
+    print(f"  {filtered['task_name'].nunique()} tasks matched in summaries")
+    return filtered
+
+
+def compute_leaderboard(summaries: pd.DataFrame, metric_name: str) -> pd.DataFrame:
+    lb = fev.analysis.leaderboard(
+        summaries=summaries,
+        metric_column=metric_name,
+        missing_strategy="impute",
+        baseline_model=BASELINE_MODEL,
+        leakage_imputation_model=LEAKAGE_IMPUTATION_MODEL,
+        normalize_time_per_n_forecasts=100,
+    )
+    lb = lb.astype("float64").reset_index()
+    lb["skill_score"] = lb["skill_score"] * 100
+    lb["win_rate"] = lb["win_rate"] * 100
+    lb["num_failures"] = lb["num_failures"] / summaries["task_name"].nunique() * 100
+    return lb.sort_values(by=SORT_COL, ascending=False)
+
+
+# Columns kept in the LaTeX leaderboard table, mapped to their (bold) display headers.
+LATEX_COLUMNS = {
+    "model_name": "Model",
+    "win_rate": r"Avg. win rate (\%)",
+    "skill_score": r"Skill score (\%)",
+    "median_e2e_time_s_per100": "Median runtime / 100 series (s)",
+    "training_corpus_overlap": r"Leakage (\%)",
+    "num_failures": r"Failed tasks (\%)",
+}
+
+
+def leaderboard_to_latex(leaderboard_df: pd.DataFrame) -> str:
+    """Render a paper-style LaTeX leaderboard table from a ``compute_leaderboard`` result."""
+    df = leaderboard_df[list(LATEX_COLUMNS)].copy()
+    for col in ["win_rate", "skill_score", "median_e2e_time_s_per100", "training_corpus_overlap", "num_failures"]:
+        df[col] = df[col].round(1)
+    df = df.astype({"training_corpus_overlap": "int"})
+    df = df.rename(columns={col: r"\textbf{" + name + r"}" for col, name in LATEX_COLUMNS.items()})
+    return df.to_latex(index=False, float_format="%.1f")
+
+
+def compute_pairwise(summaries: pd.DataFrame, metric_name: str, included_models: list[str]) -> pd.DataFrame:
+    # Baseline and leakage-imputation models must be present for imputation, even if outside the top-K
+    included_models = included_models + [
+        m for m in (BASELINE_MODEL, LEAKAGE_IMPUTATION_MODEL) if m not in included_models
+    ]
+    return (
+        fev.analysis.pairwise_comparison(
+            summaries,
+            included_models=included_models,
+            metric_column=metric_name,
+            baseline_model=BASELINE_MODEL,
+            missing_strategy="impute",
+            n_resamples=N_RESAMPLES_FOR_CI,
+            leakage_imputation_model=LEAKAGE_IMPUTATION_MODEL,
+        )
+        .round(3)
+        .reset_index()
+    )
+
+
+def parse_args(argv: list[str] | None = None) -> argparse.Namespace:
+    parser = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter)
+    parser.add_argument(
+        "--metric",
+        choices=AVAILABLE_METRICS,
+        action="append",
+        help=f"Metric(s) to generate (repeatable). Default: all of {AVAILABLE_METRICS}.",
+    )
+    parser.add_argument(
+        "--results-dir",
+        type=Path,
+        default=DEFAULT_RESULTS_DIR,
+        help="Directory containing the summary CSV files (default: benchmarks/fev_bench/results).",
+    )
+    group = parser.add_mutually_exclusive_group()
+    group.add_argument(
+        "--benchmark",
+        default=None,
+        help="Path or URL of a benchmark YAML; only its tasks are included.",
+    )
+    group.add_argument(
+        "--tasks",
+        nargs="+",
+        default=None,
+        help="Explicit list of task_names to include (alternative to --benchmark).",
+    )
+    parser.add_argument(
+        "--out-dir",
+        type=Path,
+        default=Path("figures"),
+        help="Directory to write tables and figures into (default: figures/).",
+    )
+    parser.add_argument(
+        "--fig-width",
+        type=int,
+        default=900,
+        help="Pairwise figure width in pixels; height scales to keep the matrix square (default: 900).",
+    )
+    parser.add_argument(
+        "--exclude",
+        nargs="+",
+        default=None,
+        help="Model names to drop from tables/figures (default: models marked `hidden` in models.yaml).",
+    )
+    parser.add_argument(
+        "--keep-all-models",
+        action="store_true",
+        help="Disable the default model exclusion and include every model in the summaries.",
+    )
+    return parser.parse_args(argv)
+
+
+def main(argv: list[str] | None = None) -> int:
+    args = parse_args(argv)
+    metrics = args.metric or AVAILABLE_METRICS
+
+    summaries = load_summaries(args.results_dir)
+    task_names = resolve_task_filter(args.benchmark, args.tasks)
+    summaries = filter_summaries(summaries, task_names)
+
+    if args.keep_all_models:
+        excluded = []
+    elif args.exclude is not None:
+        excluded = args.exclude
+    else:
+        # Imported here so this script stays importable on its own (the leaderboard app vendors it).
+        from fev_bench_metadata import hidden_model_names
+
+        excluded = hidden_model_names(args.results_dir)
+    if excluded:
+        present = sorted(set(excluded) & set(summaries["model_name"]))
+        summaries = summaries[~summaries["model_name"].isin(excluded)]
+        print(f"Excluding {len(present)} models: {present}")
+
+    out_dir = args.out_dir
+    out_dir.mkdir(parents=True, exist_ok=True)
+
+    for metric in metrics:
+        print(f"\nProcessing metric: {metric}")
+        leaderboard_df = compute_leaderboard(summaries, metric)
+        leaderboard_path = out_dir / f"leaderboard_{metric}.csv"
+        leaderboard_df.to_csv(leaderboard_path, index=False)
+        print(f"  Saved: {leaderboard_path}")
+
+        latex_path = out_dir / f"leaderboard_{metric}.tex"
+        latex_path.write_text(leaderboard_to_latex(leaderboard_df))
+        print(f"  Saved: {latex_path}")
+
+        top_models = leaderboard_df.head(TOP_K_MODELS_TO_PLOT)["model_name"].tolist()
+        pairwise_df = compute_pairwise(summaries, metric, top_models)
+
+        for col in ["win_rate", "skill_score"]:
+            chart = construct_pairwise_chart(pairwise_df, col=col, width=args.fig_width)
+            fig_path = out_dir / f"pairwise_{col}_{metric}.pdf"
+            chart.save(fig_path)
+            print(f"  Saved: {fig_path}")
+
+    print(f"\nAll outputs written to {out_dir}/")
+    return 0
+
+
+if __name__ == "__main__":
+    raise SystemExit(main())

tables/domain_cloud/leaderboard_MASE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-Toto-2.0-2.5B,95.80645161290323,47.105140103596796,0.0,5.064579399732653,0.0,0.0
-Toto-2.0-1B,95.16129032258065,47.049179559947774,0.0,2.3743196950416188,0.0,0.0
-Toto-2.0-313m,92.58064516129033,46.485472580621256,0.0,0.9745701860666667,0.0,0.0
-TimesFM-3,84.35483870967741,45.28228290051567,0.0,8.200040489446785,0.0,0.0
-Toto-2.0-22m,84.35483870967741,43.92623198246986,0.0,0.13920661274489796,0.0,0.0
-Toto-1.0,77.25806451612904,41.88927928450025,0.0,45.854219394249995,0.0,0.0
-t0-beta,76.93548387096773,43.10181756241107,0.0,4.3975796048998745,0.0,0.0
-Chronos-2,72.74193548387096,42.51579967639686,0.0,1.1862588189,0.0,0.0
-Toto-2.0-4m,71.93548387096773,40.931171483779714,0.0,0.09261558033545919,0.0,0.0
-TiRex-2,65.32258064516128,39.65417127595432,0.0,0.19312244271691675,0.0,0.0
-TimesFM-2.5,64.83870967741936,40.26605676264323,0.0,6.434508300230608,0.0,0.0
-TS-ICL,63.22580645161291,40.023445008897305,0.0,3.327645272361891,0.0,0.0
-TiRex,61.77419354838709,38.09940061802194,0.0,0.20884203875396826,0.0,0.0
-Moirai-2.0,47.41935483870968,35.5798994200739,0.0,0.35171731723214283,0.1,0.0
-FlowState,47.41935483870968,30.68598311802213,0.0,12.472611368300264,0.0,0.0
-citras-fm,47.41935483870968,34.357611241199095,0.0,0.7048698485226532,0.0,0.0
-TabPFN-TS-3,47.096774193548384,34.02528132692776,0.0,431.5150328579276,0.0,0.0
-PatchTST,44.67741935483872,34.304846616783294,1068.4652680383783,0.7892402496428571,0.0,0.0
-TFT,44.435483870967744,34.39379489295074,1003.5120332510221,1.1076982505700976,0.0,0.0
-Sundial-Base,44.03225806451613,34.444932595485724,0.0,7.874095355196429,0.0,0.0
-Chronos-Bolt,41.612903225806456,30.890375949929528,0.0,0.21284866287857143,0.0,0.0
-TabPFN-TS,41.29032258064515,31.182648441489537,0.0,285.2805137923404,0.0,0.0
-CatBoost,36.29032258064516,28.99041616417205,123.37088255733154,0.43462186795918367,0.0,0.0
-DeepAR,32.903225806451616,25.641579380120593,1590.4637105111146,1.558186748969388,0.0,0.0
-LightGBM,26.7741935483871,21.217567102831968,7.053590123430682,0.3469036807346939,0.0,0.0
-Stat. Ensemble,21.048387096774196,12.457381191619765,0.0,140.07917045413043,0.0,5.0
-AutoARIMA,18.79032258064516,13.156560456056853,0.0,18.324502920714288,0.0,5.0
-AutoETS,13.95161290322581,9.008132945543156,0.0,2.9907604154761906,0.0,15.0
-AutoTheta,13.709677419354838,6.832233363582574,0.0,4.0546638315458425,0.0,0.0
-Naive,11.29032258064516,-25.50199781747715,0.0,0.43933051720441596,0.0,0.0
-Seasonal Naive,9.354838709677422,0.0,0.0,0.5176203110585994,0.0,0.0
-Drift,4.193548387096775,-32.85429098273796,0.0,0.4190869192562794,0.0,0.0

tables/domain_cloud/leaderboard_SQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-Toto-2.0-2.5B,96.61290322580645,66.67609437659667,0.0,5.064579399732653,0.0,0.0
-Toto-2.0-1B,95.48387096774194,66.67229326421315,0.0,2.3743196950416188,0.0,0.0
-Toto-2.0-313m,93.06451612903226,66.42835118245338,0.0,0.9745701860666667,0.0,0.0
-Toto-2.0-22m,85.64516129032258,64.64905946685398,0.0,0.13920661274489796,0.0,0.0
-TimesFM-3,85.3225806451613,65.49636349554686,0.0,8.200040489446785,0.0,0.0
-Toto-1.0,77.25806451612904,63.05875031595707,0.0,45.854219394249995,0.0,0.0
-t0-beta,76.61290322580645,64.10856710007313,0.0,4.3975796048998745,0.0,0.0
-Chronos-2,74.35483870967741,63.92789670076326,0.0,1.1862588189,0.0,0.0
-Toto-2.0-4m,73.2258064516129,62.51740509789393,0.0,0.09261558033545919,0.0,0.0
-TiRex-2,67.74193548387096,61.657338261486025,0.0,0.19312244271691675,0.0,0.0
-TimesFM-2.5,65.32258064516128,61.98663035039822,0.0,6.434508300230608,0.0,0.0
-TiRex,63.70967741935484,60.871565834690514,0.0,0.20884203875396826,0.0,0.0
-TS-ICL,63.38709677419354,61.929921677293606,0.0,3.327645272361891,0.0,0.0
-TabPFN-TS-3,53.064516129032256,59.42246884042356,0.0,431.5150328579276,0.0,0.0
-Moirai-2.0,50.16129032258064,58.416109773202194,0.0,0.35171731723214283,0.1,0.0
-FlowState,49.03225806451613,55.917373913965896,0.0,12.472611368300264,0.0,0.0
-citras-fm,46.93548387096774,57.40397994436643,0.0,0.7048698485226532,0.0,0.0
-PatchTST,45.564516129032256,56.65838528437654,1068.4652680383783,0.7892402496428571,0.0,0.0
-TFT,44.67741935483872,56.101100728840805,1003.5120332510221,1.1076982505700976,0.0,0.0
-Sundial-Base,40.483870967741936,56.64773521043558,0.0,7.874095355196429,0.0,0.0
-TabPFN-TS,40.32258064516129,54.882167458139385,0.0,285.2805137923404,0.0,0.0
-Chronos-Bolt,40.16129032258065,54.85929046462743,0.0,0.21284866287857143,0.0,0.0
-DeepAR,35.24193548387096,50.20430422932948,1590.4637105111146,1.558186748969388,0.0,0.0
-CatBoost,27.903225806451616,46.25315473529981,123.37088255733154,0.43462186795918367,0.0,0.0
-LightGBM,22.58064516129032,40.369919076130486,7.053590123430682,0.3469036807346939,0.0,0.0
-AutoARIMA,22.016129032258064,34.1099179045811,0.0,18.324502920714288,0.0,5.0
-Stat. Ensemble,19.91935483870968,21.741616773476768,0.0,140.07917045413043,0.0,5.0
-AutoETS,14.274193548387096,-26.853793282334813,0.0,2.9907604154761906,0.0,15.0
-AutoTheta,10.483870967741936,-2.114517117703918,0.0,4.0546638315458425,0.0,0.0
-Seasonal Naive,10.403225806451612,0.0,0.0,0.5176203110585994,0.0,0.0
-Naive,7.096774193548386,-102.14853947002402,0.0,0.43933051720441596,0.0,0.0
-Drift,1.9354838709677424,-110.24318719846286,0.0,0.4190869192562794,0.0,0.0

tables/domain_cloud/leaderboard_WAPE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-Toto-2.0-2.5B,96.93548387096774,53.71035361627254,0.0,5.064579399732653,0.0,0.0
-Toto-2.0-1B,95.3225806451613,53.096830919470946,0.0,2.3743196950416188,0.0,0.0
-Toto-2.0-313m,93.2258064516129,52.69411150627982,0.0,0.9745701860666667,0.0,0.0
-TimesFM-3,86.29032258064517,53.11122845988342,0.0,8.200040489446785,0.0,0.0
-Toto-2.0-22m,86.29032258064517,50.191472774349634,0.0,0.13920661274489796,0.0,0.0
-t0-beta,76.77419354838709,49.59448987938475,0.0,4.3975796048998745,0.0,0.0
-Chronos-2,76.29032258064517,50.57276323971893,0.0,1.1862588189,0.0,0.0
-Toto-1.0,75.48387096774192,47.09252281338565,0.0,45.854219394249995,0.0,0.0
-Toto-2.0-4m,70.48387096774194,47.10219495180865,0.0,0.09261558033545919,0.0,0.0
-TiRex-2,65.48387096774194,46.55373683052376,0.0,0.19312244271691675,0.0,0.0
-TimesFM-2.5,64.03225806451613,46.24771958720855,0.0,6.434508300230608,0.0,0.0
-TiRex,61.45161290322581,44.520635260445665,0.0,0.20884203875396826,0.0,0.0
-TS-ICL,60.967741935483865,45.92336879321229,0.0,3.327645272361891,0.0,0.0
-TabPFN-TS-3,52.74193548387096,46.210313482546184,0.0,431.5150328579276,0.0,0.0
-FlowState,51.935483870967744,44.39308253523333,0.0,12.472611368300264,0.0,0.0
-Moirai-2.0,48.87096774193548,42.79254856807111,0.0,0.35171731723214283,0.1,0.0
-citras-fm,48.38709677419355,43.462794590251164,0.0,0.7048698485226532,0.0,0.0
-TabPFN-TS,46.4516129032258,42.304181829008726,0.0,285.2805137923404,0.0,0.0
-PatchTST,45.48387096774194,42.75818805959519,1068.4652680383783,0.7892402496428571,0.0,0.0
-Sundial-Base,43.2258064516129,41.966358434053696,0.0,7.874095355196429,0.0,0.0
-Chronos-Bolt,42.25806451612903,39.89366883509092,0.0,0.21284866287857143,0.0,0.0
-TFT,41.37096774193548,37.9920627846737,1003.5120332510221,1.1076982505700976,0.0,0.0
-CatBoost,32.58064516129032,34.58752644878078,123.37088255733154,0.43462186795918367,0.0,0.0
-DeepAR,32.41935483870968,31.125782577257844,1590.4637105111146,1.558186748969388,0.0,0.0
-LightGBM,25.483870967741932,27.03716130150796,7.053590123430682,0.3469036807346939,0.0,0.0
-Stat. Ensemble,18.790322580645164,17.59542897915567,0.0,140.07917045413043,0.0,5.0
-AutoARIMA,16.048387096774192,16.5309827995087,0.0,18.324502920714288,0.0,5.0
-AutoETS,12.661290322580646,5.6618608202705705,0.0,2.9907604154761906,0.0,15.0
-AutoTheta,11.129032258064516,12.660865320459136,0.0,4.0546638315458425,0.0,0.0
-Naive,10.806451612903226,4.49837321934039,0.0,0.43933051720441596,0.0,0.0
-Seasonal Naive,6.451612903225806,0.0,0.0,0.5176203110585994,0.0,0.0
-Drift,3.870967741935485,-1.7537853153904326,0.0,0.4190869192562794,0.0,0.0

tables/domain_cloud/leaderboard_WQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-Toto-2.0-2.5B,97.90322580645162,69.03469555605878,0.0,5.064579399732653,0.0,0.0
-Toto-2.0-1B,95.64516129032258,68.75529346896873,0.0,2.3743196950416188,0.0,0.0
-Toto-2.0-313m,92.90322580645162,68.41066967488192,0.0,0.9745701860666667,0.0,0.0
-TimesFM-3,86.29032258064517,68.51966945307177,0.0,8.200040489446785,0.0,0.0
-Toto-2.0-22m,85.96774193548387,66.78327813931047,0.0,0.13920661274489796,0.0,0.0
-Chronos-2,76.93548387096774,66.94397676250325,0.0,1.1862588189,0.0,0.0
-t0-beta,76.61290322580645,66.40650113837772,0.0,4.3975796048998745,0.0,0.0
-Toto-1.0,74.19354838709677,64.46135334372015,0.0,45.854219394249995,0.0,0.0
-Toto-2.0-4m,71.45161290322581,64.42603072886158,0.0,0.09261558033545919,0.0,0.0
-TiRex-2,67.25806451612904,63.99709672683953,0.0,0.19312244271691675,0.0,0.0
-TimesFM-2.5,63.70967741935484,63.7537487246866,0.0,6.434508300230608,0.0,0.0
-TiRex,63.548387096774206,62.74382048246822,0.0,0.20884203875396826,0.0,0.0
-TS-ICL,62.903225806451616,63.67831559208952,0.0,3.327645272361891,0.0,0.0
-TabPFN-TS-3,57.09677419354839,64.3601359782909,0.0,431.5150328579276,0.0,0.0
-FlowState,54.03225806451613,62.649468493586056,0.0,12.472611368300264,0.0,0.0
-Moirai-2.0,50.806451612903224,61.08750954950368,0.0,0.35171731723214283,0.1,0.0
-citras-fm,47.58064516129033,60.978054225927835,0.0,0.7048698485226532,0.0,0.0
-PatchTST,47.177419354838705,59.71037333425973,1068.4652680383783,0.7892402496428571,0.0,0.0
-TFT,43.70967741935484,55.556509382143545,1003.5120332510221,1.1076982505700976,0.0,0.0
-TabPFN-TS,42.41935483870968,58.432181218600874,0.0,285.2805137923404,0.0,0.0
-Chronos-Bolt,39.67741935483871,58.15816295699815,0.0,0.21284866287857143,0.0,0.0
-Sundial-Base,39.354838709677416,59.21372871831863,0.0,7.874095355196429,0.0,0.0
-DeepAR,34.91935483870968,50.79429174981283,1590.4637105111146,1.558186748969388,0.0,0.0
-CatBoost,27.580645161290317,46.843426009989976,123.37088255733154,0.43462186795918367,0.0,0.0
-LightGBM,23.225806451612907,40.70772252024998,7.053590123430682,0.3469036807346939,0.0,0.0
-AutoARIMA,20.241935483870968,34.821696297938075,0.0,18.324502920714288,0.0,5.0
-Stat. Ensemble,17.5,22.34504540092107,0.0,140.07917045413043,0.0,5.0
-AutoETS,11.693548387096774,-39.995047645386684,0.0,2.9907604154761906,0.0,15.0
-AutoTheta,10.0,7.361982676335321,0.0,4.0546638315458425,0.0,0.0
-Seasonal Naive,9.274193548387096,0.0,0.0,0.5176203110585994,0.0,0.0
-Naive,6.290322580645162,-64.9788901369484,0.0,0.43933051720441596,0.0,0.0
-Drift,2.096774193548387,-71.7471743825873,0.0,0.4190869192562794,0.0,0.0

tables/domain_cloud/pairwise_MASE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-1B,0.6,0.4,0.8,0.001,-0.011,0.012
-Toto-2.0-2.5B,Toto-2.0-313m,0.8,0.6,0.95,0.012,0.002,0.024
-Toto-2.0-2.5B,Toto-2.0-22m,1.0,1.0,1.0,0.057,0.031,0.088
-Toto-2.0-2.5B,TimesFM-3,0.85,0.699,1.0,0.033,-0.023,0.079
-Toto-2.0-2.5B,Toto-1.0,0.95,0.85,1.0,0.09,0.05,0.136
-Toto-2.0-2.5B,t0-beta,0.95,0.85,1.0,0.07,0.041,0.11
-Toto-2.0-2.5B,Chronos-2,0.95,0.85,1.0,0.08,0.048,0.124
-Toto-2.0-2.5B,Toto-2.0-4m,1.0,1.0,1.0,0.105,0.061,0.155
-Toto-2.0-2.5B,TiRex-2,0.95,0.85,1.0,0.123,0.077,0.173
-Toto-2.0-2.5B,TimesFM-2.5,0.95,0.85,1.0,0.114,0.07,0.181
-Toto-2.0-2.5B,TS-ICL,0.95,0.85,1.0,0.118,0.073,0.172
-Toto-2.0-2.5B,TiRex,1.0,1.0,1.0,0.145,0.082,0.223
-Toto-2.0-2.5B,FlowState,0.9,0.75,1.0,0.237,0.125,0.356
-Toto-2.0-2.5B,Moirai-2.0,1.0,1.0,1.0,0.179,0.114,0.268
-Toto-2.0-2.5B,Chronos-Bolt,1.0,1.0,1.0,0.235,0.163,0.308
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.471,0.37,0.587
-Toto-2.0-1B,Toto-2.0-2.5B,0.4,0.2,0.6,-0.001,-0.012,0.011
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-313m,0.8,0.6,0.95,0.011,0.001,0.022
-Toto-2.0-1B,Toto-2.0-22m,1.0,1.0,1.0,0.056,0.028,0.092
-Toto-2.0-1B,TimesFM-3,0.85,0.699,1.0,0.032,-0.033,0.081
-Toto-2.0-1B,Toto-1.0,1.0,1.0,1.0,0.089,0.051,0.132
-Toto-2.0-1B,t0-beta,0.9,0.75,1.0,0.069,0.039,0.11
-Toto-2.0-1B,Chronos-2,0.95,0.85,1.0,0.079,0.042,0.127
-Toto-2.0-1B,Toto-2.0-4m,1.0,1.0,1.0,0.104,0.06,0.157
-Toto-2.0-1B,TiRex-2,0.95,0.85,1.0,0.123,0.077,0.175
-Toto-2.0-1B,TimesFM-2.5,0.9,0.75,1.0,0.114,0.068,0.183
-Toto-2.0-1B,TS-ICL,1.0,1.0,1.0,0.117,0.076,0.167
-Toto-2.0-1B,TiRex,1.0,1.0,1.0,0.145,0.084,0.223
-Toto-2.0-1B,FlowState,0.9,0.75,1.0,0.236,0.115,0.36
-Toto-2.0-1B,Moirai-2.0,1.0,1.0,1.0,0.178,0.112,0.271
-Toto-2.0-1B,Chronos-Bolt,1.0,1.0,1.0,0.234,0.16,0.311
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.47,0.372,0.586
-Toto-2.0-313m,Toto-2.0-2.5B,0.2,0.05,0.4,-0.012,-0.024,-0.002
-Toto-2.0-313m,Toto-2.0-1B,0.2,0.05,0.4,-0.011,-0.023,-0.001
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-22m,1.0,1.0,1.0,0.046,0.025,0.076
-Toto-2.0-313m,TimesFM-3,0.9,0.75,1.0,0.022,-0.045,0.072
-Toto-2.0-313m,Toto-1.0,0.95,0.85,1.0,0.079,0.045,0.121
-Toto-2.0-313m,t0-beta,0.9,0.75,1.0,0.059,0.029,0.1
-Toto-2.0-313m,Chronos-2,0.95,0.85,1.0,0.069,0.033,0.115
-Toto-2.0-313m,Toto-2.0-4m,1.0,1.0,1.0,0.094,0.056,0.144
-Toto-2.0-313m,TiRex-2,0.95,0.85,1.0,0.113,0.073,0.158
-Toto-2.0-313m,TimesFM-2.5,0.95,0.85,1.0,0.104,0.058,0.173
-Toto-2.0-313m,TS-ICL,0.95,0.85,1.0,0.108,0.067,0.158
-Toto-2.0-313m,TiRex,1.0,1.0,1.0,0.135,0.076,0.212
-Toto-2.0-313m,FlowState,0.9,0.75,1.0,0.228,0.113,0.349
-Toto-2.0-313m,Moirai-2.0,1.0,1.0,1.0,0.169,0.107,0.26
-Toto-2.0-313m,Chronos-Bolt,1.0,1.0,1.0,0.226,0.157,0.3
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.465,0.364,0.583
-Toto-2.0-22m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.06,-0.096,-0.032
-Toto-2.0-22m,Toto-2.0-1B,0.0,0.0,0.0,-0.059,-0.102,-0.029
-Toto-2.0-22m,Toto-2.0-313m,0.0,0.0,0.0,-0.048,-0.082,-0.026
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TimesFM-3,0.65,0.45,0.85,-0.025,-0.099,0.018
-Toto-2.0-22m,Toto-1.0,0.75,0.55,0.9,0.035,0.012,0.064
-Toto-2.0-22m,t0-beta,0.85,0.7,1.0,0.014,-0.017,0.044
-Toto-2.0-22m,Chronos-2,0.85,0.7,1.0,0.025,-0.013,0.052
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.051,0.03,0.076
-Toto-2.0-22m,TiRex-2,0.9,0.75,1.0,0.071,0.046,0.096
-Toto-2.0-22m,TimesFM-2.5,0.85,0.699,1.0,0.061,0.016,0.111
-Toto-2.0-22m,TS-ICL,0.9,0.75,1.0,0.065,0.032,0.102
-Toto-2.0-22m,TiRex,0.85,0.7,1.0,0.094,0.047,0.149
-Toto-2.0-22m,FlowState,0.9,0.75,1.0,0.191,0.077,0.306
-Toto-2.0-22m,Moirai-2.0,1.0,1.0,1.0,0.13,0.081,0.2
-Toto-2.0-22m,Chronos-Bolt,1.0,1.0,1.0,0.189,0.128,0.252
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.439,0.34,0.551
-TimesFM-3,Toto-2.0-2.5B,0.15,0.0,0.301,-0.034,-0.086,0.022
-TimesFM-3,Toto-2.0-1B,0.15,0.0,0.301,-0.033,-0.089,0.032
-TimesFM-3,Toto-2.0-313m,0.1,0.0,0.25,-0.022,-0.077,0.043
-TimesFM-3,Toto-2.0-22m,0.35,0.15,0.55,0.024,-0.018,0.09
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Toto-1.0,0.65,0.449,0.85,0.058,0.008,0.133
-TimesFM-3,t0-beta,0.65,0.45,0.85,0.038,0.006,0.083
-TimesFM-3,Chronos-2,0.9,0.75,1.0,0.048,0.025,0.08
-TimesFM-3,Toto-2.0-4m,0.75,0.55,0.95,0.074,0.024,0.14
-TimesFM-3,TiRex-2,1.0,1.0,1.0,0.093,0.042,0.164
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.084,0.045,0.128
-TimesFM-3,TS-ICL,0.85,0.7,1.0,0.088,0.038,0.156
-TimesFM-3,TiRex,0.85,0.7,1.0,0.116,0.05,0.19
-TimesFM-3,FlowState,0.95,0.85,1.0,0.211,0.105,0.325
-TimesFM-3,Moirai-2.0,1.0,1.0,1.0,0.151,0.085,0.226
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.208,0.132,0.281
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.453,0.356,0.558
-Toto-1.0,Toto-2.0-2.5B,0.05,0.0,0.15,-0.099,-0.157,-0.052
-Toto-1.0,Toto-2.0-1B,0.0,0.0,0.0,-0.097,-0.152,-0.053
-Toto-1.0,Toto-2.0-313m,0.05,0.0,0.15,-0.086,-0.138,-0.047
-Toto-1.0,Toto-2.0-22m,0.25,0.1,0.45,-0.036,-0.068,-0.012
-Toto-1.0,TimesFM-3,0.35,0.15,0.551,-0.062,-0.154,-0.008
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,t0-beta,0.65,0.45,0.85,-0.021,-0.062,0.011
-Toto-1.0,Chronos-2,0.65,0.45,0.85,-0.011,-0.063,0.027
-Toto-1.0,Toto-2.0-4m,0.7,0.45,0.9,0.016,-0.007,0.04
-Toto-1.0,TiRex-2,0.85,0.7,1.0,0.037,0.014,0.059
-Toto-1.0,TimesFM-2.5,0.7,0.5,0.9,0.027,-0.02,0.072
-Toto-1.0,TS-ICL,0.8,0.65,0.95,0.031,0.005,0.057
-Toto-1.0,TiRex,0.8,0.6,0.95,0.061,0.027,0.114
-Toto-1.0,FlowState,0.85,0.7,1.0,0.162,0.041,0.286
-Toto-1.0,Moirai-2.0,0.95,0.85,1.0,0.098,0.052,0.164
-Toto-1.0,Chronos-Bolt,0.9,0.75,1.0,0.159,0.094,0.224
-Toto-1.0,Seasonal Naive,1.0,1.0,1.0,0.419,0.323,0.528
-t0-beta,Toto-2.0-2.5B,0.05,0.0,0.15,-0.076,-0.124,-0.042
-t0-beta,Toto-2.0-1B,0.1,0.0,0.25,-0.075,-0.123,-0.041
-t0-beta,Toto-2.0-313m,0.1,0.0,0.25,-0.063,-0.111,-0.03
-t0-beta,Toto-2.0-22m,0.15,0.0,0.3,-0.015,-0.046,0.017
-t0-beta,TimesFM-3,0.35,0.15,0.55,-0.04,-0.09,-0.006
-t0-beta,Toto-1.0,0.35,0.15,0.55,0.021,-0.011,0.059
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Chronos-2,0.6,0.4,0.8,0.01,-0.013,0.031
-t0-beta,Toto-2.0-4m,0.55,0.35,0.75,0.037,0.004,0.076
-t0-beta,TiRex-2,0.75,0.55,0.9,0.057,0.02,0.101
-t0-beta,TimesFM-2.5,0.8,0.6,0.95,0.047,0.022,0.084
-t0-beta,TS-ICL,0.85,0.7,1.0,0.051,0.025,0.087
-t0-beta,TiRex,0.75,0.55,0.9,0.081,0.035,0.137
-t0-beta,FlowState,0.9,0.75,1.0,0.179,0.07,0.304
-t0-beta,Moirai-2.0,1.0,1.0,1.0,0.117,0.066,0.182
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.177,0.11,0.244
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.431,0.343,0.538
-Chronos-2,Toto-2.0-2.5B,0.05,0.0,0.15,-0.087,-0.141,-0.05
-Chronos-2,Toto-2.0-1B,0.05,0.0,0.15,-0.086,-0.145,-0.044
-Chronos-2,Toto-2.0-313m,0.05,0.0,0.15,-0.074,-0.13,-0.034
-Chronos-2,Toto-2.0-22m,0.15,0.0,0.3,-0.025,-0.055,0.013
-Chronos-2,TimesFM-3,0.1,0.0,0.25,-0.051,-0.087,-0.026
-Chronos-2,Toto-1.0,0.35,0.15,0.55,0.011,-0.028,0.059
-Chronos-2,t0-beta,0.4,0.2,0.6,-0.01,-0.032,0.013
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-2.0-4m,0.6,0.35,0.8,0.027,-0.006,0.067
-Chronos-2,TiRex-2,0.7,0.5,0.9,0.047,0.011,0.093
-Chronos-2,TimesFM-2.5,0.7,0.5,0.9,0.038,0.009,0.071
-Chronos-2,TS-ICL,0.7,0.5,0.9,0.042,0.003,0.089
-Chronos-2,TiRex,0.75,0.55,0.95,0.071,0.022,0.128
-Chronos-2,FlowState,0.8,0.6,0.95,0.171,0.067,0.29
-Chronos-2,Moirai-2.0,1.0,1.0,1.0,0.108,0.053,0.168
-Chronos-2,Chronos-Bolt,0.95,0.85,1.0,0.168,0.101,0.231
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.425,0.331,0.534
-Toto-2.0-4m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.117,-0.184,-0.065
-Toto-2.0-4m,Toto-2.0-1B,0.0,0.0,0.0,-0.116,-0.187,-0.064
-Toto-2.0-4m,Toto-2.0-313m,0.0,0.0,0.0,-0.104,-0.168,-0.059
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.053,-0.083,-0.031
-Toto-2.0-4m,TimesFM-3,0.25,0.05,0.45,-0.08,-0.162,-0.025
-Toto-2.0-4m,Toto-1.0,0.3,0.1,0.55,-0.016,-0.042,0.007
-Toto-2.0-4m,t0-beta,0.45,0.25,0.65,-0.038,-0.082,-0.004
-Toto-2.0-4m,Chronos-2,0.4,0.2,0.65,-0.028,-0.072,0.006
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,TiRex-2,0.85,0.65,1.0,0.021,0.008,0.034
-Toto-2.0-4m,TimesFM-2.5,0.65,0.4,0.85,0.011,-0.032,0.048
-Toto-2.0-4m,TS-ICL,0.75,0.55,0.9,0.015,-0.017,0.042
-Toto-2.0-4m,TiRex,0.75,0.55,0.9,0.046,0.017,0.083
-Toto-2.0-4m,FlowState,0.85,0.699,1.0,0.148,0.032,0.269
-Toto-2.0-4m,Moirai-2.0,1.0,1.0,1.0,0.083,0.05,0.134
-Toto-2.0-4m,Chronos-Bolt,1.0,1.0,1.0,0.145,0.092,0.201
-Toto-2.0-4m,Seasonal Naive,0.95,0.85,1.0,0.409,0.315,0.516
-TiRex-2,Toto-2.0-2.5B,0.05,0.0,0.15,-0.141,-0.209,-0.084
-TiRex-2,Toto-2.0-1B,0.05,0.0,0.15,-0.14,-0.212,-0.083
-TiRex-2,Toto-2.0-313m,0.05,0.0,0.15,-0.128,-0.188,-0.078
-TiRex-2,Toto-2.0-22m,0.1,0.0,0.25,-0.076,-0.106,-0.049
-TiRex-2,TimesFM-3,0.0,0.0,0.0,-0.103,-0.196,-0.043
-TiRex-2,Toto-1.0,0.15,0.0,0.3,-0.038,-0.063,-0.014
-TiRex-2,t0-beta,0.25,0.1,0.45,-0.061,-0.112,-0.02
-TiRex-2,Chronos-2,0.3,0.1,0.5,-0.05,-0.103,-0.011
-TiRex-2,Toto-2.0-4m,0.15,0.0,0.35,-0.022,-0.035,-0.008
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-2.5,0.6,0.4,0.8,-0.01,-0.061,0.036
-TiRex-2,TS-ICL,0.65,0.45,0.85,-0.006,-0.045,0.025
-TiRex-2,TiRex,0.65,0.45,0.85,0.025,-0.006,0.072
-TiRex-2,FlowState,0.8,0.6,0.95,0.129,0.009,0.25
-TiRex-2,Moirai-2.0,0.85,0.7,1.0,0.063,0.027,0.121
-TiRex-2,Chronos-Bolt,0.95,0.85,1.0,0.127,0.072,0.184
-TiRex-2,Seasonal Naive,0.95,0.85,1.0,0.397,0.293,0.51
-TimesFM-2.5,Toto-2.0-2.5B,0.05,0.0,0.15,-0.129,-0.22,-0.075
-TimesFM-2.5,Toto-2.0-1B,0.1,0.0,0.25,-0.128,-0.224,-0.073
-TimesFM-2.5,Toto-2.0-313m,0.05,0.0,0.15,-0.116,-0.209,-0.061
-TimesFM-2.5,Toto-2.0-22m,0.15,0.0,0.301,-0.065,-0.125,-0.016
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.092,-0.147,-0.047
-TimesFM-2.5,Toto-1.0,0.3,0.1,0.5,-0.028,-0.078,0.02
-TimesFM-2.5,t0-beta,0.2,0.05,0.4,-0.05,-0.091,-0.022
-TimesFM-2.5,Chronos-2,0.3,0.1,0.5,-0.039,-0.077,-0.009
-TimesFM-2.5,Toto-2.0-4m,0.35,0.15,0.6,-0.011,-0.05,0.031
-TimesFM-2.5,TiRex-2,0.4,0.2,0.6,0.01,-0.037,0.058
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,TS-ICL,0.45,0.25,0.7,0.004,-0.033,0.047
-TimesFM-2.5,TiRex,0.65,0.45,0.85,0.035,-0.0,0.077
-TimesFM-2.5,FlowState,0.7,0.5,0.9,0.138,0.03,0.267
-TimesFM-2.5,Moirai-2.0,0.9,0.75,1.0,0.073,0.035,0.115
-TimesFM-2.5,Chronos-Bolt,0.85,0.65,1.0,0.136,0.068,0.199
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.403,0.318,0.501
-TS-ICL,Toto-2.0-2.5B,0.05,0.0,0.15,-0.134,-0.207,-0.079
-TS-ICL,Toto-2.0-1B,0.0,0.0,0.0,-0.133,-0.2,-0.082
-TS-ICL,Toto-2.0-313m,0.05,0.0,0.15,-0.121,-0.188,-0.072
-TS-ICL,Toto-2.0-22m,0.1,0.0,0.25,-0.07,-0.114,-0.033
-TS-ICL,TimesFM-3,0.15,0.0,0.3,-0.096,-0.185,-0.039
-TS-ICL,Toto-1.0,0.2,0.05,0.35,-0.032,-0.061,-0.005
-TS-ICL,t0-beta,0.15,0.0,0.3,-0.054,-0.095,-0.025
-TS-ICL,Chronos-2,0.3,0.1,0.5,-0.043,-0.098,-0.003
-TS-ICL,Toto-2.0-4m,0.25,0.1,0.45,-0.015,-0.044,0.017
-TS-ICL,TiRex-2,0.35,0.15,0.55,0.006,-0.025,0.043
-TS-ICL,TimesFM-2.5,0.55,0.3,0.75,-0.004,-0.049,0.032
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TiRex,0.5,0.3,0.7,0.031,-0.001,0.077
-TS-ICL,FlowState,0.75,0.55,0.901,0.135,0.008,0.274
-TS-ICL,Moirai-2.0,0.8,0.6,0.95,0.069,0.023,0.128
-TS-ICL,Chronos-Bolt,0.85,0.65,1.0,0.132,0.065,0.202
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.4,0.315,0.503
-TiRex,Toto-2.0-2.5B,0.0,0.0,0.0,-0.17,-0.287,-0.09
-TiRex,Toto-2.0-1B,0.0,0.0,0.0,-0.169,-0.287,-0.092
-TiRex,Toto-2.0-313m,0.0,0.0,0.0,-0.157,-0.27,-0.083
-TiRex,Toto-2.0-22m,0.15,0.0,0.3,-0.104,-0.176,-0.05
-TiRex,TimesFM-3,0.15,0.0,0.3,-0.131,-0.235,-0.053
-TiRex,Toto-1.0,0.2,0.05,0.4,-0.065,-0.129,-0.028
-TiRex,t0-beta,0.25,0.1,0.45,-0.088,-0.159,-0.036
-TiRex,Chronos-2,0.25,0.05,0.45,-0.077,-0.146,-0.022
-TiRex,Toto-2.0-4m,0.25,0.1,0.45,-0.048,-0.091,-0.017
-TiRex,TiRex-2,0.35,0.15,0.55,-0.026,-0.077,0.006
-TiRex,TimesFM-2.5,0.35,0.15,0.55,-0.036,-0.083,0.0
-TiRex,TS-ICL,0.5,0.3,0.7,-0.032,-0.084,0.001
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,FlowState,0.65,0.45,0.85,0.107,-0.02,0.236
-TiRex,Moirai-2.0,0.8,0.6,0.95,0.039,0.014,0.065
-TiRex,Chronos-Bolt,0.75,0.55,0.9,0.104,0.038,0.166
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.381,0.295,0.476
-FlowState,Toto-2.0-2.5B,0.1,0.0,0.25,-0.31,-0.554,-0.142
-FlowState,Toto-2.0-1B,0.1,0.0,0.25,-0.309,-0.563,-0.131
-FlowState,Toto-2.0-313m,0.1,0.0,0.25,-0.295,-0.536,-0.128
-FlowState,Toto-2.0-22m,0.1,0.0,0.25,-0.236,-0.442,-0.084
-FlowState,TimesFM-3,0.05,0.0,0.15,-0.267,-0.481,-0.118
-FlowState,Toto-1.0,0.15,0.0,0.3,-0.193,-0.401,-0.043
-FlowState,t0-beta,0.1,0.0,0.25,-0.218,-0.438,-0.076
-FlowState,Chronos-2,0.2,0.05,0.4,-0.206,-0.408,-0.072
-FlowState,Toto-2.0-4m,0.15,0.0,0.301,-0.173,-0.368,-0.033
-FlowState,TiRex-2,0.2,0.05,0.4,-0.149,-0.333,-0.009
-FlowState,TimesFM-2.5,0.3,0.1,0.5,-0.16,-0.363,-0.031
-FlowState,TS-ICL,0.25,0.099,0.45,-0.156,-0.378,-0.008
-FlowState,TiRex,0.35,0.15,0.55,-0.12,-0.308,0.02
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Moirai-2.0,0.4,0.2,0.6,-0.076,-0.251,0.058
-FlowState,Chronos-Bolt,0.5,0.3,0.7,-0.003,-0.136,0.112
-FlowState,Seasonal Naive,0.9,0.75,1.0,0.307,0.147,0.442
-Moirai-2.0,Toto-2.0-2.5B,0.0,0.0,0.0,-0.218,-0.367,-0.129
-Moirai-2.0,Toto-2.0-1B,0.0,0.0,0.0,-0.217,-0.371,-0.126
-Moirai-2.0,Toto-2.0-313m,0.0,0.0,0.0,-0.204,-0.352,-0.12
-Moirai-2.0,Toto-2.0-22m,0.0,0.0,0.0,-0.149,-0.25,-0.088
-Moirai-2.0,TimesFM-3,0.0,0.0,0.0,-0.177,-0.291,-0.093
-Moirai-2.0,Toto-1.0,0.05,0.0,0.15,-0.109,-0.196,-0.055
-Moirai-2.0,t0-beta,0.0,0.0,0.0,-0.132,-0.222,-0.07
-Moirai-2.0,Chronos-2,0.0,0.0,0.0,-0.121,-0.202,-0.056
-Moirai-2.0,Toto-2.0-4m,0.0,0.0,0.0,-0.091,-0.155,-0.052
-Moirai-2.0,TiRex-2,0.15,0.0,0.3,-0.068,-0.137,-0.027
-Moirai-2.0,TimesFM-2.5,0.1,0.0,0.25,-0.078,-0.13,-0.036
-Moirai-2.0,TS-ICL,0.2,0.05,0.4,-0.074,-0.147,-0.023
-Moirai-2.0,TiRex,0.2,0.05,0.4,-0.041,-0.07,-0.015
-Moirai-2.0,FlowState,0.6,0.4,0.8,0.071,-0.062,0.201
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Chronos-Bolt,0.65,0.425,0.825,0.068,-0.002,0.135
-Moirai-2.0,Seasonal Naive,0.95,0.85,1.0,0.356,0.268,0.451
-Chronos-Bolt,Toto-2.0-2.5B,0.0,0.0,0.0,-0.307,-0.445,-0.194
-Chronos-Bolt,Toto-2.0-1B,0.0,0.0,0.0,-0.305,-0.452,-0.191
-Chronos-Bolt,Toto-2.0-313m,0.0,0.0,0.0,-0.291,-0.429,-0.186
-Chronos-Bolt,Toto-2.0-22m,0.0,0.0,0.0,-0.232,-0.336,-0.147
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.263,-0.39,-0.152
-Chronos-Bolt,Toto-1.0,0.1,0.0,0.25,-0.189,-0.288,-0.104
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.215,-0.323,-0.124
-Chronos-Bolt,Chronos-2,0.05,0.0,0.15,-0.202,-0.3,-0.112
-Chronos-Bolt,Toto-2.0-4m,0.0,0.0,0.0,-0.17,-0.252,-0.101
-Chronos-Bolt,TiRex-2,0.05,0.0,0.15,-0.145,-0.225,-0.077
-Chronos-Bolt,TimesFM-2.5,0.15,0.0,0.35,-0.157,-0.248,-0.073
-Chronos-Bolt,TS-ICL,0.15,0.0,0.35,-0.152,-0.253,-0.069
-Chronos-Bolt,TiRex,0.25,0.1,0.45,-0.116,-0.198,-0.039
-Chronos-Bolt,FlowState,0.5,0.3,0.7,0.003,-0.127,0.12
-Chronos-Bolt,Moirai-2.0,0.35,0.175,0.575,-0.073,-0.156,0.002
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.85,0.7,1.0,0.309,0.185,0.434
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.891,-1.422,-0.588
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.889,-1.413,-0.593
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.869,-1.396,-0.571
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.783,-1.229,-0.515
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.828,-1.265,-0.554
-Seasonal Naive,Toto-1.0,0.0,0.0,0.0,-0.721,-1.121,-0.477
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.758,-1.164,-0.521
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.74,-1.148,-0.496
-Seasonal Naive,Toto-2.0-4m,0.05,0.0,0.15,-0.693,-1.065,-0.459
-Seasonal Naive,TiRex-2,0.05,0.0,0.15,-0.657,-1.043,-0.414
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.674,-1.003,-0.466
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.667,-1.014,-0.459
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.615,-0.909,-0.418
-Seasonal Naive,FlowState,0.1,0.0,0.25,-0.443,-0.793,-0.172
-Seasonal Naive,Moirai-2.0,0.05,0.0,0.15,-0.552,-0.822,-0.365
-Seasonal Naive,Chronos-Bolt,0.15,0.0,0.3,-0.447,-0.766,-0.228
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_cloud/pairwise_SQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-1B,0.7,0.5,0.851,0.0,-0.014,0.012
-Toto-2.0-2.5B,Toto-2.0-313m,0.8,0.6,0.95,0.007,-0.005,0.02
-Toto-2.0-2.5B,Toto-2.0-22m,1.0,1.0,1.0,0.057,0.035,0.084
-Toto-2.0-2.5B,TimesFM-3,0.85,0.699,1.0,0.034,-0.017,0.07
-Toto-2.0-2.5B,Toto-1.0,1.0,1.0,1.0,0.098,0.06,0.139
-Toto-2.0-2.5B,t0-beta,0.9,0.75,1.0,0.072,0.046,0.101
-Toto-2.0-2.5B,Chronos-2,0.95,0.85,1.0,0.076,0.052,0.104
-Toto-2.0-2.5B,Toto-2.0-4m,1.0,1.0,1.0,0.111,0.069,0.154
-Toto-2.0-2.5B,TiRex-2,1.0,1.0,1.0,0.131,0.084,0.178
-Toto-2.0-2.5B,TimesFM-2.5,1.0,1.0,1.0,0.123,0.081,0.177
-Toto-2.0-2.5B,TiRex,1.0,1.0,1.0,0.148,0.088,0.214
-Toto-2.0-2.5B,TS-ICL,1.0,1.0,1.0,0.125,0.081,0.172
-Toto-2.0-2.5B,TabPFN-TS-3,0.95,0.85,1.0,0.179,0.107,0.265
-Toto-2.0-2.5B,Moirai-2.0,1.0,1.0,1.0,0.199,0.13,0.271
-Toto-2.0-2.5B,Chronos-Bolt,1.0,1.0,1.0,0.262,0.194,0.323
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.667,0.566,0.758
-Toto-2.0-1B,Toto-2.0-2.5B,0.3,0.149,0.5,-0.0,-0.012,0.014
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-313m,0.8,0.6,0.95,0.007,-0.001,0.018
-Toto-2.0-1B,Toto-2.0-22m,1.0,1.0,1.0,0.057,0.031,0.089
-Toto-2.0-1B,TimesFM-3,0.85,0.699,1.0,0.034,-0.026,0.078
-Toto-2.0-1B,Toto-1.0,1.0,1.0,1.0,0.098,0.058,0.137
-Toto-2.0-1B,t0-beta,0.95,0.85,1.0,0.071,0.046,0.106
-Toto-2.0-1B,Chronos-2,0.95,0.85,1.0,0.076,0.045,0.113
-Toto-2.0-1B,Toto-2.0-4m,1.0,1.0,1.0,0.111,0.067,0.159
-Toto-2.0-1B,TiRex-2,0.95,0.85,1.0,0.131,0.083,0.181
-Toto-2.0-1B,TimesFM-2.5,1.0,1.0,1.0,0.123,0.079,0.184
-Toto-2.0-1B,TiRex,1.0,1.0,1.0,0.148,0.088,0.217
-Toto-2.0-1B,TS-ICL,1.0,1.0,1.0,0.125,0.082,0.17
-Toto-2.0-1B,TabPFN-TS-3,0.95,0.85,1.0,0.179,0.102,0.272
-Toto-2.0-1B,Moirai-2.0,1.0,1.0,1.0,0.199,0.129,0.277
-Toto-2.0-1B,Chronos-Bolt,1.0,1.0,1.0,0.262,0.192,0.328
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.667,0.566,0.759
-Toto-2.0-313m,Toto-2.0-2.5B,0.2,0.05,0.4,-0.007,-0.021,0.005
-Toto-2.0-313m,Toto-2.0-1B,0.2,0.05,0.4,-0.007,-0.018,0.001
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-22m,1.0,1.0,1.0,0.05,0.03,0.076
-Toto-2.0-313m,TimesFM-3,0.9,0.75,1.0,0.027,-0.036,0.071
-Toto-2.0-313m,Toto-1.0,1.0,1.0,1.0,0.091,0.055,0.129
-Toto-2.0-313m,t0-beta,0.9,0.75,1.0,0.065,0.036,0.1
-Toto-2.0-313m,Chronos-2,0.95,0.85,1.0,0.069,0.038,0.106
-Toto-2.0-313m,Toto-2.0-4m,1.0,1.0,1.0,0.104,0.064,0.149
-Toto-2.0-313m,TiRex-2,0.95,0.85,1.0,0.124,0.08,0.171
-Toto-2.0-313m,TimesFM-2.5,0.95,0.85,1.0,0.117,0.072,0.179
-Toto-2.0-313m,TiRex,1.0,1.0,1.0,0.142,0.084,0.212
-Toto-2.0-313m,TS-ICL,1.0,1.0,1.0,0.118,0.077,0.165
-Toto-2.0-313m,TabPFN-TS-3,0.95,0.85,1.0,0.173,0.093,0.266
-Toto-2.0-313m,Moirai-2.0,1.0,1.0,1.0,0.193,0.124,0.271
-Toto-2.0-313m,Chronos-Bolt,1.0,1.0,1.0,0.256,0.19,0.318
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.664,0.561,0.758
-Toto-2.0-22m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.061,-0.091,-0.036
-Toto-2.0-22m,Toto-2.0-1B,0.0,0.0,0.0,-0.061,-0.098,-0.032
-Toto-2.0-22m,Toto-2.0-313m,0.0,0.0,0.0,-0.053,-0.082,-0.031
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TimesFM-3,0.7,0.5,0.9,-0.025,-0.101,0.019
-Toto-2.0-22m,Toto-1.0,0.85,0.7,1.0,0.043,0.02,0.071
-Toto-2.0-22m,t0-beta,0.8,0.6,0.95,0.015,-0.024,0.046
-Toto-2.0-22m,Chronos-2,0.85,0.7,1.0,0.02,-0.019,0.047
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.057,0.034,0.082
-Toto-2.0-22m,TiRex-2,0.95,0.85,1.0,0.078,0.049,0.106
-Toto-2.0-22m,TimesFM-2.5,0.85,0.699,1.0,0.07,0.023,0.119
-Toto-2.0-22m,TiRex,0.95,0.85,1.0,0.097,0.053,0.149
-Toto-2.0-22m,TS-ICL,0.9,0.75,1.0,0.071,0.04,0.106
-Toto-2.0-22m,TabPFN-TS-3,0.95,0.85,1.0,0.129,0.048,0.211
-Toto-2.0-22m,Moirai-2.0,1.0,1.0,1.0,0.15,0.094,0.211
-Toto-2.0-22m,Chronos-Bolt,1.0,1.0,1.0,0.217,0.158,0.27
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.646,0.539,0.743
-TimesFM-3,Toto-2.0-2.5B,0.15,0.0,0.301,-0.035,-0.075,0.017
-TimesFM-3,Toto-2.0-1B,0.15,0.0,0.301,-0.035,-0.085,0.026
-TimesFM-3,Toto-2.0-313m,0.1,0.0,0.25,-0.028,-0.077,0.035
-TimesFM-3,Toto-2.0-22m,0.3,0.1,0.5,0.024,-0.019,0.092
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Toto-1.0,0.65,0.45,0.85,0.066,0.014,0.144
-TimesFM-3,t0-beta,0.7,0.5,0.9,0.039,0.01,0.077
-TimesFM-3,Chronos-2,0.85,0.7,1.0,0.043,0.021,0.076
-TimesFM-3,Toto-2.0-4m,0.8,0.6,0.95,0.079,0.028,0.153
-TimesFM-3,TiRex-2,1.0,1.0,1.0,0.1,0.045,0.177
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.092,0.052,0.136
-TimesFM-3,TiRex,0.9,0.75,1.0,0.118,0.052,0.195
-TimesFM-3,TS-ICL,0.95,0.85,1.0,0.094,0.042,0.166
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.15,0.09,0.222
-TimesFM-3,Moirai-2.0,1.0,1.0,1.0,0.17,0.097,0.253
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.236,0.16,0.31
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.655,0.557,0.746
-Toto-1.0,Toto-2.0-2.5B,0.0,0.0,0.0,-0.109,-0.162,-0.064
-Toto-1.0,Toto-2.0-1B,0.0,0.0,0.0,-0.108,-0.159,-0.062
-Toto-1.0,Toto-2.0-313m,0.0,0.0,0.0,-0.1,-0.148,-0.058
-Toto-1.0,Toto-2.0-22m,0.15,0.0,0.3,-0.045,-0.076,-0.02
-Toto-1.0,TimesFM-3,0.35,0.15,0.55,-0.071,-0.169,-0.014
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,t0-beta,0.65,0.45,0.85,-0.029,-0.081,0.007
-Toto-1.0,Chronos-2,0.6,0.4,0.8,-0.024,-0.08,0.018
-Toto-1.0,Toto-2.0-4m,0.7,0.5,0.9,0.014,-0.008,0.036
-Toto-1.0,TiRex-2,0.85,0.7,1.0,0.037,0.012,0.06
-Toto-1.0,TimesFM-2.5,0.75,0.55,0.95,0.028,-0.025,0.076
-Toto-1.0,TiRex,0.8,0.6,0.95,0.056,0.022,0.104
-Toto-1.0,TS-ICL,0.8,0.65,0.95,0.03,0.004,0.056
-Toto-1.0,TabPFN-TS-3,0.95,0.85,1.0,0.09,0.005,0.175
-Toto-1.0,Moirai-2.0,0.95,0.85,1.0,0.112,0.064,0.169
-Toto-1.0,Chronos-Bolt,0.95,0.85,1.0,0.182,0.124,0.236
-Toto-1.0,Seasonal Naive,1.0,1.0,1.0,0.631,0.52,0.73
-t0-beta,Toto-2.0-2.5B,0.1,0.0,0.25,-0.077,-0.113,-0.048
-t0-beta,Toto-2.0-1B,0.05,0.0,0.15,-0.077,-0.118,-0.048
-t0-beta,Toto-2.0-313m,0.1,0.0,0.25,-0.069,-0.111,-0.038
-t0-beta,Toto-2.0-22m,0.2,0.05,0.4,-0.015,-0.048,0.023
-t0-beta,TimesFM-3,0.3,0.1,0.5,-0.04,-0.084,-0.01
-t0-beta,Toto-1.0,0.35,0.15,0.55,0.028,-0.007,0.075
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Chronos-2,0.5,0.3,0.7,0.005,-0.019,0.027
-t0-beta,Toto-2.0-4m,0.55,0.35,0.75,0.042,0.003,0.089
-t0-beta,TiRex-2,0.7,0.5,0.9,0.064,0.02,0.116
-t0-beta,TimesFM-2.5,0.8,0.6,0.95,0.056,0.028,0.09
-t0-beta,TiRex,0.7,0.5,0.9,0.083,0.031,0.143
-t0-beta,TS-ICL,0.95,0.85,1.0,0.057,0.025,0.101
-t0-beta,TabPFN-TS-3,0.85,0.65,1.0,0.115,0.053,0.197
-t0-beta,Moirai-2.0,0.95,0.85,1.0,0.137,0.076,0.206
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.205,0.138,0.27
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.641,0.539,0.734
-Chronos-2,Toto-2.0-2.5B,0.05,0.0,0.15,-0.082,-0.116,-0.055
-Chronos-2,Toto-2.0-1B,0.05,0.0,0.15,-0.082,-0.127,-0.047
-Chronos-2,Toto-2.0-313m,0.05,0.0,0.15,-0.074,-0.119,-0.039
-Chronos-2,Toto-2.0-22m,0.15,0.0,0.3,-0.02,-0.049,0.019
-Chronos-2,TimesFM-3,0.15,0.0,0.3,-0.045,-0.082,-0.021
-Chronos-2,Toto-1.0,0.4,0.2,0.6,0.024,-0.018,0.074
-Chronos-2,t0-beta,0.5,0.3,0.7,-0.005,-0.028,0.018
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-2.0-4m,0.6,0.35,0.8,0.038,0.001,0.085
-Chronos-2,TiRex-2,0.65,0.4,0.85,0.059,0.017,0.111
-Chronos-2,TimesFM-2.5,0.75,0.55,0.9,0.051,0.017,0.09
-Chronos-2,TiRex,0.75,0.55,0.9,0.078,0.024,0.139
-Chronos-2,TS-ICL,0.75,0.55,0.9,0.052,0.01,0.104
-Chronos-2,TabPFN-TS-3,0.85,0.7,1.0,0.111,0.053,0.183
-Chronos-2,Moirai-2.0,1.0,1.0,1.0,0.133,0.069,0.2
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.201,0.134,0.261
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.639,0.533,0.735
-Toto-2.0-4m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.125,-0.182,-0.074
-Toto-2.0-4m,Toto-2.0-1B,0.0,0.0,0.0,-0.125,-0.189,-0.072
-Toto-2.0-4m,Toto-2.0-313m,0.0,0.0,0.0,-0.116,-0.175,-0.069
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.06,-0.089,-0.035
-Toto-2.0-4m,TimesFM-3,0.2,0.05,0.4,-0.086,-0.18,-0.029
-Toto-2.0-4m,Toto-1.0,0.3,0.1,0.5,-0.015,-0.037,0.008
-Toto-2.0-4m,t0-beta,0.45,0.25,0.65,-0.044,-0.098,-0.003
-Toto-2.0-4m,Chronos-2,0.4,0.2,0.65,-0.039,-0.093,-0.001
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,TiRex-2,0.8,0.6,0.95,0.022,0.009,0.035
-Toto-2.0-4m,TimesFM-2.5,0.65,0.4,0.85,0.014,-0.039,0.056
-Toto-2.0-4m,TiRex,0.75,0.55,0.9,0.042,0.015,0.077
-Toto-2.0-4m,TS-ICL,0.8,0.65,0.95,0.015,-0.014,0.039
-Toto-2.0-4m,TabPFN-TS-3,0.85,0.7,1.0,0.076,-0.009,0.147
-Toto-2.0-4m,Moirai-2.0,1.0,1.0,1.0,0.099,0.061,0.145
-Toto-2.0-4m,Chronos-Bolt,1.0,1.0,1.0,0.17,0.12,0.218
-Toto-2.0-4m,Seasonal Naive,1.0,1.0,1.0,0.625,0.515,0.726
-TiRex-2,Toto-2.0-2.5B,0.0,0.0,0.0,-0.151,-0.216,-0.092
-TiRex-2,Toto-2.0-1B,0.05,0.0,0.15,-0.15,-0.22,-0.09
-TiRex-2,Toto-2.0-313m,0.05,0.0,0.15,-0.142,-0.206,-0.087
-TiRex-2,Toto-2.0-22m,0.05,0.0,0.15,-0.085,-0.119,-0.051
-TiRex-2,TimesFM-3,0.0,0.0,0.0,-0.111,-0.215,-0.047
-TiRex-2,Toto-1.0,0.15,0.0,0.3,-0.038,-0.064,-0.012
-TiRex-2,t0-beta,0.3,0.1,0.5,-0.068,-0.131,-0.021
-TiRex-2,Chronos-2,0.35,0.15,0.6,-0.063,-0.125,-0.017
-TiRex-2,Toto-2.0-4m,0.2,0.05,0.4,-0.023,-0.037,-0.009
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-2.5,0.55,0.349,0.75,-0.009,-0.07,0.04
-TiRex-2,TiRex,0.65,0.45,0.85,0.02,-0.01,0.064
-TiRex-2,TS-ICL,0.6,0.4,0.8,-0.007,-0.046,0.022
-TiRex-2,TabPFN-TS-3,0.85,0.7,1.0,0.055,-0.036,0.135
-TiRex-2,Moirai-2.0,0.9,0.75,1.0,0.078,0.043,0.128
-TiRex-2,Chronos-Bolt,0.95,0.85,1.0,0.151,0.106,0.197
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.617,0.505,0.72
-TimesFM-2.5,Toto-2.0-2.5B,0.0,0.0,0.0,-0.141,-0.216,-0.088
-TimesFM-2.5,Toto-2.0-1B,0.0,0.0,0.0,-0.141,-0.226,-0.086
-TimesFM-2.5,Toto-2.0-313m,0.05,0.0,0.15,-0.132,-0.218,-0.078
-TimesFM-2.5,Toto-2.0-22m,0.15,0.0,0.301,-0.075,-0.136,-0.024
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.102,-0.158,-0.055
-TimesFM-2.5,Toto-1.0,0.25,0.05,0.45,-0.029,-0.082,0.024
-TimesFM-2.5,t0-beta,0.2,0.05,0.4,-0.059,-0.098,-0.029
-TimesFM-2.5,Chronos-2,0.25,0.1,0.45,-0.054,-0.099,-0.017
-TimesFM-2.5,Toto-2.0-4m,0.35,0.15,0.6,-0.014,-0.059,0.038
-TimesFM-2.5,TiRex-2,0.45,0.25,0.651,0.009,-0.041,0.065
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,TiRex,0.6,0.4,0.8,0.028,-0.014,0.08
-TimesFM-2.5,TS-ICL,0.4,0.2,0.6,0.001,-0.038,0.052
-TimesFM-2.5,TabPFN-TS-3,0.75,0.55,0.95,0.063,0.005,0.129
-TimesFM-2.5,Moirai-2.0,0.9,0.75,1.0,0.086,0.038,0.143
-TimesFM-2.5,Chronos-Bolt,0.9,0.75,1.0,0.158,0.095,0.217
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.62,0.519,0.713
-TiRex,Toto-2.0-2.5B,0.0,0.0,0.0,-0.174,-0.273,-0.097
-TiRex,Toto-2.0-1B,0.0,0.0,0.0,-0.174,-0.277,-0.096
-TiRex,Toto-2.0-313m,0.0,0.0,0.0,-0.166,-0.27,-0.091
-TiRex,Toto-2.0-22m,0.05,0.0,0.15,-0.107,-0.176,-0.056
-TiRex,TimesFM-3,0.1,0.0,0.25,-0.134,-0.243,-0.055
-TiRex,Toto-1.0,0.2,0.05,0.4,-0.059,-0.116,-0.023
-TiRex,t0-beta,0.3,0.1,0.5,-0.09,-0.167,-0.032
-TiRex,Chronos-2,0.25,0.1,0.45,-0.085,-0.162,-0.025
-TiRex,Toto-2.0-4m,0.25,0.1,0.45,-0.044,-0.083,-0.015
-TiRex,TiRex-2,0.35,0.15,0.55,-0.02,-0.068,0.01
-TiRex,TimesFM-2.5,0.4,0.2,0.6,-0.029,-0.086,0.013
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TS-ICL,0.5,0.3,0.7,-0.028,-0.072,0.001
-TiRex,TabPFN-TS-3,0.8,0.6,0.95,0.036,-0.056,0.102
-TiRex,Moirai-2.0,0.85,0.7,1.0,0.059,0.03,0.09
-TiRex,Chronos-Bolt,0.9,0.75,1.0,0.133,0.073,0.186
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.609,0.499,0.709
-TS-ICL,Toto-2.0-2.5B,0.0,0.0,0.0,-0.142,-0.208,-0.088
-TS-ICL,Toto-2.0-1B,0.0,0.0,0.0,-0.142,-0.205,-0.09
-TS-ICL,Toto-2.0-313m,0.0,0.0,0.0,-0.134,-0.197,-0.083
-TS-ICL,Toto-2.0-22m,0.1,0.0,0.25,-0.077,-0.118,-0.041
-TS-ICL,TimesFM-3,0.05,0.0,0.15,-0.103,-0.199,-0.044
-TS-ICL,Toto-1.0,0.2,0.05,0.35,-0.031,-0.06,-0.004
-TS-ICL,t0-beta,0.05,0.0,0.15,-0.061,-0.112,-0.026
-TS-ICL,Chronos-2,0.25,0.1,0.45,-0.055,-0.116,-0.01
-TS-ICL,Toto-2.0-4m,0.2,0.05,0.35,-0.016,-0.041,0.014
-TS-ICL,TiRex-2,0.4,0.2,0.6,0.007,-0.023,0.044
-TS-ICL,TimesFM-2.5,0.6,0.4,0.8,-0.001,-0.055,0.037
-TS-ICL,TiRex,0.5,0.3,0.7,0.027,-0.001,0.067
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TabPFN-TS-3,0.8,0.6,0.95,0.062,-0.031,0.15
-TS-ICL,Moirai-2.0,0.75,0.55,0.901,0.084,0.038,0.139
-TS-ICL,Chronos-Bolt,0.95,0.85,1.0,0.157,0.095,0.219
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.619,0.512,0.717
-TabPFN-TS-3,Toto-2.0-2.5B,0.05,0.0,0.15,-0.218,-0.361,-0.12
-TabPFN-TS-3,Toto-2.0-1B,0.05,0.0,0.15,-0.218,-0.374,-0.114
-TabPFN-TS-3,Toto-2.0-313m,0.05,0.0,0.15,-0.209,-0.363,-0.103
-TabPFN-TS-3,Toto-2.0-22m,0.05,0.0,0.15,-0.148,-0.267,-0.05
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.176,-0.285,-0.099
-TabPFN-TS-3,Toto-1.0,0.05,0.0,0.15,-0.098,-0.212,-0.005
-TabPFN-TS-3,t0-beta,0.15,0.0,0.35,-0.131,-0.246,-0.056
-TabPFN-TS-3,Chronos-2,0.15,0.0,0.3,-0.125,-0.223,-0.057
-TabPFN-TS-3,Toto-2.0-4m,0.15,0.0,0.3,-0.083,-0.172,0.009
-TabPFN-TS-3,TiRex-2,0.15,0.0,0.3,-0.058,-0.156,0.035
-TabPFN-TS-3,TimesFM-2.5,0.25,0.05,0.45,-0.067,-0.148,-0.006
-TabPFN-TS-3,TiRex,0.2,0.05,0.4,-0.037,-0.113,0.053
-TabPFN-TS-3,TS-ICL,0.2,0.05,0.4,-0.066,-0.176,0.03
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,Moirai-2.0,0.45,0.25,0.65,0.024,-0.037,0.104
-TabPFN-TS-3,Chronos-Bolt,0.65,0.4,0.85,0.101,0.008,0.193
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.594,0.486,0.694
-Moirai-2.0,Toto-2.0-2.5B,0.0,0.0,0.0,-0.248,-0.371,-0.15
-Moirai-2.0,Toto-2.0-1B,0.0,0.0,0.0,-0.248,-0.383,-0.148
-Moirai-2.0,Toto-2.0-313m,0.0,0.0,0.0,-0.239,-0.371,-0.142
-Moirai-2.0,Toto-2.0-22m,0.0,0.0,0.0,-0.176,-0.267,-0.104
-Moirai-2.0,TimesFM-3,0.0,0.0,0.0,-0.205,-0.338,-0.108
-Moirai-2.0,Toto-1.0,0.05,0.0,0.15,-0.126,-0.203,-0.068
-Moirai-2.0,t0-beta,0.05,0.0,0.15,-0.159,-0.259,-0.082
-Moirai-2.0,Chronos-2,0.0,0.0,0.0,-0.153,-0.249,-0.074
-Moirai-2.0,Toto-2.0-4m,0.0,0.0,0.0,-0.109,-0.169,-0.065
-Moirai-2.0,TiRex-2,0.1,0.0,0.25,-0.085,-0.146,-0.045
-Moirai-2.0,TimesFM-2.5,0.1,0.0,0.25,-0.094,-0.167,-0.039
-Moirai-2.0,TiRex,0.15,0.0,0.3,-0.063,-0.099,-0.03
-Moirai-2.0,TS-ICL,0.25,0.099,0.45,-0.092,-0.161,-0.04
-Moirai-2.0,TabPFN-TS-3,0.55,0.35,0.75,-0.025,-0.116,0.035
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Chronos-Bolt,0.8,0.6,0.95,0.079,0.017,0.14
-Moirai-2.0,Seasonal Naive,1.0,1.0,1.0,0.584,0.469,0.689
-Chronos-Bolt,Toto-2.0-2.5B,0.0,0.0,0.0,-0.355,-0.477,-0.24
-Chronos-Bolt,Toto-2.0-1B,0.0,0.0,0.0,-0.354,-0.487,-0.237
-Chronos-Bolt,Toto-2.0-313m,0.0,0.0,0.0,-0.345,-0.466,-0.235
-Chronos-Bolt,Toto-2.0-22m,0.0,0.0,0.0,-0.277,-0.37,-0.188
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.308,-0.45,-0.19
-Chronos-Bolt,Toto-1.0,0.05,0.0,0.15,-0.222,-0.31,-0.141
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.258,-0.369,-0.16
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.251,-0.352,-0.155
-Chronos-Bolt,Toto-2.0-4m,0.0,0.0,0.0,-0.204,-0.279,-0.137
-Chronos-Bolt,TiRex-2,0.05,0.0,0.15,-0.177,-0.246,-0.119
-Chronos-Bolt,TimesFM-2.5,0.1,0.0,0.25,-0.187,-0.277,-0.105
-Chronos-Bolt,TiRex,0.1,0.0,0.25,-0.154,-0.229,-0.079
-Chronos-Bolt,TS-ICL,0.05,0.0,0.15,-0.186,-0.28,-0.105
-Chronos-Bolt,TabPFN-TS-3,0.35,0.15,0.6,-0.112,-0.239,-0.008
-Chronos-Bolt,Moirai-2.0,0.2,0.05,0.4,-0.086,-0.162,-0.017
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.9,0.75,1.0,0.549,0.413,0.67
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-2.001,-3.137,-1.304
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-2.001,-3.152,-1.302
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-1.979,-3.139,-1.28
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-1.829,-2.894,-1.168
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-1.898,-2.937,-1.256
-Seasonal Naive,Toto-1.0,0.0,0.0,0.0,-1.707,-2.709,-1.085
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-1.786,-2.755,-1.169
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-1.772,-2.77,-1.139
-Seasonal Naive,Toto-2.0-4m,0.0,0.0,0.0,-1.668,-2.646,-1.063
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-1.608,-2.568,-1.019
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-1.631,-2.486,-1.077
-Seasonal Naive,TiRex,0.0,0.0,0.0,-1.556,-2.437,-0.997
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-1.627,-2.533,-1.049
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-1.464,-2.271,-0.947
-Seasonal Naive,Moirai-2.0,0.0,0.0,0.0,-1.405,-2.214,-0.883
-Seasonal Naive,Chronos-Bolt,0.1,0.0,0.25,-1.215,-2.027,-0.704
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_cloud/pairwise_WAPE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-1B,0.65,0.4,0.85,0.013,-0.0,0.033
-Toto-2.0-2.5B,Toto-2.0-313m,0.85,0.65,1.0,0.021,0.003,0.051
-Toto-2.0-2.5B,Toto-2.0-22m,1.0,1.0,1.0,0.071,0.029,0.124
-Toto-2.0-2.5B,TimesFM-3,0.85,0.7,1.0,0.013,-0.079,0.073
-Toto-2.0-2.5B,t0-beta,1.0,1.0,1.0,0.082,0.051,0.116
-Toto-2.0-2.5B,Chronos-2,0.9,0.75,1.0,0.063,0.023,0.11
-Toto-2.0-2.5B,Toto-1.0,1.0,1.0,1.0,0.125,0.053,0.213
-Toto-2.0-2.5B,Toto-2.0-4m,1.0,1.0,1.0,0.125,0.066,0.193
-Toto-2.0-2.5B,TiRex-2,1.0,1.0,1.0,0.134,0.073,0.209
-Toto-2.0-2.5B,TimesFM-2.5,0.95,0.85,1.0,0.139,0.086,0.203
-Toto-2.0-2.5B,TiRex,1.0,1.0,1.0,0.166,0.087,0.257
-Toto-2.0-2.5B,TS-ICL,1.0,1.0,1.0,0.144,0.086,0.219
-Toto-2.0-2.5B,FlowState,0.95,0.85,1.0,0.168,0.079,0.256
-Toto-2.0-2.5B,TabPFN-TS-3,0.95,0.85,1.0,0.139,0.049,0.245
-Toto-2.0-2.5B,Chronos-Bolt,1.0,1.0,1.0,0.23,0.156,0.302
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.537,0.421,0.654
-Toto-2.0-1B,Toto-2.0-2.5B,0.35,0.15,0.6,-0.013,-0.034,0.0
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-313m,0.7,0.5,0.9,0.009,-0.002,0.023
-Toto-2.0-1B,Toto-2.0-22m,1.0,1.0,1.0,0.058,0.025,0.099
-Toto-2.0-1B,TimesFM-3,0.8,0.6,0.95,-0.0,-0.113,0.07
-Toto-2.0-1B,t0-beta,1.0,1.0,1.0,0.069,0.045,0.101
-Toto-2.0-1B,Chronos-2,0.9,0.75,1.0,0.051,-0.006,0.103
-Toto-2.0-1B,Toto-1.0,1.0,1.0,1.0,0.113,0.051,0.188
-Toto-2.0-1B,Toto-2.0-4m,1.0,1.0,1.0,0.113,0.062,0.171
-Toto-2.0-1B,TiRex-2,1.0,1.0,1.0,0.122,0.069,0.184
-Toto-2.0-1B,TimesFM-2.5,1.0,1.0,1.0,0.127,0.081,0.191
-Toto-2.0-1B,TiRex,1.0,1.0,1.0,0.155,0.082,0.239
-Toto-2.0-1B,TS-ICL,1.0,1.0,1.0,0.133,0.082,0.193
-Toto-2.0-1B,FlowState,0.95,0.85,1.0,0.157,0.056,0.251
-Toto-2.0-1B,TabPFN-TS-3,0.95,0.85,1.0,0.128,0.019,0.239
-Toto-2.0-1B,Chronos-Bolt,1.0,1.0,1.0,0.22,0.152,0.285
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.531,0.419,0.647
-Toto-2.0-313m,Toto-2.0-2.5B,0.15,0.0,0.35,-0.022,-0.054,-0.003
-Toto-2.0-313m,Toto-2.0-1B,0.3,0.1,0.5,-0.009,-0.023,0.002
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-22m,1.0,1.0,1.0,0.05,0.024,0.082
-Toto-2.0-313m,TimesFM-3,0.8,0.6,0.95,-0.009,-0.132,0.066
-Toto-2.0-313m,t0-beta,0.95,0.85,1.0,0.061,0.036,0.094
-Toto-2.0-313m,Chronos-2,0.9,0.75,1.0,0.043,-0.025,0.097
-Toto-2.0-313m,Toto-1.0,1.0,1.0,1.0,0.106,0.048,0.177
-Toto-2.0-313m,Toto-2.0-4m,1.0,1.0,1.0,0.106,0.06,0.159
-Toto-2.0-313m,TiRex-2,1.0,1.0,1.0,0.115,0.068,0.169
-Toto-2.0-313m,TimesFM-2.5,1.0,1.0,1.0,0.12,0.076,0.18
-Toto-2.0-313m,TiRex,1.0,1.0,1.0,0.147,0.08,0.229
-Toto-2.0-313m,TS-ICL,1.0,1.0,1.0,0.125,0.079,0.176
-Toto-2.0-313m,FlowState,0.95,0.85,1.0,0.149,0.038,0.248
-Toto-2.0-313m,TabPFN-TS-3,0.95,0.85,1.0,0.121,-0.004,0.231
-Toto-2.0-313m,Chronos-Bolt,1.0,1.0,1.0,0.213,0.151,0.275
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.527,0.414,0.642
-Toto-2.0-22m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.076,-0.142,-0.03
-Toto-2.0-22m,Toto-2.0-1B,0.0,0.0,0.0,-0.062,-0.11,-0.026
-Toto-2.0-22m,Toto-2.0-313m,0.0,0.0,0.0,-0.053,-0.089,-0.025
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TimesFM-3,0.7,0.5,0.9,-0.062,-0.216,0.014
-Toto-2.0-22m,t0-beta,0.9,0.75,1.0,0.012,-0.026,0.038
-Toto-2.0-22m,Chronos-2,0.8,0.6,0.95,-0.008,-0.096,0.044
-Toto-2.0-22m,Toto-1.0,0.9,0.75,1.0,0.059,0.02,0.114
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.058,0.034,0.085
-Toto-2.0-22m,TiRex-2,0.95,0.85,1.0,0.068,0.042,0.099
-Toto-2.0-22m,TimesFM-2.5,0.9,0.75,1.0,0.073,0.036,0.118
-Toto-2.0-22m,TiRex,0.95,0.85,1.0,0.102,0.053,0.16
-Toto-2.0-22m,TS-ICL,0.95,0.85,1.0,0.079,0.05,0.11
-Toto-2.0-22m,FlowState,0.95,0.85,1.0,0.104,-0.035,0.209
-Toto-2.0-22m,TabPFN-TS-3,0.95,0.85,1.0,0.074,-0.075,0.178
-Toto-2.0-22m,Chronos-Bolt,1.0,1.0,1.0,0.171,0.122,0.223
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.502,0.392,0.613
-TimesFM-3,Toto-2.0-2.5B,0.15,0.0,0.3,-0.013,-0.079,0.074
-TimesFM-3,Toto-2.0-1B,0.2,0.05,0.4,0.0,-0.075,0.102
-TimesFM-3,Toto-2.0-313m,0.2,0.05,0.4,0.009,-0.07,0.117
-TimesFM-3,Toto-2.0-22m,0.3,0.1,0.5,0.059,-0.015,0.178
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,t0-beta,0.75,0.55,0.95,0.07,0.011,0.162
-TimesFM-3,Chronos-2,0.8,0.65,0.95,0.051,0.016,0.104
-TimesFM-3,Toto-1.0,0.75,0.55,0.95,0.114,0.013,0.263
-TimesFM-3,Toto-2.0-4m,0.9,0.75,1.0,0.114,0.029,0.24
-TimesFM-3,TiRex-2,1.0,1.0,1.0,0.123,0.038,0.253
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.128,0.055,0.225
-TimesFM-3,TiRex,0.85,0.7,1.0,0.155,0.052,0.292
-TimesFM-3,TS-ICL,0.9,0.75,1.0,0.133,0.05,0.26
-TimesFM-3,FlowState,0.95,0.85,1.0,0.157,0.094,0.22
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.128,0.084,0.194
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.22,0.125,0.332
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.531,0.408,0.645
-t0-beta,Toto-2.0-2.5B,0.0,0.0,0.0,-0.089,-0.131,-0.054
-t0-beta,Toto-2.0-1B,0.0,0.0,0.0,-0.075,-0.112,-0.047
-t0-beta,Toto-2.0-313m,0.05,0.0,0.15,-0.066,-0.104,-0.038
-t0-beta,Toto-2.0-22m,0.1,0.0,0.25,-0.012,-0.04,0.025
-t0-beta,TimesFM-3,0.25,0.05,0.45,-0.075,-0.193,-0.011
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Chronos-2,0.55,0.35,0.75,-0.02,-0.079,0.018
-t0-beta,Toto-1.0,0.5,0.3,0.7,0.047,-0.011,0.121
-t0-beta,Toto-2.0-4m,0.6,0.4,0.8,0.047,0.005,0.097
-t0-beta,TiRex-2,0.8,0.6,0.95,0.057,0.013,0.115
-t0-beta,TimesFM-2.5,0.85,0.7,1.0,0.062,0.032,0.104
-t0-beta,TiRex,0.75,0.55,0.95,0.091,0.03,0.166
-t0-beta,TS-ICL,0.9,0.75,1.0,0.068,0.029,0.123
-t0-beta,FlowState,0.9,0.75,1.0,0.094,-0.012,0.183
-t0-beta,TabPFN-TS-3,0.85,0.65,1.0,0.063,-0.051,0.16
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.161,0.108,0.217
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.496,0.388,0.609
-Chronos-2,Toto-2.0-2.5B,0.1,0.0,0.25,-0.068,-0.124,-0.023
-Chronos-2,Toto-2.0-1B,0.1,0.0,0.25,-0.054,-0.115,0.006
-Chronos-2,Toto-2.0-313m,0.1,0.0,0.25,-0.045,-0.107,0.024
-Chronos-2,Toto-2.0-22m,0.2,0.05,0.4,0.008,-0.046,0.087
-Chronos-2,TimesFM-3,0.2,0.05,0.35,-0.054,-0.116,-0.016
-Chronos-2,t0-beta,0.45,0.25,0.65,0.019,-0.019,0.073
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-1.0,0.35,0.15,0.55,0.066,-0.014,0.174
-Chronos-2,Toto-2.0-4m,0.6,0.35,0.8,0.066,0.005,0.155
-Chronos-2,TiRex-2,0.85,0.65,1.0,0.075,0.013,0.169
-Chronos-2,TimesFM-2.5,0.75,0.55,0.9,0.08,0.03,0.14
-Chronos-2,TiRex,0.8,0.6,0.95,0.109,0.032,0.209
-Chronos-2,TS-ICL,0.9,0.75,1.0,0.086,0.029,0.175
-Chronos-2,FlowState,0.8,0.6,0.95,0.111,0.049,0.183
-Chronos-2,TabPFN-TS-3,0.85,0.65,1.0,0.081,0.019,0.155
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.178,0.103,0.259
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.506,0.388,0.617
-Toto-1.0,Toto-2.0-2.5B,0.0,0.0,0.0,-0.143,-0.27,-0.056
-Toto-1.0,Toto-2.0-1B,0.0,0.0,0.0,-0.128,-0.232,-0.054
-Toto-1.0,Toto-2.0-313m,0.0,0.0,0.0,-0.118,-0.215,-0.05
-Toto-1.0,Toto-2.0-22m,0.1,0.0,0.25,-0.062,-0.128,-0.021
-Toto-1.0,TimesFM-3,0.25,0.05,0.45,-0.128,-0.356,-0.013
-Toto-1.0,t0-beta,0.5,0.3,0.7,-0.05,-0.138,0.01
-Toto-1.0,Chronos-2,0.65,0.45,0.85,-0.07,-0.211,0.014
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,Toto-2.0-4m,0.75,0.55,0.95,-0.0,-0.046,0.03
-Toto-1.0,TiRex-2,0.8,0.65,0.95,0.01,-0.05,0.046
-Toto-1.0,TimesFM-2.5,0.8,0.6,0.95,0.016,-0.049,0.069
-Toto-1.0,TiRex,0.75,0.55,0.9,0.046,-0.002,0.1
-Toto-1.0,TS-ICL,0.8,0.65,0.95,0.022,-0.02,0.054
-Toto-1.0,FlowState,0.8,0.6,0.95,0.049,-0.12,0.172
-Toto-1.0,TabPFN-TS-3,0.85,0.699,1.0,0.016,-0.189,0.136
-Toto-1.0,Chronos-Bolt,0.95,0.85,1.0,0.12,0.051,0.182
-Toto-1.0,Seasonal Naive,1.0,1.0,1.0,0.471,0.37,0.58
-Toto-2.0-4m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.143,-0.239,-0.07
-Toto-2.0-4m,Toto-2.0-1B,0.0,0.0,0.0,-0.128,-0.206,-0.066
-Toto-2.0-4m,Toto-2.0-313m,0.0,0.0,0.0,-0.118,-0.189,-0.063
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.062,-0.093,-0.036
-Toto-2.0-4m,TimesFM-3,0.1,0.0,0.25,-0.128,-0.316,-0.03
-Toto-2.0-4m,t0-beta,0.4,0.2,0.6,-0.049,-0.108,-0.005
-Toto-2.0-4m,Chronos-2,0.4,0.2,0.65,-0.07,-0.184,-0.005
-Toto-2.0-4m,Toto-1.0,0.25,0.05,0.45,0.0,-0.031,0.044
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,TiRex-2,0.75,0.55,0.9,0.01,-0.012,0.033
-Toto-2.0-4m,TimesFM-2.5,0.7,0.5,0.9,0.016,-0.025,0.049
-Toto-2.0-4m,TiRex,0.75,0.55,0.9,0.047,0.016,0.086
-Toto-2.0-4m,TS-ICL,0.75,0.55,0.9,0.022,0.0,0.042
-Toto-2.0-4m,FlowState,0.8,0.6,0.95,0.049,-0.109,0.156
-Toto-2.0-4m,TabPFN-TS-3,0.75,0.55,0.95,0.017,-0.155,0.119
-Toto-2.0-4m,Chronos-Bolt,1.0,1.0,1.0,0.12,0.077,0.168
-Toto-2.0-4m,Seasonal Naive,1.0,1.0,1.0,0.471,0.364,0.579
-TiRex-2,Toto-2.0-2.5B,0.0,0.0,0.0,-0.155,-0.264,-0.079
-TiRex-2,Toto-2.0-1B,0.0,0.0,0.0,-0.14,-0.226,-0.074
-TiRex-2,Toto-2.0-313m,0.0,0.0,0.0,-0.13,-0.204,-0.073
-TiRex-2,Toto-2.0-22m,0.05,0.0,0.15,-0.073,-0.11,-0.044
-TiRex-2,TimesFM-3,0.0,0.0,0.0,-0.14,-0.339,-0.039
-TiRex-2,t0-beta,0.2,0.05,0.4,-0.06,-0.13,-0.013
-TiRex-2,Chronos-2,0.15,0.0,0.35,-0.081,-0.204,-0.013
-TiRex-2,Toto-1.0,0.2,0.05,0.35,-0.01,-0.049,0.047
-TiRex-2,Toto-2.0-4m,0.25,0.1,0.45,-0.01,-0.034,0.012
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-2.5,0.65,0.45,0.85,0.006,-0.055,0.053
-TiRex-2,TiRex,0.65,0.45,0.85,0.037,0.003,0.082
-TiRex-2,TS-ICL,0.7,0.5,0.9,0.012,-0.013,0.038
-TiRex-2,FlowState,0.75,0.55,0.95,0.039,-0.135,0.155
-TiRex-2,TabPFN-TS-3,0.8,0.65,0.95,0.006,-0.176,0.12
-TiRex-2,Chronos-Bolt,0.95,0.85,1.0,0.111,0.066,0.165
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.466,0.355,0.579
-TimesFM-2.5,Toto-2.0-2.5B,0.05,0.0,0.15,-0.161,-0.255,-0.094
-TimesFM-2.5,Toto-2.0-1B,0.0,0.0,0.0,-0.146,-0.236,-0.088
-TimesFM-2.5,Toto-2.0-313m,0.0,0.0,0.0,-0.136,-0.22,-0.082
-TimesFM-2.5,Toto-2.0-22m,0.1,0.0,0.25,-0.079,-0.134,-0.037
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.146,-0.291,-0.058
-TimesFM-2.5,t0-beta,0.15,0.0,0.3,-0.066,-0.116,-0.033
-TimesFM-2.5,Chronos-2,0.25,0.1,0.45,-0.088,-0.162,-0.031
-TimesFM-2.5,Toto-1.0,0.2,0.05,0.4,-0.016,-0.074,0.047
-TimesFM-2.5,Toto-2.0-4m,0.3,0.1,0.5,-0.016,-0.052,0.025
-TimesFM-2.5,TiRex-2,0.35,0.15,0.55,-0.006,-0.056,0.052
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,TiRex,0.6,0.4,0.8,0.031,-0.009,0.083
-TimesFM-2.5,TS-ICL,0.6,0.4,0.8,0.006,-0.033,0.051
-TimesFM-2.5,FlowState,0.8,0.6,0.95,0.033,-0.09,0.123
-TimesFM-2.5,TabPFN-TS-3,0.7,0.5,0.9,0.001,-0.121,0.081
-TimesFM-2.5,Chronos-Bolt,0.9,0.75,1.0,0.106,0.065,0.148
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.462,0.364,0.568
-TiRex,Toto-2.0-2.5B,0.0,0.0,0.0,-0.199,-0.346,-0.095
-TiRex,Toto-2.0-1B,0.0,0.0,0.0,-0.183,-0.313,-0.089
-TiRex,Toto-2.0-313m,0.0,0.0,0.0,-0.173,-0.296,-0.087
-TiRex,Toto-2.0-22m,0.05,0.0,0.15,-0.114,-0.191,-0.056
-TiRex,TimesFM-3,0.15,0.0,0.3,-0.183,-0.412,-0.055
-TiRex,t0-beta,0.25,0.05,0.45,-0.101,-0.199,-0.031
-TiRex,Chronos-2,0.2,0.05,0.4,-0.122,-0.264,-0.033
-TiRex,Toto-1.0,0.25,0.1,0.45,-0.049,-0.111,0.002
-TiRex,Toto-2.0-4m,0.25,0.1,0.45,-0.049,-0.094,-0.016
-TiRex,TiRex-2,0.35,0.15,0.55,-0.038,-0.09,-0.003
-TiRex,TimesFM-2.5,0.4,0.2,0.6,-0.032,-0.091,0.009
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TS-ICL,0.55,0.35,0.75,-0.026,-0.071,0.004
-TiRex,FlowState,0.6,0.4,0.8,0.002,-0.176,0.116
-TiRex,TabPFN-TS-3,0.75,0.55,0.901,-0.031,-0.219,0.065
-TiRex,Chronos-Bolt,0.85,0.65,1.0,0.077,0.03,0.124
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.445,0.35,0.545
-TS-ICL,Toto-2.0-2.5B,0.0,0.0,0.0,-0.168,-0.28,-0.094
-TS-ICL,Toto-2.0-1B,0.0,0.0,0.0,-0.153,-0.239,-0.09
-TS-ICL,Toto-2.0-313m,0.0,0.0,0.0,-0.143,-0.213,-0.086
-TS-ICL,Toto-2.0-22m,0.05,0.0,0.15,-0.086,-0.124,-0.053
-TS-ICL,TimesFM-3,0.1,0.0,0.25,-0.153,-0.351,-0.052
-TS-ICL,t0-beta,0.1,0.0,0.25,-0.073,-0.14,-0.03
-TS-ICL,Chronos-2,0.1,0.0,0.25,-0.094,-0.212,-0.03
-TS-ICL,Toto-1.0,0.2,0.05,0.35,-0.022,-0.057,0.02
-TS-ICL,Toto-2.0-4m,0.25,0.1,0.45,-0.022,-0.044,-0.0
-TS-ICL,TiRex-2,0.3,0.1,0.5,-0.012,-0.04,0.013
-TS-ICL,TimesFM-2.5,0.4,0.2,0.6,-0.006,-0.054,0.032
-TS-ICL,TiRex,0.45,0.25,0.65,0.025,-0.004,0.066
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,FlowState,0.6,0.4,0.8,0.028,-0.133,0.132
-TS-ICL,TabPFN-TS-3,0.75,0.55,0.95,-0.005,-0.182,0.104
-TS-ICL,Chronos-Bolt,0.9,0.75,1.0,0.1,0.058,0.146
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.459,0.355,0.568
-FlowState,Toto-2.0-2.5B,0.05,0.0,0.15,-0.201,-0.344,-0.085
-FlowState,Toto-2.0-1B,0.05,0.0,0.15,-0.186,-0.335,-0.059
-FlowState,Toto-2.0-313m,0.05,0.0,0.15,-0.175,-0.33,-0.04
-FlowState,Toto-2.0-22m,0.05,0.0,0.15,-0.116,-0.264,0.034
-FlowState,TimesFM-3,0.05,0.0,0.15,-0.186,-0.281,-0.104
-FlowState,t0-beta,0.1,0.0,0.25,-0.103,-0.224,0.012
-FlowState,Chronos-2,0.2,0.05,0.4,-0.125,-0.224,-0.051
-FlowState,Toto-1.0,0.2,0.05,0.4,-0.051,-0.208,0.107
-FlowState,Toto-2.0-4m,0.2,0.05,0.4,-0.051,-0.185,0.099
-FlowState,TiRex-2,0.25,0.05,0.45,-0.04,-0.183,0.119
-FlowState,TimesFM-2.5,0.2,0.05,0.4,-0.035,-0.141,0.083
-FlowState,TiRex,0.4,0.2,0.6,-0.002,-0.131,0.149
-FlowState,TS-ICL,0.4,0.2,0.6,-0.028,-0.152,0.117
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TabPFN-TS-3,0.5,0.3,0.7,-0.034,-0.124,0.05
-FlowState,Chronos-Bolt,0.7,0.5,0.851,0.075,-0.004,0.187
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.444,0.326,0.558
-TabPFN-TS-3,Toto-2.0-2.5B,0.05,0.0,0.15,-0.162,-0.325,-0.051
-TabPFN-TS-3,Toto-2.0-1B,0.05,0.0,0.15,-0.147,-0.313,-0.019
-TabPFN-TS-3,Toto-2.0-313m,0.05,0.0,0.15,-0.137,-0.3,0.004
-TabPFN-TS-3,Toto-2.0-22m,0.05,0.0,0.15,-0.08,-0.217,0.07
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.147,-0.241,-0.092
-TabPFN-TS-3,t0-beta,0.15,0.0,0.35,-0.067,-0.191,0.049
-TabPFN-TS-3,Chronos-2,0.15,0.0,0.35,-0.088,-0.184,-0.019
-TabPFN-TS-3,Toto-1.0,0.15,0.0,0.301,-0.017,-0.157,0.159
-TabPFN-TS-3,Toto-2.0-4m,0.25,0.05,0.45,-0.017,-0.135,0.134
-TabPFN-TS-3,TiRex-2,0.2,0.05,0.35,-0.006,-0.137,0.15
-TabPFN-TS-3,TimesFM-2.5,0.3,0.1,0.5,-0.001,-0.088,0.108
-TabPFN-TS-3,TiRex,0.25,0.099,0.45,0.03,-0.07,0.179
-TabPFN-TS-3,TS-ICL,0.25,0.05,0.45,0.005,-0.116,0.154
-TabPFN-TS-3,FlowState,0.5,0.3,0.7,0.033,-0.052,0.11
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,Chronos-Bolt,0.6,0.4,0.8,0.105,-0.001,0.226
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.462,0.342,0.578
-Chronos-Bolt,Toto-2.0-2.5B,0.0,0.0,0.0,-0.298,-0.433,-0.184
-Chronos-Bolt,Toto-2.0-1B,0.0,0.0,0.0,-0.281,-0.399,-0.179
-Chronos-Bolt,Toto-2.0-313m,0.0,0.0,0.0,-0.271,-0.38,-0.178
-Chronos-Bolt,Toto-2.0-22m,0.0,0.0,0.0,-0.207,-0.287,-0.139
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.282,-0.496,-0.143
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.192,-0.278,-0.121
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.216,-0.349,-0.115
-Chronos-Bolt,Toto-1.0,0.05,0.0,0.15,-0.136,-0.223,-0.053
-Chronos-Bolt,Toto-2.0-4m,0.0,0.0,0.0,-0.136,-0.201,-0.083
-Chronos-Bolt,TiRex-2,0.05,0.0,0.15,-0.125,-0.197,-0.071
-Chronos-Bolt,TimesFM-2.5,0.1,0.0,0.25,-0.118,-0.174,-0.069
-Chronos-Bolt,TiRex,0.15,0.0,0.35,-0.083,-0.141,-0.031
-Chronos-Bolt,TS-ICL,0.1,0.0,0.25,-0.112,-0.171,-0.062
-Chronos-Bolt,FlowState,0.3,0.149,0.5,-0.081,-0.231,0.004
-Chronos-Bolt,TabPFN-TS-3,0.4,0.2,0.6,-0.117,-0.293,0.001
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.399,0.295,0.512
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-1.16,-1.888,-0.726
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-1.132,-1.83,-0.721
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-1.114,-1.794,-0.707
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-1.008,-1.587,-0.645
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-1.133,-1.815,-0.688
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.984,-1.557,-0.635
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-1.023,-1.609,-0.634
-Seasonal Naive,Toto-1.0,0.0,0.0,0.0,-0.89,-1.38,-0.588
-Seasonal Naive,Toto-2.0-4m,0.0,0.0,0.0,-0.89,-1.375,-0.572
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.871,-1.377,-0.55
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.86,-1.313,-0.572
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.802,-1.198,-0.539
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.849,-1.313,-0.551
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.798,-1.26,-0.483
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.859,-1.369,-0.521
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.664,-1.049,-0.418
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_cloud/pairwise_WQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-1B,0.75,0.55,0.9,0.009,-0.004,0.026
-Toto-2.0-2.5B,Toto-2.0-313m,0.9,0.75,1.0,0.02,-0.002,0.053
-Toto-2.0-2.5B,TimesFM-3,0.9,0.75,1.0,0.016,-0.064,0.067
-Toto-2.0-2.5B,Toto-2.0-22m,1.0,1.0,1.0,0.068,0.033,0.117
-Toto-2.0-2.5B,Chronos-2,0.95,0.85,1.0,0.063,0.029,0.097
-Toto-2.0-2.5B,t0-beta,1.0,1.0,1.0,0.078,0.056,0.103
-Toto-2.0-2.5B,Toto-1.0,1.0,1.0,1.0,0.129,0.058,0.225
-Toto-2.0-2.5B,Toto-2.0-4m,1.0,1.0,1.0,0.13,0.069,0.205
-Toto-2.0-2.5B,TiRex-2,1.0,1.0,1.0,0.14,0.077,0.222
-Toto-2.0-2.5B,TimesFM-2.5,1.0,1.0,1.0,0.146,0.095,0.204
-Toto-2.0-2.5B,TiRex,1.0,1.0,1.0,0.169,0.091,0.263
-Toto-2.0-2.5B,TS-ICL,1.0,1.0,1.0,0.147,0.088,0.228
-Toto-2.0-2.5B,TabPFN-TS-3,0.95,0.85,1.0,0.131,0.047,0.222
-Toto-2.0-2.5B,FlowState,0.95,0.85,1.0,0.171,0.084,0.255
-Toto-2.0-2.5B,Chronos-Bolt,1.0,1.0,1.0,0.26,0.189,0.332
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.69,0.609,0.766
-Toto-2.0-1B,Toto-2.0-2.5B,0.25,0.1,0.45,-0.009,-0.027,0.004
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-313m,0.8,0.6,0.95,0.011,-0.002,0.03
-Toto-2.0-1B,TimesFM-3,0.8,0.6,0.95,0.007,-0.09,0.066
-Toto-2.0-1B,Toto-2.0-22m,1.0,1.0,1.0,0.059,0.03,0.097
-Toto-2.0-1B,Chronos-2,0.95,0.85,1.0,0.055,0.005,0.095
-Toto-2.0-1B,t0-beta,1.0,1.0,1.0,0.07,0.051,0.092
-Toto-2.0-1B,Toto-1.0,1.0,1.0,1.0,0.121,0.056,0.205
-Toto-2.0-1B,Toto-2.0-4m,1.0,1.0,1.0,0.122,0.068,0.187
-Toto-2.0-1B,TiRex-2,1.0,1.0,1.0,0.132,0.076,0.205
-Toto-2.0-1B,TimesFM-2.5,1.0,1.0,1.0,0.138,0.091,0.191
-Toto-2.0-1B,TiRex,1.0,1.0,1.0,0.161,0.088,0.248
-Toto-2.0-1B,TS-ICL,1.0,1.0,1.0,0.14,0.086,0.209
-Toto-2.0-1B,TabPFN-TS-3,0.95,0.85,1.0,0.123,0.025,0.223
-Toto-2.0-1B,FlowState,0.95,0.85,1.0,0.163,0.068,0.254
-Toto-2.0-1B,Chronos-Bolt,1.0,1.0,1.0,0.253,0.186,0.32
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.688,0.607,0.763
-Toto-2.0-313m,Toto-2.0-2.5B,0.1,0.0,0.25,-0.02,-0.056,0.002
-Toto-2.0-313m,Toto-2.0-1B,0.2,0.05,0.4,-0.011,-0.03,0.002
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TimesFM-3,0.85,0.7,1.0,-0.003,-0.118,0.065
-Toto-2.0-313m,Toto-2.0-22m,1.0,1.0,1.0,0.049,0.028,0.073
-Toto-2.0-313m,Chronos-2,0.9,0.75,1.0,0.044,-0.025,0.093
-Toto-2.0-313m,t0-beta,0.95,0.85,1.0,0.06,0.035,0.087
-Toto-2.0-313m,Toto-1.0,1.0,1.0,1.0,0.111,0.054,0.181
-Toto-2.0-313m,Toto-2.0-4m,1.0,1.0,1.0,0.112,0.065,0.165
-Toto-2.0-313m,TiRex-2,1.0,1.0,1.0,0.123,0.074,0.182
-Toto-2.0-313m,TimesFM-2.5,1.0,1.0,1.0,0.128,0.087,0.182
-Toto-2.0-313m,TiRex,1.0,1.0,1.0,0.152,0.086,0.227
-Toto-2.0-313m,TS-ICL,1.0,1.0,1.0,0.13,0.083,0.188
-Toto-2.0-313m,TabPFN-TS-3,0.95,0.85,1.0,0.114,-0.005,0.22
-Toto-2.0-313m,FlowState,0.95,0.85,1.0,0.154,0.045,0.251
-Toto-2.0-313m,Chronos-Bolt,1.0,1.0,1.0,0.245,0.185,0.304
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.684,0.602,0.763
-TimesFM-3,Toto-2.0-2.5B,0.1,0.0,0.25,-0.017,-0.072,0.06
-TimesFM-3,Toto-2.0-1B,0.2,0.05,0.4,-0.008,-0.071,0.083
-TimesFM-3,Toto-2.0-313m,0.15,0.0,0.3,0.003,-0.069,0.106
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Toto-2.0-22m,0.4,0.2,0.6,0.052,-0.016,0.163
-TimesFM-3,Chronos-2,0.75,0.55,0.95,0.048,0.016,0.095
-TimesFM-3,t0-beta,0.8,0.6,0.95,0.063,0.012,0.144
-TimesFM-3,Toto-1.0,0.75,0.55,0.9,0.114,0.013,0.265
-TimesFM-3,Toto-2.0-4m,0.9,0.75,1.0,0.115,0.03,0.246
-TimesFM-3,TiRex-2,1.0,1.0,1.0,0.126,0.04,0.26
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.131,0.061,0.229
-TimesFM-3,TiRex,0.85,0.7,1.0,0.155,0.054,0.294
-TimesFM-3,TS-ICL,0.95,0.85,1.0,0.133,0.048,0.264
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.117,0.077,0.178
-TimesFM-3,FlowState,0.95,0.85,1.0,0.157,0.098,0.221
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.248,0.157,0.358
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.685,0.595,0.761
-Toto-2.0-22m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.073,-0.133,-0.034
-Toto-2.0-22m,Toto-2.0-1B,0.0,0.0,0.0,-0.063,-0.107,-0.031
-Toto-2.0-22m,Toto-2.0-313m,0.0,0.0,0.0,-0.052,-0.079,-0.029
-Toto-2.0-22m,TimesFM-3,0.6,0.4,0.8,-0.055,-0.194,0.016
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Chronos-2,0.8,0.6,0.95,-0.005,-0.088,0.044
-Toto-2.0-22m,t0-beta,0.9,0.75,1.0,0.011,-0.026,0.038
-Toto-2.0-22m,Toto-1.0,0.9,0.75,1.0,0.065,0.023,0.123
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.066,0.036,0.1
-Toto-2.0-22m,TiRex-2,1.0,1.0,1.0,0.077,0.044,0.12
-Toto-2.0-22m,TimesFM-2.5,0.95,0.85,1.0,0.084,0.052,0.121
-Toto-2.0-22m,TiRex,0.95,0.85,1.0,0.108,0.057,0.168
-Toto-2.0-22m,TS-ICL,0.9,0.75,1.0,0.085,0.052,0.126
-Toto-2.0-22m,TabPFN-TS-3,0.9,0.75,1.0,0.068,-0.074,0.168
-Toto-2.0-22m,FlowState,0.9,0.75,1.0,0.111,-0.022,0.213
-Toto-2.0-22m,Chronos-Bolt,1.0,1.0,1.0,0.206,0.157,0.257
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.668,0.584,0.745
-Chronos-2,Toto-2.0-2.5B,0.05,0.0,0.15,-0.068,-0.107,-0.03
-Chronos-2,Toto-2.0-1B,0.05,0.0,0.15,-0.058,-0.105,-0.005
-Chronos-2,Toto-2.0-313m,0.1,0.0,0.25,-0.046,-0.103,0.024
-Chronos-2,TimesFM-3,0.25,0.05,0.45,-0.05,-0.105,-0.016
-Chronos-2,Toto-2.0-22m,0.2,0.05,0.4,0.005,-0.046,0.081
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,t0-beta,0.4,0.2,0.6,0.016,-0.018,0.062
-Chronos-2,Toto-1.0,0.35,0.15,0.55,0.07,-0.014,0.185
-Chronos-2,Toto-2.0-4m,0.6,0.35,0.8,0.071,0.004,0.171
-Chronos-2,TiRex-2,0.8,0.6,0.95,0.082,0.016,0.185
-Chronos-2,TimesFM-2.5,0.75,0.55,0.9,0.088,0.033,0.155
-Chronos-2,TiRex,0.85,0.7,1.0,0.113,0.032,0.222
-Chronos-2,TS-ICL,0.95,0.85,1.0,0.09,0.026,0.189
-Chronos-2,TabPFN-TS-3,0.9,0.75,1.0,0.072,0.011,0.147
-Chronos-2,FlowState,0.85,0.65,1.0,0.115,0.05,0.188
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.21,0.134,0.3
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.669,0.582,0.746
-t0-beta,Toto-2.0-2.5B,0.0,0.0,0.0,-0.085,-0.115,-0.059
-t0-beta,Toto-2.0-1B,0.0,0.0,0.0,-0.075,-0.102,-0.054
-t0-beta,Toto-2.0-313m,0.05,0.0,0.15,-0.063,-0.096,-0.036
-t0-beta,TimesFM-3,0.2,0.05,0.4,-0.067,-0.169,-0.013
-t0-beta,Toto-2.0-22m,0.1,0.0,0.25,-0.011,-0.039,0.025
-t0-beta,Chronos-2,0.6,0.4,0.8,-0.016,-0.067,0.018
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-1.0,0.5,0.3,0.7,0.055,-0.008,0.138
-t0-beta,Toto-2.0-4m,0.6,0.4,0.8,0.056,0.007,0.121
-t0-beta,TiRex-2,0.75,0.55,0.95,0.067,0.018,0.139
-t0-beta,TimesFM-2.5,0.85,0.7,1.0,0.073,0.038,0.113
-t0-beta,TiRex,0.7,0.5,0.9,0.098,0.032,0.181
-t0-beta,TS-ICL,0.9,0.75,1.0,0.075,0.029,0.145
-t0-beta,TabPFN-TS-3,0.9,0.75,1.0,0.057,-0.051,0.151
-t0-beta,FlowState,0.9,0.75,1.0,0.101,0.001,0.187
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.197,0.139,0.259
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.664,0.584,0.741
-Toto-1.0,Toto-2.0-2.5B,0.0,0.0,0.0,-0.148,-0.291,-0.061
-Toto-1.0,Toto-2.0-1B,0.0,0.0,0.0,-0.137,-0.257,-0.06
-Toto-1.0,Toto-2.0-313m,0.0,0.0,0.0,-0.125,-0.222,-0.057
-Toto-1.0,TimesFM-3,0.25,0.1,0.45,-0.129,-0.361,-0.013
-Toto-1.0,Toto-2.0-22m,0.1,0.0,0.25,-0.07,-0.141,-0.024
-Toto-1.0,Chronos-2,0.65,0.45,0.85,-0.075,-0.227,0.014
-Toto-1.0,t0-beta,0.5,0.3,0.7,-0.058,-0.161,0.008
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,Toto-2.0-4m,0.6,0.4,0.8,0.001,-0.04,0.028
-Toto-1.0,TiRex-2,0.8,0.65,0.95,0.013,-0.041,0.047
-Toto-1.0,TimesFM-2.5,0.75,0.55,0.95,0.02,-0.047,0.073
-Toto-1.0,TiRex,0.75,0.55,0.9,0.046,0.0,0.095
-Toto-1.0,TS-ICL,0.8,0.65,0.95,0.022,-0.018,0.052
-Toto-1.0,TabPFN-TS-3,0.8,0.6,0.95,0.003,-0.211,0.127
-Toto-1.0,FlowState,0.75,0.55,0.9,0.049,-0.131,0.178
-Toto-1.0,Chronos-Bolt,0.95,0.85,1.0,0.151,0.089,0.21
-Toto-1.0,Seasonal Naive,1.0,1.0,1.0,0.645,0.563,0.725
-Toto-2.0-4m,Toto-2.0-2.5B,0.0,0.0,0.0,-0.149,-0.258,-0.075
-Toto-2.0-4m,Toto-2.0-1B,0.0,0.0,0.0,-0.139,-0.23,-0.073
-Toto-2.0-4m,Toto-2.0-313m,0.0,0.0,0.0,-0.126,-0.198,-0.069
-Toto-2.0-4m,TimesFM-3,0.1,0.0,0.25,-0.13,-0.326,-0.031
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.071,-0.112,-0.038
-Toto-2.0-4m,Chronos-2,0.4,0.2,0.65,-0.076,-0.207,-0.004
-Toto-2.0-4m,t0-beta,0.4,0.2,0.6,-0.059,-0.138,-0.007
-Toto-2.0-4m,Toto-1.0,0.4,0.2,0.6,-0.001,-0.029,0.038
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,TiRex-2,0.65,0.45,0.85,0.012,-0.009,0.034
-Toto-2.0-4m,TimesFM-2.5,0.6,0.4,0.8,0.019,-0.028,0.056
-Toto-2.0-4m,TiRex,0.8,0.649,0.95,0.045,0.016,0.082
-Toto-2.0-4m,TS-ICL,0.8,0.65,0.95,0.021,0.0,0.04
-Toto-2.0-4m,TabPFN-TS-3,0.75,0.55,0.95,0.002,-0.182,0.109
-Toto-2.0-4m,FlowState,0.85,0.7,1.0,0.048,-0.128,0.162
-Toto-2.0-4m,Chronos-Bolt,1.0,1.0,1.0,0.15,0.107,0.197
-Toto-2.0-4m,Seasonal Naive,1.0,1.0,1.0,0.644,0.559,0.727
-TiRex-2,Toto-2.0-2.5B,0.0,0.0,0.0,-0.163,-0.286,-0.084
-TiRex-2,Toto-2.0-1B,0.0,0.0,0.0,-0.152,-0.258,-0.082
-TiRex-2,Toto-2.0-313m,0.0,0.0,0.0,-0.14,-0.222,-0.08
-TiRex-2,TimesFM-3,0.0,0.0,0.0,-0.144,-0.352,-0.041
-TiRex-2,Toto-2.0-22m,0.0,0.0,0.0,-0.084,-0.136,-0.046
-TiRex-2,Chronos-2,0.2,0.05,0.4,-0.089,-0.227,-0.017
-TiRex-2,t0-beta,0.25,0.05,0.45,-0.072,-0.162,-0.019
-TiRex-2,Toto-1.0,0.2,0.05,0.35,-0.013,-0.049,0.039
-TiRex-2,Toto-2.0-4m,0.35,0.15,0.55,-0.012,-0.035,0.009
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-2.5,0.65,0.45,0.85,0.007,-0.056,0.053
-TiRex-2,TiRex,0.65,0.45,0.85,0.034,0.004,0.075
-TiRex-2,TS-ICL,0.6,0.4,0.8,0.009,-0.011,0.03
-TiRex-2,TabPFN-TS-3,0.75,0.6,0.9,-0.01,-0.207,0.11
-TiRex-2,FlowState,0.75,0.55,0.95,0.036,-0.151,0.155
-TiRex-2,Chronos-Bolt,1.0,1.0,1.0,0.14,0.099,0.185
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.64,0.55,0.728
-TimesFM-2.5,Toto-2.0-2.5B,0.0,0.0,0.0,-0.171,-0.256,-0.105
-TimesFM-2.5,Toto-2.0-1B,0.0,0.0,0.0,-0.16,-0.236,-0.1
-TimesFM-2.5,Toto-2.0-313m,0.0,0.0,0.0,-0.147,-0.223,-0.095
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.151,-0.297,-0.065
-TimesFM-2.5,Toto-2.0-22m,0.05,0.0,0.15,-0.091,-0.138,-0.055
-TimesFM-2.5,Chronos-2,0.25,0.1,0.45,-0.097,-0.183,-0.034
-TimesFM-2.5,t0-beta,0.15,0.0,0.3,-0.079,-0.127,-0.039
-TimesFM-2.5,Toto-1.0,0.25,0.05,0.45,-0.02,-0.079,0.045
-TimesFM-2.5,Toto-2.0-4m,0.4,0.2,0.6,-0.019,-0.059,0.027
-TimesFM-2.5,TiRex-2,0.35,0.15,0.55,-0.007,-0.056,0.053
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,TiRex,0.6,0.4,0.8,0.027,-0.018,0.086
-TimesFM-2.5,TS-ICL,0.55,0.3,0.75,0.002,-0.039,0.052
-TimesFM-2.5,TabPFN-TS-3,0.6,0.4,0.8,-0.017,-0.149,0.071
-TimesFM-2.5,FlowState,0.7,0.5,0.9,0.03,-0.104,0.121
-TimesFM-2.5,Chronos-Bolt,0.9,0.75,1.0,0.134,0.092,0.179
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.638,0.557,0.714
-TiRex,Toto-2.0-2.5B,0.0,0.0,0.0,-0.203,-0.356,-0.1
-TiRex,Toto-2.0-1B,0.0,0.0,0.0,-0.192,-0.33,-0.096
-TiRex,Toto-2.0-313m,0.0,0.0,0.0,-0.179,-0.294,-0.094
-TiRex,TimesFM-3,0.15,0.0,0.3,-0.183,-0.416,-0.057
-TiRex,Toto-2.0-22m,0.05,0.0,0.15,-0.122,-0.202,-0.061
-TiRex,Chronos-2,0.15,0.0,0.3,-0.127,-0.285,-0.033
-TiRex,t0-beta,0.3,0.1,0.5,-0.109,-0.221,-0.033
-TiRex,Toto-1.0,0.25,0.1,0.45,-0.048,-0.105,-0.0
-TiRex,Toto-2.0-4m,0.2,0.05,0.351,-0.047,-0.089,-0.016
-TiRex,TiRex-2,0.35,0.15,0.55,-0.035,-0.081,-0.004
-TiRex,TimesFM-2.5,0.4,0.2,0.6,-0.028,-0.095,0.018
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TS-ICL,0.45,0.25,0.65,-0.026,-0.065,0.001
-TiRex,TabPFN-TS-3,0.7,0.5,0.9,-0.045,-0.247,0.06
-TiRex,FlowState,0.7,0.5,0.9,0.003,-0.19,0.122
-TiRex,Chronos-Bolt,0.9,0.75,1.0,0.11,0.064,0.155
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.627,0.54,0.71
-TS-ICL,Toto-2.0-2.5B,0.0,0.0,0.0,-0.173,-0.296,-0.096
-TS-ICL,Toto-2.0-1B,0.0,0.0,0.0,-0.162,-0.264,-0.095
-TS-ICL,Toto-2.0-313m,0.0,0.0,0.0,-0.15,-0.232,-0.091
-TS-ICL,TimesFM-3,0.05,0.0,0.15,-0.154,-0.359,-0.051
-TS-ICL,Toto-2.0-22m,0.1,0.0,0.25,-0.093,-0.144,-0.055
-TS-ICL,Chronos-2,0.05,0.0,0.15,-0.099,-0.234,-0.027
-TS-ICL,t0-beta,0.1,0.0,0.25,-0.081,-0.169,-0.03
-TS-ICL,Toto-1.0,0.2,0.05,0.35,-0.022,-0.055,0.018
-TS-ICL,Toto-2.0-4m,0.2,0.05,0.35,-0.021,-0.041,-0.0
-TS-ICL,TiRex-2,0.4,0.2,0.6,-0.009,-0.031,0.011
-TS-ICL,TimesFM-2.5,0.45,0.25,0.7,-0.002,-0.055,0.037
-TS-ICL,TiRex,0.55,0.35,0.75,0.025,-0.001,0.061
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TabPFN-TS-3,0.75,0.55,0.95,-0.019,-0.211,0.095
-TS-ICL,FlowState,0.65,0.45,0.85,0.028,-0.153,0.141
-TS-ICL,Chronos-Bolt,1.0,1.0,1.0,0.132,0.093,0.176
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.637,0.552,0.72
-TabPFN-TS-3,Toto-2.0-2.5B,0.05,0.0,0.15,-0.151,-0.285,-0.049
-TabPFN-TS-3,Toto-2.0-1B,0.05,0.0,0.15,-0.141,-0.286,-0.025
-TabPFN-TS-3,Toto-2.0-313m,0.05,0.0,0.15,-0.128,-0.282,0.005
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.132,-0.216,-0.084
-TabPFN-TS-3,Toto-2.0-22m,0.1,0.0,0.25,-0.073,-0.202,0.069
-TabPFN-TS-3,Chronos-2,0.1,0.0,0.25,-0.078,-0.172,-0.012
-TabPFN-TS-3,t0-beta,0.1,0.0,0.25,-0.061,-0.178,0.048
-TabPFN-TS-3,Toto-1.0,0.2,0.05,0.4,-0.003,-0.146,0.175
-TabPFN-TS-3,Toto-2.0-4m,0.25,0.05,0.45,-0.002,-0.123,0.154
-TabPFN-TS-3,TiRex-2,0.25,0.1,0.4,0.01,-0.124,0.172
-TabPFN-TS-3,TimesFM-2.5,0.4,0.2,0.6,0.017,-0.077,0.13
-TabPFN-TS-3,TiRex,0.3,0.1,0.5,0.043,-0.064,0.198
-TabPFN-TS-3,TS-ICL,0.25,0.05,0.45,0.019,-0.105,0.174
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,FlowState,0.5,0.3,0.7,0.046,-0.042,0.123
-TabPFN-TS-3,Chronos-Bolt,0.85,0.65,1.0,0.148,0.036,0.276
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.644,0.549,0.724
-FlowState,Toto-2.0-2.5B,0.05,0.0,0.15,-0.206,-0.343,-0.092
-FlowState,Toto-2.0-1B,0.05,0.0,0.15,-0.195,-0.34,-0.073
-FlowState,Toto-2.0-313m,0.05,0.0,0.15,-0.182,-0.334,-0.047
-FlowState,TimesFM-3,0.05,0.0,0.15,-0.186,-0.284,-0.109
-FlowState,Toto-2.0-22m,0.1,0.0,0.25,-0.124,-0.271,0.021
-FlowState,Chronos-2,0.15,0.0,0.35,-0.13,-0.232,-0.053
-FlowState,t0-beta,0.1,0.0,0.25,-0.112,-0.23,-0.001
-FlowState,Toto-1.0,0.25,0.1,0.45,-0.051,-0.217,0.116
-FlowState,Toto-2.0-4m,0.15,0.0,0.3,-0.05,-0.194,0.113
-FlowState,TiRex-2,0.25,0.05,0.45,-0.037,-0.184,0.131
-FlowState,TimesFM-2.5,0.3,0.1,0.5,-0.03,-0.137,0.094
-FlowState,TiRex,0.3,0.1,0.5,-0.003,-0.139,0.159
-FlowState,TS-ICL,0.35,0.15,0.55,-0.028,-0.164,0.132
-FlowState,TabPFN-TS-3,0.5,0.3,0.7,-0.048,-0.141,0.04
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Chronos-Bolt,0.8,0.649,0.95,0.107,0.023,0.228
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.626,0.538,0.704
-Chronos-Bolt,Toto-2.0-2.5B,0.0,0.0,0.0,-0.351,-0.498,-0.233
-Chronos-Bolt,Toto-2.0-1B,0.0,0.0,0.0,-0.339,-0.471,-0.228
-Chronos-Bolt,Toto-2.0-313m,0.0,0.0,0.0,-0.325,-0.437,-0.227
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.329,-0.558,-0.186
-Chronos-Bolt,Toto-2.0-22m,0.0,0.0,0.0,-0.26,-0.345,-0.186
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.266,-0.429,-0.154
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.246,-0.35,-0.161
-Chronos-Bolt,Toto-1.0,0.05,0.0,0.15,-0.177,-0.267,-0.098
-Chronos-Bolt,Toto-2.0-4m,0.0,0.0,0.0,-0.176,-0.246,-0.12
-Chronos-Bolt,TiRex-2,0.0,0.0,0.0,-0.162,-0.227,-0.11
-Chronos-Bolt,TimesFM-2.5,0.1,0.0,0.25,-0.154,-0.218,-0.101
-Chronos-Bolt,TiRex,0.1,0.0,0.25,-0.123,-0.183,-0.069
-Chronos-Bolt,TS-ICL,0.0,0.0,0.0,-0.152,-0.214,-0.102
-Chronos-Bolt,TabPFN-TS-3,0.15,0.0,0.35,-0.174,-0.382,-0.037
-Chronos-Bolt,FlowState,0.2,0.05,0.351,-0.12,-0.295,-0.023
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.582,0.486,0.675
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-2.229,-3.277,-1.556
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-2.201,-3.228,-1.546
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-2.166,-3.211,-1.516
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-2.177,-3.181,-1.472
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-2.011,-2.926,-1.406
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-2.025,-2.936,-1.394
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-1.977,-2.865,-1.402
-Seasonal Naive,Toto-1.0,0.0,0.0,0.0,-1.814,-2.639,-1.287
-Seasonal Naive,Toto-2.0-4m,0.0,0.0,0.0,-1.811,-2.664,-1.269
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-1.778,-2.67,-1.221
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-1.759,-2.495,-1.259
-Seasonal Naive,TiRex,0.0,0.0,0.0,-1.684,-2.448,-1.175
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-1.753,-2.574,-1.232
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-1.806,-2.622,-1.215
-Seasonal Naive,FlowState,0.0,0.0,0.0,-1.677,-2.381,-1.163
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-1.39,-2.073,-0.945
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_econ/leaderboard_MASE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TiRex-2,88.70967741935483,40.553930524399625,0.0,0.11294837920086495,0.0,0.0
-TimesFM-3,83.60215053763442,39.84025129195216,0.0,0.8189295783813578,0.0,0.0
-Stat. Ensemble,77.41935483870968,38.47702197421158,0.0,73.43481351955408,0.0,0.0
-Toto-2.0-22m,74.46236559139786,37.883510512986405,0.0,0.2300832338301921,0.0,0.0
-Toto-2.0-1B,72.8494623655914,37.647796213911036,0.0,2.4167769806179775,0.0,0.0
-Toto-2.0-313m,70.43010752688173,37.637104246897856,0.0,0.9865880503225806,0.0,0.0
-Toto-2.0-2.5B,70.43010752688171,37.649421436010044,0.0,5.236902611304615,0.0,0.0
-TiRex,66.93548387096774,36.87592044073875,0.0,0.16472977363175062,0.0,0.0
-Chronos-2,65.86021505376344,36.307128273958256,0.0,0.14791438772454144,0.0,0.0
-LightGBM,63.97849462365591,36.739370201928836,0.20454036927361854,0.03409663050126502,0.0,0.0
-AutoETS,61.82795698924731,35.908870624227376,0.0,1.5253584038361796,0.0,0.0
-FlowState,60.483870967741936,35.21482359572895,0.0,0.8205954025996205,0.16666666666666666,0.0
-CatBoost,59.13978494623655,35.982559330359685,3.42108969184492,0.03905346701454776,0.0,0.0
-Toto-1.0,54.83870967741935,32.41516602344565,0.0,5.0937543479594325,0.16666666666666666,0.0
-Toto-2.0-4m,54.56989247311829,35.180832137280916,0.0,0.1810118077664009,0.0,0.0
-t0-beta,52.41935483870967,34.556069294115424,0.0,0.19918463912297943,0.0,0.0
-citras-fm,51.344086021505376,34.02322385198361,0.0,0.12518068105908503,0.0,0.0
-AutoARIMA,50.806451612903224,33.893658085803416,0.0,6.5345976113161015,0.0,0.0
-TabPFN-TS,47.8494623655914,34.19057001716027,0.0,52.326198869129215,0.0,0.0
-AutoTheta,46.774193548387096,32.52926186802178,0.0,0.9578271612919038,0.0,0.0
-TimesFM-2.5,44.354838709677416,32.83344751489832,0.0,0.3095206282094962,0.16666666666666666,0.0
-Drift,44.354838709677416,29.639454067966152,0.0,0.4198026182352941,0.0,0.0
-TS-ICL,43.27956989247313,29.501972032987776,0.0,0.8407145490361518,0.0,0.0
-TabPFN-TS-3,35.21505376344086,28.575629786307356,0.0,190.9822121554963,0.0,0.0
-Chronos-Bolt,34.67741935483871,30.133730029400986,0.0,0.1587546411616528,0.0,0.0
-Moirai-2.0,34.40860215053764,28.236498726126015,0.0,0.21986280235955058,0.16666666666666666,0.0
-DeepAR,26.075268817204307,24.302560020818376,546.7685936688092,0.18274403532732447,0.0,0.0
-Sundial-Base,18.548387096774192,19.70951503418047,0.0,8.00438149490214,0.0,0.0
-PatchTST,13.709677419354838,15.279108700450617,310.3190003231231,0.1605401314516129,0.0,0.0
-Naive,12.903225806451612,15.593612422240255,0.0,0.46331807906862743,0.0,0.0
-TFT,10.483870967741936,9.838087249658834,445.02348117965687,0.18857640938013914,0.0,0.0
-Seasonal Naive,7.258064516129033,0.0,0.0,0.41450250024509805,0.0,0.0

tables/domain_econ/leaderboard_SQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TiRex-2,92.20430107526882,41.37587435805797,0.0,0.11294837920086495,0.0,0.0
-TimesFM-3,84.67741935483872,40.174803180792665,0.0,0.8189295783813578,0.0,0.0
-Toto-2.0-2.5B,77.68817204301077,38.54527045088485,0.0,5.236902611304615,0.0,0.0
-Toto-2.0-1B,77.15053763440861,38.30540837943911,0.0,2.4167769806179775,0.0,0.0
-Toto-2.0-313m,76.88172043010752,38.27714813601945,0.0,0.9865880503225806,0.0,0.0
-TiRex,76.34408602150536,38.16787226217255,0.0,0.16472977363175062,0.0,0.0
-Toto-2.0-22m,76.07526881720432,38.28322277552283,0.0,0.2300832338301921,0.0,0.0
-Chronos-2,75.0,37.73601252203713,0.0,0.14791438772454144,0.0,0.0
-Stat. Ensemble,67.74193548387096,37.119576639717835,0.0,73.43481351955408,0.0,0.0
-FlowState,63.44086021505375,35.273957411546085,0.0,0.8205954025996205,0.16666666666666666,0.0
-Toto-2.0-4m,60.75268817204302,35.90432755342822,0.0,0.1810118077664009,0.0,0.0
-t0-beta,59.67741935483871,35.916024615133665,0.0,0.19918463912297943,0.0,0.0
-citras-fm,59.67741935483871,35.245938628620046,0.0,0.12518068105908503,0.0,0.0
-Toto-1.0,57.52688172043011,33.496371356107844,0.0,5.0937543479594325,0.16666666666666666,0.0
-TabPFN-TS,57.25806451612904,35.173459448094114,0.0,52.326198869129215,0.0,0.0
-AutoETS,53.76344086021505,29.18586393990128,0.0,1.5253584038361796,0.0,0.0
-TimesFM-2.5,48.11827956989247,32.772070331944484,0.0,0.3095206282094962,0.16666666666666666,0.0
-AutoARIMA,46.774193548387096,31.72145242450589,0.0,6.5345976113161015,0.0,0.0
-Chronos-Bolt,44.892473118279575,31.81815534740079,0.0,0.1587546411616528,0.0,0.0
-TS-ICL,43.81720430107527,29.358753198562194,0.0,0.8407145490361518,0.0,0.0
-Moirai-2.0,38.44086021505376,29.079628766325204,0.0,0.21986280235955058,0.16666666666666666,0.0
-TabPFN-TS-3,38.17204301075268,29.19971717461506,0.0,190.9822121554963,0.0,0.0
-AutoTheta,37.903225806451616,29.61896808086114,0.0,0.9578271612919038,0.0,0.0
-Drift,37.36559139784946,25.58270375016218,0.0,0.4198026182352941,0.0,0.0
-DeepAR,35.75268817204301,25.12762288287479,546.7685936688092,0.18274403532732447,0.0,0.0
-LightGBM,25.806451612903224,24.325044506495818,0.20454036927361854,0.03409663050126502,0.0,0.0
-CatBoost,21.236559139784944,23.419716355230047,3.42108969184492,0.03905346701454776,0.0,0.0
-PatchTST,18.27956989247312,16.930294384775955,310.3190003231231,0.1605401314516129,0.0,0.0
-Sundial-Base,14.24731182795699,14.510260955147846,0.0,8.00438149490214,0.0,0.0
-Naive,12.903225806451612,11.510640002523509,0.0,0.46331807906862743,0.0,0.0
-TFT,12.903225806451612,9.329379481293765,445.02348117965687,0.18857640938013914,0.0,0.0
-Seasonal Naive,7.526881720430106,0.0,0.0,0.41450250024509805,0.0,0.0

tables/domain_econ/leaderboard_WAPE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TiRex-2,87.09677419354838,42.13247790984753,0.0,0.11294837920086495,0.0,0.0
-TimesFM-3,84.13978494623656,42.69479221914494,0.0,0.8189295783813578,0.0,0.0
-Toto-2.0-1B,79.56989247311827,38.80502192761649,0.0,2.4167769806179775,0.0,0.0
-Toto-2.0-2.5B,78.49462365591397,39.10703314170318,0.0,5.236902611304615,0.0,0.0
-Toto-2.0-313m,74.19354838709677,38.257695402459,0.0,0.9865880503225806,0.0,0.0
-Toto-2.0-22m,70.43010752688171,37.906655236674865,0.0,0.2300832338301921,0.0,0.0
-TiRex,68.27956989247312,37.758720587285445,0.0,0.16472977363175062,0.0,0.0
-Chronos-2,62.096774193548384,36.558735189016225,0.0,0.14791438772454144,0.0,0.0
-Stat. Ensemble,61.82795698924731,38.177219528557146,0.0,73.43481351955408,0.0,0.0
-Toto-1.0,57.52688172043011,33.97875884401389,0.0,5.0937543479594325,0.16666666666666666,0.0
-TimesFM-2.5,57.5268817204301,35.89256072267927,0.0,0.3095206282094962,0.16666666666666666,0.0
-TabPFN-TS,56.451612903225815,36.531743334435674,0.0,52.326198869129215,0.0,0.0
-FlowState,55.64516129032258,37.645403955852096,0.0,0.8205954025996205,0.16666666666666666,0.0
-citras-fm,54.301075268817215,34.4896707490341,0.0,0.12518068105908503,0.0,0.0
-t0-beta,54.3010752688172,34.65499019284073,0.0,0.19918463912297943,0.0,0.0
-CatBoost,53.49462365591398,35.20082715344605,3.42108969184492,0.03905346701454776,0.0,0.0
-Toto-2.0-4m,51.61290322580645,33.31225235226658,0.0,0.1810118077664009,0.0,0.0
-AutoETS,51.61290322580645,34.84116662551825,0.0,1.5253584038361796,0.0,0.0
-LightGBM,50.26881720430107,35.02206834104291,0.20454036927361854,0.03409663050126502,0.0,0.0
-AutoARIMA,47.31182795698925,35.732170334358024,0.0,6.5345976113161015,0.0,0.0
-Chronos-Bolt,43.54838709677419,30.478143266802604,0.0,0.1587546411616528,0.0,0.0
-TabPFN-TS-3,43.01075268817204,29.457560079978773,0.0,190.9822121554963,0.0,0.0
-Moirai-2.0,41.66666666666667,28.277512977220987,0.0,0.21986280235955058,0.16666666666666666,0.0
-AutoTheta,41.12903225806452,31.812923074763923,0.0,0.9578271612919038,0.0,0.0
-Drift,40.32258064516129,28.435824921980835,0.0,0.4198026182352941,0.0,0.0
-TS-ICL,37.903225806451616,25.73612363732908,0.0,0.8407145490361518,0.0,0.0
-Naive,19.086021505376344,15.872310498117715,0.0,0.46331807906862743,0.0,0.0
-Sundial-Base,18.010752688172044,17.737235971841127,0.0,8.00438149490214,0.0,0.0
-PatchTST,17.204301075268816,15.619782622761335,310.3190003231231,0.1605401314516129,0.0,0.0
-DeepAR,16.666666666666664,19.60425306556468,546.7685936688092,0.18274403532732447,0.0,0.0
-TFT,14.247311827956988,6.946074243338563,445.02348117965687,0.18857640938013914,0.0,0.0
-Seasonal Naive,11.021505376344084,0.0,0.0,0.41450250024509805,0.0,0.0

tables/domain_econ/leaderboard_WQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TiRex-2,88.17204301075269,45.53906787899109,0.0,0.11294837920086495,0.0,0.0
-TimesFM-3,84.67741935483872,45.84953802579841,0.0,0.8189295783813578,0.0,0.0
-Toto-2.0-1B,81.18279569892474,42.35200647023204,0.0,2.4167769806179775,0.0,0.0
-Toto-2.0-2.5B,79.03225806451613,42.8032329067254,0.0,5.236902611304615,0.0,0.0
-Toto-2.0-22m,74.46236559139786,42.320942130283335,0.0,0.2300832338301921,0.0,0.0
-Toto-2.0-313m,74.46236559139786,42.088190864136244,0.0,0.9865880503225806,0.0,0.0
-TiRex,74.19354838709677,42.09146596586096,0.0,0.16472977363175062,0.0,0.0
-Chronos-2,67.74193548387096,40.960757337476025,0.0,0.14791438772454144,0.0,0.0
-citras-fm,63.70967741935484,39.04918118052987,0.0,0.12518068105908503,0.0,0.0
-FlowState,62.096774193548384,40.9054936267241,0.0,0.8205954025996205,0.16666666666666666,0.0
-t0-beta,61.29032258064516,39.52414153578086,0.0,0.19918463912297943,0.0,0.0
-Toto-1.0,61.021505376344074,38.100769058535434,0.0,5.0937543479594325,0.16666666666666666,0.0
-TabPFN-TS,60.21505376344085,40.20371520247606,0.0,52.326198869129215,0.0,0.0
-TimesFM-2.5,59.13978494623656,39.266493040907115,0.0,0.3095206282094962,0.16666666666666666,0.0
-Toto-2.0-4m,57.5268817204301,38.36462827294697,0.0,0.1810118077664009,0.0,0.0
-Stat. Ensemble,54.83870967741935,37.992090519620156,0.0,73.43481351955408,0.0,0.0
-Chronos-Bolt,49.73118279569893,35.534952430792764,0.0,0.1587546411616528,0.0,0.0
-AutoETS,49.46236559139784,36.76571988294681,0.0,1.5253584038361796,0.0,0.0
-TabPFN-TS-3,46.774193548387096,34.00880337940215,0.0,190.9822121554963,0.0,0.0
-Moirai-2.0,45.43010752688172,32.793225265991246,0.0,0.21986280235955058,0.16666666666666666,0.0
-AutoARIMA,44.354838709677416,34.44615311952015,0.0,6.5345976113161015,0.0,0.0
-TS-ICL,40.86021505376344,29.757321220508814,0.0,0.8407145490361518,0.0,0.0
-AutoTheta,35.215053763440864,29.146207850323268,0.0,0.9578271612919038,0.0,0.0
-Drift,29.838709677419356,23.828649343246187,0.0,0.4198026182352941,0.0,0.0
-CatBoost,24.73118279569892,26.0945614678313,3.42108969184492,0.03905346701454776,0.0,0.0
-LightGBM,24.73118279569892,25.89068156049532,0.20454036927361854,0.03409663050126502,0.0,0.0
-DeepAR,23.65591397849462,21.869167576579297,546.7685936688092,0.18274403532732447,0.0,0.0
-PatchTST,21.774193548387096,19.911167839333967,310.3190003231231,0.1605401314516129,0.0,0.0
-Sundial-Base,17.20430107526882,17.532849869365606,0.0,8.00438149490214,0.0,0.0
-TFT,15.591397849462366,9.939963215759995,445.02348117965687,0.18857640938013914,0.0,0.0
-Naive,15.32258064516129,11.371958531244664,0.0,0.46331807906862743,0.0,0.0
-Seasonal Naive,11.559139784946236,0.0,0.0,0.41450250024509805,0.0,0.0

tables/domain_econ/pairwise_MASE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-3,0.667,0.417,0.917,0.012,-0.014,0.036
-TiRex-2,Stat. Ensemble,0.583,0.25,0.833,0.034,-0.011,0.076
-TiRex-2,Toto-2.0-22m,0.75,0.5,0.917,0.043,0.018,0.069
-TiRex-2,Toto-2.0-1B,0.833,0.583,1.0,0.047,0.018,0.074
-TiRex-2,Toto-2.0-2.5B,0.833,0.583,1.0,0.047,0.015,0.075
-TiRex-2,Toto-2.0-313m,0.833,0.583,1.0,0.047,0.02,0.07
-TiRex-2,Chronos-2,0.833,0.583,1.0,0.067,0.014,0.124
-TiRex-2,TiRex,1.0,1.0,1.0,0.058,0.032,0.092
-TiRex-2,LightGBM,0.917,0.75,1.0,0.06,0.015,0.103
-TiRex-2,FlowState,0.833,0.583,1.0,0.082,0.013,0.144
-TiRex-2,AutoETS,0.917,0.75,1.0,0.072,0.036,0.112
-TiRex-2,CatBoost,0.833,0.583,1.0,0.071,0.024,0.117
-TiRex-2,Toto-1.0,0.833,0.583,1.0,0.12,0.051,0.194
-TiRex-2,Toto-2.0-4m,0.917,0.75,1.0,0.083,0.049,0.122
-TiRex-2,Chronos-Bolt,1.0,1.0,1.0,0.149,0.095,0.205
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.406,0.298,0.505
-TimesFM-3,TiRex-2,0.333,0.083,0.583,-0.012,-0.037,0.014
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Stat. Ensemble,0.5,0.25,0.752,0.022,-0.007,0.053
-TimesFM-3,Toto-2.0-22m,0.75,0.5,1.0,0.032,0.008,0.054
-TimesFM-3,Toto-2.0-1B,0.667,0.417,0.917,0.035,0.003,0.076
-TimesFM-3,Toto-2.0-2.5B,0.667,0.417,0.917,0.035,-0.001,0.075
-TimesFM-3,Toto-2.0-313m,0.75,0.5,0.917,0.035,0.005,0.07
-TimesFM-3,Chronos-2,0.833,0.583,1.0,0.055,-0.002,0.118
-TimesFM-3,TiRex,0.667,0.333,0.917,0.047,0.009,0.089
-TimesFM-3,LightGBM,0.833,0.583,1.0,0.049,0.019,0.083
-TimesFM-3,FlowState,0.75,0.5,1.0,0.071,0.017,0.126
-TimesFM-3,AutoETS,0.833,0.583,1.0,0.061,0.027,0.1
-TimesFM-3,CatBoost,0.75,0.5,1.0,0.06,0.028,0.096
-TimesFM-3,Toto-1.0,0.833,0.583,1.0,0.11,0.048,0.172
-TimesFM-3,Toto-2.0-4m,1.0,1.0,1.0,0.072,0.046,0.098
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.139,0.09,0.19
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.398,0.292,0.497
-Stat. Ensemble,TiRex-2,0.417,0.167,0.75,-0.035,-0.083,0.011
-Stat. Ensemble,TimesFM-3,0.5,0.248,0.75,-0.023,-0.056,0.007
-Stat. Ensemble,Stat. Ensemble,0.5,0.5,0.5,0.0,0.0,0.0
-Stat. Ensemble,Toto-2.0-22m,0.5,0.248,0.75,0.01,-0.034,0.052
-Stat. Ensemble,Toto-2.0-1B,0.5,0.25,0.75,0.013,-0.041,0.068
-Stat. Ensemble,Toto-2.0-2.5B,0.667,0.417,0.917,0.013,-0.041,0.064
-Stat. Ensemble,Toto-2.0-313m,0.583,0.25,0.833,0.013,-0.039,0.064
-Stat. Ensemble,Chronos-2,0.75,0.5,1.0,0.034,-0.014,0.087
-Stat. Ensemble,TiRex,0.75,0.5,1.0,0.025,-0.023,0.072
-Stat. Ensemble,LightGBM,0.75,0.5,1.0,0.027,-0.0,0.06
-Stat. Ensemble,FlowState,0.667,0.417,0.917,0.05,-0.001,0.104
-Stat. Ensemble,AutoETS,0.75,0.5,1.0,0.04,0.016,0.067
-Stat. Ensemble,CatBoost,0.75,0.5,1.0,0.039,0.005,0.073
-Stat. Ensemble,Toto-1.0,0.75,0.417,1.0,0.09,0.024,0.151
-Stat. Ensemble,Toto-2.0-4m,0.667,0.333,0.917,0.051,0.007,0.097
-Stat. Ensemble,Chronos-Bolt,0.917,0.75,1.0,0.119,0.068,0.168
-Stat. Ensemble,Seasonal Naive,1.0,1.0,1.0,0.385,0.289,0.476
-Toto-2.0-22m,TiRex-2,0.25,0.083,0.5,-0.045,-0.074,-0.018
-Toto-2.0-22m,TimesFM-3,0.25,0.0,0.5,-0.033,-0.057,-0.008
-Toto-2.0-22m,Stat. Ensemble,0.5,0.25,0.752,-0.01,-0.055,0.033
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Toto-2.0-1B,0.417,0.167,0.667,0.004,-0.028,0.04
-Toto-2.0-22m,Toto-2.0-2.5B,0.583,0.333,0.833,0.004,-0.029,0.034
-Toto-2.0-22m,Toto-2.0-313m,0.583,0.333,0.833,0.004,-0.023,0.031
-Toto-2.0-22m,Chronos-2,0.583,0.25,0.833,0.025,-0.041,0.081
-Toto-2.0-22m,TiRex,0.583,0.25,0.833,0.016,-0.02,0.048
-Toto-2.0-22m,LightGBM,0.667,0.417,0.917,0.018,-0.021,0.053
-Toto-2.0-22m,FlowState,0.667,0.417,0.917,0.041,-0.025,0.105
-Toto-2.0-22m,AutoETS,0.667,0.333,0.917,0.031,-0.008,0.068
-Toto-2.0-22m,CatBoost,0.667,0.417,0.917,0.03,-0.012,0.069
-Toto-2.0-22m,Toto-1.0,0.75,0.5,1.0,0.081,0.012,0.155
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.042,0.025,0.061
-Toto-2.0-22m,Chronos-Bolt,1.0,1.0,1.0,0.111,0.063,0.16
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.379,0.266,0.482
-Toto-2.0-1B,TiRex-2,0.167,0.0,0.417,-0.049,-0.08,-0.018
-Toto-2.0-1B,TimesFM-3,0.333,0.083,0.583,-0.036,-0.082,-0.003
-Toto-2.0-1B,Stat. Ensemble,0.5,0.25,0.75,-0.013,-0.073,0.039
-Toto-2.0-1B,Toto-2.0-22m,0.583,0.333,0.833,-0.004,-0.041,0.028
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-2.5B,0.583,0.333,0.833,-0.0,-0.013,0.013
-Toto-2.0-1B,Toto-2.0-313m,0.667,0.417,0.917,0.0,-0.011,0.011
-Toto-2.0-1B,Chronos-2,0.5,0.25,0.752,0.021,-0.027,0.076
-Toto-2.0-1B,TiRex,0.667,0.417,0.917,0.012,-0.019,0.044
-Toto-2.0-1B,LightGBM,0.583,0.333,0.833,0.014,-0.046,0.063
-Toto-2.0-1B,FlowState,0.667,0.417,0.917,0.038,-0.045,0.096
-Toto-2.0-1B,AutoETS,0.667,0.417,0.917,0.027,-0.016,0.071
-Toto-2.0-1B,CatBoost,0.75,0.5,1.0,0.026,-0.035,0.074
-Toto-2.0-1B,Toto-1.0,0.583,0.25,0.833,0.077,0.011,0.152
-Toto-2.0-1B,Toto-2.0-4m,0.833,0.583,1.0,0.038,-0.006,0.081
-Toto-2.0-1B,Chronos-Bolt,0.833,0.583,1.0,0.108,0.058,0.154
-Toto-2.0-1B,Seasonal Naive,0.917,0.75,1.0,0.376,0.262,0.473
-Toto-2.0-2.5B,TiRex-2,0.167,0.0,0.417,-0.049,-0.082,-0.015
-Toto-2.0-2.5B,TimesFM-3,0.333,0.083,0.583,-0.036,-0.081,0.001
-Toto-2.0-2.5B,Stat. Ensemble,0.333,0.083,0.583,-0.013,-0.068,0.039
-Toto-2.0-2.5B,Toto-2.0-22m,0.417,0.167,0.667,-0.004,-0.035,0.028
-Toto-2.0-2.5B,Toto-2.0-1B,0.417,0.167,0.667,0.0,-0.014,0.013
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.5,0.25,0.75,0.0,-0.01,0.009
-Toto-2.0-2.5B,Chronos-2,0.417,0.167,0.75,0.021,-0.024,0.072
-Toto-2.0-2.5B,TiRex,0.583,0.333,0.833,0.012,-0.011,0.037
-Toto-2.0-2.5B,LightGBM,0.667,0.417,0.917,0.014,-0.043,0.067
-Toto-2.0-2.5B,FlowState,0.667,0.417,0.917,0.038,-0.043,0.103
-Toto-2.0-2.5B,AutoETS,0.583,0.333,0.833,0.027,-0.011,0.068
-Toto-2.0-2.5B,CatBoost,0.667,0.417,0.917,0.026,-0.033,0.076
-Toto-2.0-2.5B,Toto-1.0,0.583,0.25,0.833,0.077,0.001,0.158
-Toto-2.0-2.5B,Toto-2.0-4m,0.667,0.417,0.917,0.038,-0.002,0.085
-Toto-2.0-2.5B,Chronos-Bolt,0.917,0.75,1.0,0.108,0.058,0.156
-Toto-2.0-2.5B,Seasonal Naive,0.917,0.75,1.0,0.376,0.263,0.471
-Toto-2.0-313m,TiRex-2,0.167,0.0,0.417,-0.049,-0.076,-0.021
-Toto-2.0-313m,TimesFM-3,0.25,0.083,0.5,-0.037,-0.075,-0.005
-Toto-2.0-313m,Stat. Ensemble,0.417,0.167,0.75,-0.014,-0.068,0.037
-Toto-2.0-313m,Toto-2.0-22m,0.417,0.167,0.667,-0.004,-0.032,0.023
-Toto-2.0-313m,Toto-2.0-1B,0.333,0.083,0.583,-0.0,-0.011,0.011
-Toto-2.0-313m,Toto-2.0-2.5B,0.5,0.25,0.75,-0.0,-0.009,0.01
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Chronos-2,0.417,0.167,0.75,0.021,-0.03,0.075
-Toto-2.0-313m,TiRex,0.583,0.333,0.833,0.012,-0.013,0.041
-Toto-2.0-313m,LightGBM,0.667,0.417,0.917,0.014,-0.041,0.063
-Toto-2.0-313m,FlowState,0.667,0.417,0.917,0.037,-0.043,0.1
-Toto-2.0-313m,AutoETS,0.5,0.25,0.752,0.027,-0.011,0.069
-Toto-2.0-313m,CatBoost,0.667,0.417,0.917,0.026,-0.03,0.075
-Toto-2.0-313m,Toto-1.0,0.583,0.25,0.833,0.077,0.006,0.155
-Toto-2.0-313m,Toto-2.0-4m,0.667,0.417,0.917,0.038,0.001,0.08
-Toto-2.0-313m,Chronos-Bolt,0.917,0.75,1.0,0.107,0.058,0.157
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.376,0.262,0.475
-Chronos-2,TiRex-2,0.167,0.0,0.417,-0.071,-0.141,-0.014
-Chronos-2,TimesFM-3,0.167,0.0,0.417,-0.059,-0.133,0.002
-Chronos-2,Stat. Ensemble,0.25,0.0,0.5,-0.035,-0.095,0.014
-Chronos-2,Toto-2.0-22m,0.417,0.167,0.75,-0.025,-0.088,0.039
-Chronos-2,Toto-2.0-1B,0.5,0.248,0.75,-0.022,-0.082,0.027
-Chronos-2,Toto-2.0-2.5B,0.583,0.25,0.833,-0.022,-0.077,0.024
-Chronos-2,Toto-2.0-313m,0.583,0.25,0.833,-0.021,-0.081,0.029
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,TiRex,0.417,0.167,0.667,-0.009,-0.045,0.026
-Chronos-2,LightGBM,0.5,0.25,0.75,-0.007,-0.068,0.055
-Chronos-2,FlowState,0.5,0.25,0.75,0.017,-0.064,0.092
-Chronos-2,AutoETS,0.5,0.25,0.75,0.006,-0.027,0.041
-Chronos-2,CatBoost,0.583,0.333,0.833,0.005,-0.055,0.067
-Chronos-2,Toto-1.0,0.583,0.333,0.833,0.058,-0.037,0.145
-Chronos-2,Toto-2.0-4m,0.583,0.333,0.833,0.017,-0.054,0.091
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.088,0.044,0.143
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.363,0.264,0.451
-TiRex,TiRex-2,0.0,0.0,0.0,-0.062,-0.101,-0.033
-TiRex,TimesFM-3,0.333,0.083,0.667,-0.049,-0.097,-0.009
-TiRex,Stat. Ensemble,0.25,0.0,0.5,-0.026,-0.078,0.023
-TiRex,Toto-2.0-22m,0.417,0.167,0.75,-0.016,-0.051,0.019
-TiRex,Toto-2.0-1B,0.333,0.083,0.583,-0.012,-0.046,0.018
-TiRex,Toto-2.0-2.5B,0.417,0.167,0.667,-0.012,-0.038,0.011
-TiRex,Toto-2.0-313m,0.417,0.167,0.667,-0.012,-0.043,0.012
-TiRex,Chronos-2,0.583,0.333,0.833,0.009,-0.026,0.043
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,LightGBM,0.5,0.25,0.75,0.002,-0.051,0.049
-TiRex,FlowState,0.583,0.333,0.833,0.026,-0.05,0.091
-TiRex,AutoETS,0.5,0.25,0.75,0.015,-0.013,0.045
-TiRex,CatBoost,0.75,0.5,1.0,0.014,-0.041,0.062
-TiRex,Toto-1.0,0.583,0.333,0.833,0.066,-0.019,0.149
-TiRex,Toto-2.0-4m,0.583,0.333,0.833,0.026,-0.02,0.076
-TiRex,Chronos-Bolt,0.917,0.75,1.0,0.097,0.05,0.149
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.369,0.261,0.466
-LightGBM,TiRex-2,0.083,0.0,0.25,-0.064,-0.114,-0.016
-LightGBM,TimesFM-3,0.167,0.0,0.417,-0.052,-0.09,-0.019
-LightGBM,Stat. Ensemble,0.25,0.0,0.5,-0.028,-0.064,0.0
-LightGBM,Toto-2.0-22m,0.333,0.083,0.583,-0.018,-0.056,0.02
-LightGBM,Toto-2.0-1B,0.417,0.167,0.667,-0.015,-0.068,0.044
-LightGBM,Toto-2.0-2.5B,0.333,0.083,0.583,-0.015,-0.072,0.042
-LightGBM,Toto-2.0-313m,0.333,0.083,0.583,-0.014,-0.067,0.04
-LightGBM,Chronos-2,0.5,0.25,0.75,0.007,-0.059,0.064
-LightGBM,TiRex,0.5,0.25,0.75,-0.002,-0.051,0.049
-LightGBM,LightGBM,0.5,0.5,0.5,0.0,0.0,0.0
-LightGBM,FlowState,0.5,0.25,0.75,0.024,-0.019,0.072
-LightGBM,AutoETS,0.667,0.417,0.917,0.013,-0.03,0.049
-LightGBM,CatBoost,0.75,0.5,1.0,0.012,-0.002,0.026
-LightGBM,Toto-1.0,0.667,0.333,0.917,0.064,-0.009,0.132
-LightGBM,Toto-2.0-4m,0.5,0.25,0.75,0.024,-0.016,0.063
-LightGBM,Chronos-Bolt,0.917,0.75,1.0,0.095,0.053,0.136
-LightGBM,Seasonal Naive,1.0,1.0,1.0,0.367,0.267,0.458
-FlowState,TiRex-2,0.167,0.0,0.417,-0.09,-0.168,-0.013
-FlowState,TimesFM-3,0.25,0.0,0.5,-0.077,-0.144,-0.017
-FlowState,Stat. Ensemble,0.333,0.083,0.583,-0.053,-0.117,0.001
-FlowState,Toto-2.0-22m,0.333,0.083,0.583,-0.043,-0.117,0.025
-FlowState,Toto-2.0-1B,0.333,0.083,0.583,-0.039,-0.107,0.043
-FlowState,Toto-2.0-2.5B,0.333,0.083,0.583,-0.039,-0.114,0.041
-FlowState,Toto-2.0-313m,0.333,0.083,0.583,-0.039,-0.112,0.041
-FlowState,Chronos-2,0.5,0.25,0.75,-0.017,-0.102,0.06
-FlowState,TiRex,0.417,0.167,0.667,-0.026,-0.1,0.048
-FlowState,LightGBM,0.5,0.25,0.75,-0.024,-0.077,0.019
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,AutoETS,0.417,0.167,0.667,-0.011,-0.083,0.049
-FlowState,CatBoost,0.667,0.417,0.917,-0.012,-0.06,0.028
-FlowState,Toto-1.0,0.583,0.292,0.833,0.041,-0.047,0.127
-FlowState,Toto-2.0-4m,0.5,0.25,0.75,0.001,-0.075,0.068
-FlowState,Chronos-Bolt,0.833,0.625,1.0,0.073,0.02,0.125
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.352,0.265,0.429
-AutoETS,TiRex-2,0.083,0.0,0.25,-0.078,-0.126,-0.037
-AutoETS,TimesFM-3,0.167,0.0,0.417,-0.065,-0.111,-0.028
-AutoETS,Stat. Ensemble,0.25,0.0,0.5,-0.042,-0.072,-0.016
-AutoETS,Toto-2.0-22m,0.333,0.083,0.667,-0.032,-0.073,0.008
-AutoETS,Toto-2.0-1B,0.333,0.083,0.583,-0.028,-0.076,0.015
-AutoETS,Toto-2.0-2.5B,0.417,0.167,0.667,-0.028,-0.073,0.011
-AutoETS,Toto-2.0-313m,0.5,0.248,0.75,-0.028,-0.074,0.011
-AutoETS,Chronos-2,0.5,0.25,0.75,-0.006,-0.043,0.026
-AutoETS,TiRex,0.5,0.25,0.75,-0.015,-0.047,0.013
-AutoETS,LightGBM,0.333,0.083,0.583,-0.013,-0.052,0.029
-AutoETS,FlowState,0.583,0.333,0.833,0.011,-0.051,0.077
-AutoETS,AutoETS,0.5,0.5,0.5,0.0,0.0,0.0
-AutoETS,CatBoost,0.417,0.167,0.667,-0.001,-0.04,0.039
-AutoETS,Toto-1.0,0.583,0.333,0.833,0.052,-0.025,0.122
-AutoETS,Toto-2.0-4m,0.583,0.25,0.833,0.011,-0.035,0.059
-AutoETS,Chronos-Bolt,0.833,0.583,1.0,0.083,0.041,0.127
-AutoETS,Seasonal Naive,1.0,1.0,1.0,0.359,0.256,0.456
-CatBoost,TiRex-2,0.167,0.0,0.417,-0.077,-0.133,-0.024
-CatBoost,TimesFM-3,0.25,0.0,0.5,-0.064,-0.106,-0.029
-CatBoost,Stat. Ensemble,0.25,0.0,0.5,-0.041,-0.078,-0.005
-CatBoost,Toto-2.0-22m,0.333,0.083,0.583,-0.031,-0.074,0.012
-CatBoost,Toto-2.0-1B,0.25,0.0,0.5,-0.027,-0.08,0.034
-CatBoost,Toto-2.0-2.5B,0.333,0.083,0.583,-0.027,-0.083,0.032
-CatBoost,Toto-2.0-313m,0.333,0.083,0.583,-0.027,-0.081,0.029
-CatBoost,Chronos-2,0.417,0.167,0.667,-0.005,-0.071,0.052
-CatBoost,TiRex,0.25,0.0,0.5,-0.014,-0.066,0.039
-CatBoost,LightGBM,0.25,0.0,0.5,-0.012,-0.026,0.002
-CatBoost,FlowState,0.333,0.083,0.583,0.012,-0.029,0.057
-CatBoost,AutoETS,0.583,0.333,0.833,0.001,-0.041,0.039
-CatBoost,CatBoost,0.5,0.5,0.5,0.0,0.0,0.0
-CatBoost,Toto-1.0,0.667,0.333,0.917,0.053,-0.022,0.121
-CatBoost,Toto-2.0-4m,0.5,0.25,0.75,0.012,-0.033,0.054
-CatBoost,Chronos-Bolt,0.917,0.75,1.0,0.084,0.046,0.12
-CatBoost,Seasonal Naive,1.0,1.0,1.0,0.36,0.26,0.448
-Toto-1.0,TiRex-2,0.167,0.0,0.417,-0.137,-0.24,-0.054
-Toto-1.0,TimesFM-3,0.167,0.0,0.417,-0.123,-0.208,-0.05
-Toto-1.0,Stat. Ensemble,0.25,0.0,0.583,-0.099,-0.177,-0.024
-Toto-1.0,Toto-2.0-22m,0.25,0.0,0.5,-0.088,-0.183,-0.012
-Toto-1.0,Toto-2.0-1B,0.417,0.167,0.75,-0.084,-0.179,-0.012
-Toto-1.0,Toto-2.0-2.5B,0.417,0.167,0.75,-0.084,-0.188,-0.001
-Toto-1.0,Toto-2.0-313m,0.417,0.167,0.75,-0.084,-0.184,-0.006
-Toto-1.0,Chronos-2,0.417,0.167,0.667,-0.061,-0.169,0.035
-Toto-1.0,TiRex,0.417,0.167,0.667,-0.071,-0.175,0.019
-Toto-1.0,LightGBM,0.333,0.083,0.667,-0.068,-0.152,0.009
-Toto-1.0,FlowState,0.417,0.167,0.708,-0.043,-0.146,0.045
-Toto-1.0,AutoETS,0.417,0.167,0.667,-0.055,-0.139,0.025
-Toto-1.0,CatBoost,0.333,0.083,0.667,-0.056,-0.138,0.021
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,Toto-2.0-4m,0.583,0.333,0.833,-0.043,-0.126,0.025
-Toto-1.0,Chronos-Bolt,0.75,0.5,0.958,0.033,-0.034,0.097
-Toto-1.0,Seasonal Naive,0.917,0.75,1.0,0.324,0.198,0.433
-Toto-2.0-4m,TiRex-2,0.083,0.0,0.25,-0.09,-0.139,-0.051
-Toto-2.0-4m,TimesFM-3,0.0,0.0,0.0,-0.077,-0.108,-0.048
-Toto-2.0-4m,Stat. Ensemble,0.333,0.083,0.667,-0.054,-0.108,-0.007
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.044,-0.065,-0.026
-Toto-2.0-4m,Toto-2.0-1B,0.167,0.0,0.417,-0.04,-0.088,0.006
-Toto-2.0-4m,Toto-2.0-2.5B,0.333,0.083,0.583,-0.04,-0.093,0.002
-Toto-2.0-4m,Toto-2.0-313m,0.333,0.083,0.583,-0.039,-0.087,-0.001
-Toto-2.0-4m,Chronos-2,0.417,0.167,0.667,-0.018,-0.1,0.051
-Toto-2.0-4m,TiRex,0.417,0.167,0.667,-0.027,-0.082,0.019
-Toto-2.0-4m,LightGBM,0.5,0.25,0.75,-0.025,-0.068,0.016
-Toto-2.0-4m,FlowState,0.5,0.25,0.75,-0.001,-0.073,0.07
-Toto-2.0-4m,AutoETS,0.417,0.167,0.75,-0.011,-0.063,0.034
-Toto-2.0-4m,CatBoost,0.5,0.25,0.75,-0.013,-0.057,0.032
-Toto-2.0-4m,Toto-1.0,0.417,0.167,0.667,0.041,-0.025,0.112
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,Chronos-Bolt,0.667,0.417,0.917,0.072,0.02,0.128
-Toto-2.0-4m,Seasonal Naive,0.917,0.75,1.0,0.352,0.226,0.462
-Chronos-Bolt,TiRex-2,0.0,0.0,0.0,-0.175,-0.258,-0.106
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.161,-0.234,-0.099
-Chronos-Bolt,Stat. Ensemble,0.083,0.0,0.25,-0.136,-0.202,-0.073
-Chronos-Bolt,Toto-2.0-22m,0.0,0.0,0.0,-0.125,-0.191,-0.068
-Chronos-Bolt,Toto-2.0-1B,0.167,0.0,0.417,-0.121,-0.182,-0.062
-Chronos-Bolt,Toto-2.0-2.5B,0.083,0.0,0.25,-0.121,-0.185,-0.061
-Chronos-Bolt,Toto-2.0-313m,0.083,0.0,0.25,-0.12,-0.186,-0.062
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.097,-0.167,-0.046
-Chronos-Bolt,TiRex,0.083,0.0,0.25,-0.107,-0.175,-0.053
-Chronos-Bolt,LightGBM,0.083,0.0,0.25,-0.104,-0.157,-0.056
-Chronos-Bolt,FlowState,0.167,0.0,0.375,-0.078,-0.143,-0.02
-Chronos-Bolt,AutoETS,0.167,0.0,0.417,-0.09,-0.145,-0.043
-Chronos-Bolt,CatBoost,0.083,0.0,0.25,-0.091,-0.136,-0.049
-Chronos-Bolt,Toto-1.0,0.25,0.042,0.5,-0.034,-0.107,0.033
-Chronos-Bolt,Toto-2.0-4m,0.333,0.083,0.583,-0.078,-0.146,-0.021
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.833,0.583,1.0,0.301,0.198,0.389
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.682,-1.021,-0.425
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.662,-0.988,-0.413
-Seasonal Naive,Stat. Ensemble,0.0,0.0,0.0,-0.625,-0.907,-0.407
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.61,-0.932,-0.362
-Seasonal Naive,Toto-2.0-1B,0.083,0.0,0.25,-0.604,-0.897,-0.355
-Seasonal Naive,Toto-2.0-2.5B,0.083,0.0,0.25,-0.604,-0.891,-0.357
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.604,-0.904,-0.354
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.57,-0.821,-0.358
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.584,-0.872,-0.353
-Seasonal Naive,LightGBM,0.0,0.0,0.0,-0.581,-0.845,-0.364
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.544,-0.752,-0.36
-Seasonal Naive,AutoETS,0.0,0.0,0.0,-0.56,-0.837,-0.345
-Seasonal Naive,CatBoost,0.0,0.0,0.0,-0.562,-0.812,-0.352
-Seasonal Naive,Toto-1.0,0.083,0.0,0.25,-0.48,-0.763,-0.247
-Seasonal Naive,Toto-2.0-4m,0.083,0.0,0.25,-0.543,-0.858,-0.292
-Seasonal Naive,Chronos-Bolt,0.167,0.0,0.417,-0.431,-0.638,-0.246
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_econ/pairwise_SQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-3,0.75,0.5,1.0,0.02,-0.001,0.041
-TiRex-2,Toto-2.0-1B,0.833,0.583,1.0,0.05,0.019,0.077
-TiRex-2,Toto-2.0-2.5B,0.833,0.583,1.0,0.046,0.014,0.077
-TiRex-2,Toto-2.0-313m,0.833,0.583,1.0,0.05,0.022,0.076
-TiRex-2,TiRex,1.0,1.0,1.0,0.052,0.026,0.086
-TiRex-2,Toto-2.0-22m,0.75,0.5,0.917,0.05,0.023,0.079
-TiRex-2,Chronos-2,0.917,0.75,1.0,0.058,0.014,0.109
-TiRex-2,Stat. Ensemble,0.833,0.583,1.0,0.068,0.024,0.107
-TiRex-2,FlowState,0.833,0.583,1.0,0.094,0.027,0.152
-TiRex-2,Toto-1.0,1.0,1.0,1.0,0.118,0.061,0.181
-TiRex-2,Toto-2.0-4m,0.917,0.75,1.0,0.085,0.049,0.126
-TiRex-2,t0-beta,0.917,0.75,1.0,0.085,0.052,0.117
-TiRex-2,citras-fm,0.917,0.75,1.0,0.095,0.05,0.135
-TiRex-2,TabPFN-TS,0.833,0.583,1.0,0.096,0.05,0.138
-TiRex-2,Chronos-Bolt,1.0,1.0,1.0,0.14,0.09,0.195
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.414,0.318,0.502
-TimesFM-3,TiRex-2,0.25,0.0,0.5,-0.02,-0.043,0.001
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Toto-2.0-1B,0.583,0.333,0.833,0.03,0.003,0.065
-TimesFM-3,Toto-2.0-2.5B,0.583,0.333,0.833,0.027,-0.006,0.061
-TimesFM-3,Toto-2.0-313m,0.667,0.417,0.917,0.031,0.005,0.059
-TimesFM-3,TiRex,0.583,0.333,0.833,0.032,-0.004,0.07
-TimesFM-3,Toto-2.0-22m,0.833,0.583,1.0,0.031,0.014,0.047
-TimesFM-3,Chronos-2,0.833,0.583,1.0,0.039,-0.014,0.095
-TimesFM-3,Stat. Ensemble,0.75,0.5,1.0,0.049,0.009,0.086
-TimesFM-3,FlowState,0.833,0.583,1.0,0.076,0.018,0.127
-TimesFM-3,Toto-1.0,0.833,0.583,1.0,0.1,0.045,0.158
-TimesFM-3,Toto-2.0-4m,1.0,1.0,1.0,0.067,0.044,0.092
-TimesFM-3,t0-beta,0.917,0.75,1.0,0.066,0.036,0.096
-TimesFM-3,citras-fm,0.917,0.75,1.0,0.076,0.034,0.125
-TimesFM-3,TabPFN-TS,0.833,0.583,1.0,0.077,0.021,0.125
-TimesFM-3,Chronos-Bolt,0.917,0.75,1.0,0.123,0.075,0.171
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.402,0.303,0.491
-Toto-2.0-1B,TiRex-2,0.167,0.0,0.417,-0.052,-0.083,-0.019
-Toto-2.0-1B,TimesFM-3,0.417,0.167,0.667,-0.031,-0.069,-0.003
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-2.5B,0.417,0.167,0.667,-0.004,-0.018,0.01
-Toto-2.0-1B,Toto-2.0-313m,0.583,0.333,0.833,0.0,-0.016,0.014
-Toto-2.0-1B,TiRex,0.5,0.25,0.75,0.002,-0.025,0.032
-Toto-2.0-1B,Toto-2.0-22m,0.5,0.167,0.75,0.0,-0.03,0.027
-Toto-2.0-1B,Chronos-2,0.417,0.167,0.75,0.009,-0.036,0.055
-Toto-2.0-1B,Stat. Ensemble,0.75,0.5,1.0,0.019,-0.04,0.068
-Toto-2.0-1B,FlowState,0.75,0.5,1.0,0.047,-0.032,0.1
-Toto-2.0-1B,Toto-1.0,0.75,0.5,1.0,0.072,0.013,0.134
-Toto-2.0-1B,Toto-2.0-4m,0.833,0.583,1.0,0.037,-0.006,0.08
-Toto-2.0-1B,t0-beta,0.833,0.583,1.0,0.037,0.009,0.062
-Toto-2.0-1B,citras-fm,0.833,0.667,1.0,0.047,0.024,0.072
-Toto-2.0-1B,TabPFN-TS,0.833,0.583,1.0,0.048,-0.007,0.097
-Toto-2.0-1B,Chronos-Bolt,0.833,0.583,1.0,0.095,0.048,0.139
-Toto-2.0-1B,Seasonal Naive,0.917,0.75,1.0,0.383,0.278,0.469
-Toto-2.0-2.5B,TiRex-2,0.167,0.0,0.417,-0.048,-0.084,-0.015
-Toto-2.0-2.5B,TimesFM-3,0.417,0.167,0.667,-0.027,-0.065,0.006
-Toto-2.0-2.5B,Toto-2.0-1B,0.583,0.333,0.833,0.004,-0.011,0.018
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.583,0.331,0.833,0.004,-0.006,0.014
-Toto-2.0-2.5B,TiRex,0.5,0.25,0.75,0.006,-0.017,0.03
-Toto-2.0-2.5B,Toto-2.0-22m,0.583,0.25,0.833,0.004,-0.024,0.036
-Toto-2.0-2.5B,Chronos-2,0.417,0.167,0.75,0.013,-0.029,0.057
-Toto-2.0-2.5B,Stat. Ensemble,0.583,0.333,0.833,0.023,-0.033,0.071
-Toto-2.0-2.5B,FlowState,0.667,0.417,0.917,0.051,-0.024,0.108
-Toto-2.0-2.5B,Toto-1.0,0.75,0.5,1.0,0.076,0.006,0.146
-Toto-2.0-2.5B,Toto-2.0-4m,0.667,0.417,0.917,0.041,0.0,0.089
-Toto-2.0-2.5B,t0-beta,0.917,0.75,1.0,0.041,0.019,0.062
-Toto-2.0-2.5B,citras-fm,0.833,0.583,1.0,0.051,0.026,0.078
-Toto-2.0-2.5B,TabPFN-TS,0.75,0.5,1.0,0.052,0.005,0.095
-Toto-2.0-2.5B,Chronos-Bolt,0.917,0.75,1.0,0.099,0.05,0.146
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.385,0.285,0.47
-Toto-2.0-313m,TiRex-2,0.167,0.0,0.417,-0.053,-0.082,-0.023
-Toto-2.0-313m,TimesFM-3,0.333,0.083,0.583,-0.032,-0.062,-0.005
-Toto-2.0-313m,Toto-2.0-1B,0.417,0.167,0.667,-0.0,-0.015,0.015
-Toto-2.0-313m,Toto-2.0-2.5B,0.417,0.167,0.669,-0.004,-0.014,0.006
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TiRex,0.583,0.333,0.833,0.002,-0.025,0.029
-Toto-2.0-313m,Toto-2.0-22m,0.583,0.25,0.833,-0.0,-0.024,0.024
-Toto-2.0-313m,Chronos-2,0.5,0.167,0.833,0.009,-0.038,0.056
-Toto-2.0-313m,Stat. Ensemble,0.667,0.417,0.917,0.018,-0.031,0.064
-Toto-2.0-313m,FlowState,0.667,0.417,0.917,0.046,-0.02,0.099
-Toto-2.0-313m,Toto-1.0,0.667,0.417,0.917,0.072,0.005,0.139
-Toto-2.0-313m,Toto-2.0-4m,0.667,0.417,0.917,0.037,0.001,0.079
-Toto-2.0-313m,t0-beta,0.917,0.75,1.0,0.037,0.016,0.055
-Toto-2.0-313m,citras-fm,0.833,0.667,1.0,0.047,0.016,0.081
-Toto-2.0-313m,TabPFN-TS,0.75,0.5,1.0,0.048,0.0,0.09
-Toto-2.0-313m,Chronos-Bolt,0.917,0.75,1.0,0.095,0.047,0.142
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.383,0.283,0.468
-TiRex,TiRex-2,0.0,0.0,0.0,-0.055,-0.094,-0.027
-TiRex,TimesFM-3,0.417,0.167,0.667,-0.034,-0.075,0.003
-TiRex,Toto-2.0-1B,0.5,0.25,0.75,-0.002,-0.033,0.024
-TiRex,Toto-2.0-2.5B,0.5,0.25,0.75,-0.006,-0.031,0.017
-TiRex,Toto-2.0-313m,0.417,0.167,0.667,-0.002,-0.03,0.024
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,Toto-2.0-22m,0.5,0.25,0.833,-0.002,-0.037,0.033
-TiRex,Chronos-2,0.667,0.417,0.917,0.007,-0.028,0.036
-TiRex,Stat. Ensemble,0.75,0.5,1.0,0.017,-0.034,0.06
-TiRex,FlowState,0.833,0.583,1.0,0.045,-0.023,0.098
-TiRex,Toto-1.0,0.667,0.333,0.917,0.07,-0.008,0.143
-TiRex,Toto-2.0-4m,0.667,0.415,0.917,0.035,-0.011,0.083
-TiRex,t0-beta,0.75,0.5,1.0,0.035,0.006,0.064
-TiRex,citras-fm,0.667,0.417,0.917,0.045,0.013,0.08
-TiRex,TabPFN-TS,0.833,0.583,1.0,0.046,0.002,0.086
-TiRex,Chronos-Bolt,0.917,0.75,1.0,0.093,0.05,0.141
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.382,0.282,0.467
-Toto-2.0-22m,TiRex-2,0.25,0.083,0.5,-0.053,-0.086,-0.024
-Toto-2.0-22m,TimesFM-3,0.167,0.0,0.417,-0.032,-0.049,-0.014
-Toto-2.0-22m,Toto-2.0-1B,0.5,0.25,0.833,-0.0,-0.028,0.029
-Toto-2.0-22m,Toto-2.0-2.5B,0.417,0.167,0.75,-0.004,-0.038,0.023
-Toto-2.0-22m,Toto-2.0-313m,0.417,0.167,0.75,0.0,-0.025,0.023
-Toto-2.0-22m,TiRex,0.5,0.167,0.75,0.002,-0.034,0.036
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Chronos-2,0.5,0.167,0.833,0.009,-0.051,0.061
-Toto-2.0-22m,Stat. Ensemble,0.667,0.417,0.917,0.019,-0.03,0.062
-Toto-2.0-22m,FlowState,0.583,0.333,0.833,0.046,-0.012,0.098
-Toto-2.0-22m,Toto-1.0,0.667,0.417,0.917,0.072,0.016,0.131
-Toto-2.0-22m,Toto-2.0-4m,0.833,0.583,1.0,0.037,0.019,0.057
-Toto-2.0-22m,t0-beta,0.833,0.583,1.0,0.037,0.012,0.059
-Toto-2.0-22m,citras-fm,0.833,0.583,1.0,0.047,0.005,0.091
-Toto-2.0-22m,TabPFN-TS,0.667,0.417,0.917,0.048,-0.011,0.096
-Toto-2.0-22m,Chronos-Bolt,1.0,1.0,1.0,0.095,0.055,0.138
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.383,0.284,0.473
-Chronos-2,TiRex-2,0.083,0.0,0.25,-0.062,-0.123,-0.014
-Chronos-2,TimesFM-3,0.167,0.0,0.417,-0.041,-0.105,0.014
-Chronos-2,Toto-2.0-1B,0.583,0.25,0.833,-0.009,-0.059,0.035
-Chronos-2,Toto-2.0-2.5B,0.583,0.25,0.833,-0.013,-0.06,0.028
-Chronos-2,Toto-2.0-313m,0.5,0.167,0.833,-0.009,-0.06,0.036
-Chronos-2,TiRex,0.333,0.083,0.583,-0.007,-0.037,0.027
-Chronos-2,Toto-2.0-22m,0.5,0.167,0.833,-0.009,-0.065,0.049
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Stat. Ensemble,0.833,0.583,1.0,0.01,-0.042,0.051
-Chronos-2,FlowState,0.667,0.417,0.917,0.038,-0.034,0.106
-Chronos-2,Toto-1.0,0.667,0.333,0.917,0.064,-0.021,0.141
-Chronos-2,Toto-2.0-4m,0.667,0.415,0.917,0.029,-0.035,0.098
-Chronos-2,t0-beta,0.583,0.25,0.833,0.028,-0.024,0.082
-Chronos-2,citras-fm,0.75,0.5,1.0,0.038,-0.003,0.079
-Chronos-2,TabPFN-TS,0.75,0.5,1.0,0.04,0.005,0.072
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.087,0.043,0.142
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.377,0.286,0.457
-Stat. Ensemble,TiRex-2,0.167,0.0,0.417,-0.073,-0.119,-0.024
-Stat. Ensemble,TimesFM-3,0.25,0.0,0.5,-0.051,-0.094,-0.009
-Stat. Ensemble,Toto-2.0-1B,0.25,0.0,0.5,-0.019,-0.072,0.039
-Stat. Ensemble,Toto-2.0-2.5B,0.417,0.167,0.667,-0.023,-0.076,0.032
-Stat. Ensemble,Toto-2.0-313m,0.333,0.083,0.583,-0.019,-0.069,0.03
-Stat. Ensemble,TiRex,0.25,0.0,0.5,-0.017,-0.064,0.033
-Stat. Ensemble,Toto-2.0-22m,0.333,0.083,0.583,-0.019,-0.066,0.029
-Stat. Ensemble,Chronos-2,0.167,0.0,0.417,-0.01,-0.053,0.04
-Stat. Ensemble,Stat. Ensemble,0.5,0.5,0.5,0.0,0.0,0.0
-Stat. Ensemble,FlowState,0.5,0.167,0.75,0.029,-0.016,0.073
-Stat. Ensemble,Toto-1.0,0.667,0.333,0.917,0.054,-0.012,0.118
-Stat. Ensemble,Toto-2.0-4m,0.417,0.167,0.667,0.019,-0.029,0.073
-Stat. Ensemble,t0-beta,0.5,0.25,0.75,0.019,-0.039,0.076
-Stat. Ensemble,citras-fm,0.5,0.25,0.75,0.029,-0.031,0.098
-Stat. Ensemble,TabPFN-TS,0.75,0.5,1.0,0.03,-0.01,0.063
-Stat. Ensemble,Chronos-Bolt,0.917,0.75,1.0,0.078,0.024,0.131
-Stat. Ensemble,Seasonal Naive,1.0,1.0,1.0,0.371,0.288,0.452
-FlowState,TiRex-2,0.167,0.0,0.417,-0.104,-0.179,-0.028
-FlowState,TimesFM-3,0.167,0.0,0.417,-0.082,-0.145,-0.019
-FlowState,Toto-2.0-1B,0.25,0.0,0.5,-0.049,-0.112,0.031
-FlowState,Toto-2.0-2.5B,0.333,0.083,0.583,-0.053,-0.121,0.024
-FlowState,Toto-2.0-313m,0.333,0.083,0.583,-0.049,-0.109,0.02
-FlowState,TiRex,0.167,0.0,0.417,-0.047,-0.109,0.023
-FlowState,Toto-2.0-22m,0.417,0.167,0.667,-0.049,-0.109,0.012
-FlowState,Chronos-2,0.333,0.083,0.583,-0.04,-0.118,0.033
-FlowState,Stat. Ensemble,0.5,0.25,0.833,-0.029,-0.079,0.016
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Toto-1.0,0.583,0.292,0.833,0.027,-0.057,0.11
-FlowState,Toto-2.0-4m,0.5,0.25,0.75,-0.01,-0.079,0.052
-FlowState,t0-beta,0.417,0.167,0.667,-0.01,-0.084,0.061
-FlowState,citras-fm,0.5,0.25,0.75,0.0,-0.075,0.088
-FlowState,TabPFN-TS,0.583,0.333,0.833,0.002,-0.065,0.055
-FlowState,Chronos-Bolt,0.833,0.625,1.0,0.051,-0.002,0.101
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.353,0.274,0.424
-Toto-1.0,TiRex-2,0.0,0.0,0.0,-0.134,-0.221,-0.065
-Toto-1.0,TimesFM-3,0.167,0.0,0.417,-0.112,-0.188,-0.047
-Toto-1.0,Toto-2.0-1B,0.25,0.0,0.5,-0.078,-0.155,-0.013
-Toto-1.0,Toto-2.0-2.5B,0.25,0.0,0.5,-0.082,-0.171,-0.006
-Toto-1.0,Toto-2.0-313m,0.333,0.083,0.583,-0.077,-0.162,-0.005
-Toto-1.0,TiRex,0.333,0.083,0.667,-0.076,-0.167,0.008
-Toto-1.0,Toto-2.0-22m,0.333,0.083,0.583,-0.078,-0.151,-0.017
-Toto-1.0,Chronos-2,0.333,0.083,0.667,-0.068,-0.164,0.021
-Toto-1.0,Stat. Ensemble,0.333,0.083,0.667,-0.058,-0.134,0.012
-Toto-1.0,FlowState,0.417,0.167,0.708,-0.027,-0.124,0.054
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,Toto-2.0-4m,0.583,0.333,0.833,-0.038,-0.107,0.022
-Toto-1.0,t0-beta,0.417,0.167,0.667,-0.038,-0.125,0.034
-Toto-1.0,citras-fm,0.583,0.333,0.833,-0.027,-0.108,0.041
-Toto-1.0,TabPFN-TS,0.667,0.417,0.917,-0.026,-0.134,0.065
-Toto-1.0,Chronos-Bolt,0.667,0.417,0.875,0.025,-0.031,0.083
-Toto-1.0,Seasonal Naive,0.917,0.75,1.0,0.335,0.215,0.436
-Toto-2.0-4m,TiRex-2,0.083,0.0,0.25,-0.093,-0.144,-0.052
-Toto-2.0-4m,TimesFM-3,0.0,0.0,0.0,-0.071,-0.101,-0.046
-Toto-2.0-4m,Toto-2.0-1B,0.167,0.0,0.417,-0.039,-0.087,0.006
-Toto-2.0-4m,Toto-2.0-2.5B,0.333,0.083,0.583,-0.043,-0.097,-0.0
-Toto-2.0-4m,Toto-2.0-313m,0.333,0.083,0.583,-0.038,-0.086,-0.001
-Toto-2.0-4m,TiRex,0.333,0.083,0.585,-0.037,-0.091,0.011
-Toto-2.0-4m,Toto-2.0-22m,0.167,0.0,0.417,-0.039,-0.06,-0.019
-Toto-2.0-4m,Chronos-2,0.333,0.083,0.585,-0.029,-0.108,0.034
-Toto-2.0-4m,Stat. Ensemble,0.583,0.333,0.833,-0.019,-0.079,0.028
-Toto-2.0-4m,FlowState,0.5,0.25,0.75,0.01,-0.055,0.073
-Toto-2.0-4m,Toto-1.0,0.417,0.167,0.667,0.036,-0.022,0.097
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,t0-beta,0.583,0.25,0.833,-0.0,-0.038,0.033
-Toto-2.0-4m,citras-fm,0.5,0.25,0.75,0.01,-0.052,0.069
-Toto-2.0-4m,TabPFN-TS,0.583,0.333,0.833,0.011,-0.067,0.07
-Toto-2.0-4m,Chronos-Bolt,0.667,0.417,0.917,0.06,0.01,0.112
-Toto-2.0-4m,Seasonal Naive,0.917,0.75,1.0,0.359,0.246,0.458
-t0-beta,TiRex-2,0.083,0.0,0.25,-0.093,-0.132,-0.054
-t0-beta,TimesFM-3,0.083,0.0,0.25,-0.071,-0.106,-0.037
-t0-beta,Toto-2.0-1B,0.167,0.0,0.417,-0.039,-0.066,-0.009
-t0-beta,Toto-2.0-2.5B,0.083,0.0,0.25,-0.043,-0.067,-0.019
-t0-beta,Toto-2.0-313m,0.083,0.0,0.25,-0.038,-0.058,-0.016
-t0-beta,TiRex,0.25,0.0,0.5,-0.036,-0.068,-0.006
-t0-beta,Toto-2.0-22m,0.167,0.0,0.417,-0.038,-0.062,-0.012
-t0-beta,Chronos-2,0.417,0.167,0.75,-0.029,-0.09,0.023
-t0-beta,Stat. Ensemble,0.5,0.25,0.75,-0.019,-0.083,0.038
-t0-beta,FlowState,0.583,0.333,0.833,0.01,-0.065,0.078
-t0-beta,Toto-1.0,0.583,0.333,0.833,0.036,-0.036,0.111
-t0-beta,Toto-2.0-4m,0.417,0.167,0.75,0.0,-0.034,0.037
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,citras-fm,0.583,0.333,0.833,0.01,-0.025,0.049
-t0-beta,TabPFN-TS,0.583,0.333,0.833,0.011,-0.049,0.063
-t0-beta,Chronos-Bolt,0.583,0.333,0.833,0.06,0.009,0.114
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.359,0.251,0.456
-citras-fm,TiRex-2,0.083,0.0,0.25,-0.105,-0.157,-0.053
-citras-fm,TimesFM-3,0.083,0.0,0.25,-0.082,-0.143,-0.035
-citras-fm,Toto-2.0-1B,0.167,0.0,0.333,-0.05,-0.077,-0.024
-citras-fm,Toto-2.0-2.5B,0.167,0.0,0.417,-0.054,-0.084,-0.027
-citras-fm,Toto-2.0-313m,0.167,0.0,0.333,-0.049,-0.089,-0.016
-citras-fm,TiRex,0.333,0.083,0.583,-0.047,-0.087,-0.013
-citras-fm,Toto-2.0-22m,0.167,0.0,0.417,-0.049,-0.1,-0.005
-citras-fm,Chronos-2,0.25,0.0,0.5,-0.04,-0.085,0.003
-citras-fm,Stat. Ensemble,0.5,0.25,0.75,-0.03,-0.108,0.03
-citras-fm,FlowState,0.5,0.25,0.75,-0.0,-0.097,0.069
-citras-fm,Toto-1.0,0.417,0.167,0.667,0.026,-0.043,0.097
-citras-fm,Toto-2.0-4m,0.5,0.25,0.75,-0.01,-0.074,0.049
-citras-fm,t0-beta,0.417,0.167,0.667,-0.01,-0.051,0.024
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,TabPFN-TS,0.583,0.333,0.833,0.001,-0.067,0.061
-citras-fm,Chronos-Bolt,0.75,0.5,1.0,0.05,-0.003,0.098
-citras-fm,Seasonal Naive,0.917,0.75,1.0,0.352,0.233,0.442
-TabPFN-TS,TiRex-2,0.167,0.0,0.417,-0.106,-0.16,-0.053
-TabPFN-TS,TimesFM-3,0.167,0.0,0.417,-0.084,-0.143,-0.021
-TabPFN-TS,Toto-2.0-1B,0.167,0.0,0.417,-0.051,-0.107,0.007
-TabPFN-TS,Toto-2.0-2.5B,0.25,0.0,0.5,-0.055,-0.105,-0.005
-TabPFN-TS,Toto-2.0-313m,0.25,0.0,0.5,-0.05,-0.099,-0.0
-TabPFN-TS,TiRex,0.167,0.0,0.417,-0.048,-0.094,-0.002
-TabPFN-TS,Toto-2.0-22m,0.333,0.083,0.583,-0.05,-0.106,0.011
-TabPFN-TS,Chronos-2,0.25,0.0,0.5,-0.041,-0.077,-0.005
-TabPFN-TS,Stat. Ensemble,0.25,0.0,0.5,-0.031,-0.067,0.009
-TabPFN-TS,FlowState,0.417,0.167,0.667,-0.002,-0.058,0.061
-TabPFN-TS,Toto-1.0,0.333,0.083,0.583,0.025,-0.069,0.118
-TabPFN-TS,Toto-2.0-4m,0.417,0.167,0.667,-0.011,-0.075,0.062
-TabPFN-TS,t0-beta,0.417,0.167,0.667,-0.012,-0.067,0.046
-TabPFN-TS,citras-fm,0.417,0.167,0.667,-0.001,-0.065,0.063
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,Chronos-Bolt,0.5,0.25,0.75,0.049,-0.015,0.114
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.352,0.266,0.435
-Chronos-Bolt,TiRex-2,0.0,0.0,0.0,-0.163,-0.242,-0.099
-Chronos-Bolt,TimesFM-3,0.083,0.0,0.25,-0.14,-0.206,-0.081
-Chronos-Bolt,Toto-2.0-1B,0.167,0.0,0.417,-0.105,-0.162,-0.05
-Chronos-Bolt,Toto-2.0-2.5B,0.083,0.0,0.25,-0.109,-0.171,-0.053
-Chronos-Bolt,Toto-2.0-313m,0.083,0.0,0.25,-0.105,-0.165,-0.049
-Chronos-Bolt,TiRex,0.083,0.0,0.25,-0.103,-0.164,-0.052
-Chronos-Bolt,Toto-2.0-22m,0.0,0.0,0.0,-0.105,-0.159,-0.058
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.095,-0.165,-0.044
-Chronos-Bolt,Stat. Ensemble,0.083,0.0,0.25,-0.084,-0.151,-0.024
-Chronos-Bolt,FlowState,0.167,0.0,0.375,-0.053,-0.113,0.002
-Chronos-Bolt,Toto-1.0,0.333,0.125,0.583,-0.025,-0.09,0.03
-Chronos-Bolt,Toto-2.0-4m,0.333,0.083,0.583,-0.064,-0.126,-0.01
-Chronos-Bolt,t0-beta,0.417,0.167,0.667,-0.064,-0.129,-0.009
-Chronos-Bolt,citras-fm,0.25,0.0,0.5,-0.053,-0.108,0.003
-Chronos-Bolt,TabPFN-TS,0.5,0.25,0.75,-0.052,-0.128,0.014
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.917,0.75,1.0,0.318,0.219,0.402
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.706,-1.009,-0.467
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.672,-0.965,-0.435
-Seasonal Naive,Toto-2.0-1B,0.083,0.0,0.25,-0.621,-0.884,-0.386
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.627,-0.887,-0.398
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.62,-0.881,-0.394
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.617,-0.877,-0.392
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.62,-0.898,-0.396
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.606,-0.842,-0.401
-Seasonal Naive,Stat. Ensemble,0.0,0.0,0.0,-0.59,-0.824,-0.404
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.545,-0.736,-0.377
-Seasonal Naive,Toto-1.0,0.083,0.0,0.25,-0.504,-0.774,-0.274
-Seasonal Naive,Toto-2.0-4m,0.083,0.0,0.25,-0.56,-0.847,-0.326
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.56,-0.837,-0.334
-Seasonal Naive,citras-fm,0.083,0.0,0.25,-0.544,-0.793,-0.303
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.543,-0.769,-0.363
-Seasonal Naive,Chronos-Bolt,0.083,0.0,0.25,-0.467,-0.673,-0.28
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_econ/pairwise_WAPE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-3,0.417,0.167,0.667,-0.01,-0.08,0.056
-TiRex-2,Toto-2.0-1B,0.583,0.333,0.833,0.054,-0.019,0.135
-TiRex-2,Toto-2.0-2.5B,0.583,0.25,0.833,0.05,-0.021,0.117
-TiRex-2,Toto-2.0-313m,0.75,0.5,1.0,0.063,-0.007,0.135
-TiRex-2,Toto-2.0-22m,0.667,0.417,0.917,0.068,0.017,0.127
-TiRex-2,TiRex,0.917,0.75,1.0,0.07,0.023,0.119
-TiRex-2,Chronos-2,0.75,0.5,1.0,0.088,0.017,0.151
-TiRex-2,Stat. Ensemble,0.833,0.583,1.0,0.064,-0.008,0.14
-TiRex-2,Toto-1.0,0.917,0.75,1.0,0.124,0.043,0.2
-TiRex-2,FlowState,0.917,0.75,1.0,0.072,-0.004,0.126
-TiRex-2,TimesFM-2.5,0.917,0.75,1.0,0.097,0.043,0.154
-TiRex-2,TabPFN-TS,0.75,0.5,1.0,0.088,0.001,0.173
-TiRex-2,citras-fm,0.917,0.75,1.0,0.117,0.053,0.186
-TiRex-2,t0-beta,0.917,0.75,1.0,0.114,0.049,0.18
-TiRex-2,Chronos-Bolt,1.0,1.0,1.0,0.168,0.089,0.254
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.421,0.305,0.538
-TimesFM-3,TiRex-2,0.583,0.333,0.833,0.01,-0.06,0.074
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Toto-2.0-1B,0.583,0.333,0.833,0.064,-0.015,0.177
-TimesFM-3,Toto-2.0-2.5B,0.5,0.25,0.75,0.059,-0.015,0.161
-TimesFM-3,Toto-2.0-313m,0.75,0.5,1.0,0.072,0.001,0.168
-TimesFM-3,Toto-2.0-22m,0.75,0.5,1.0,0.077,0.025,0.128
-TimesFM-3,TiRex,0.75,0.5,1.0,0.079,0.017,0.163
-TimesFM-3,Chronos-2,0.833,0.583,1.0,0.097,0.015,0.191
-TimesFM-3,Stat. Ensemble,0.75,0.5,1.0,0.073,0.035,0.108
-TimesFM-3,Toto-1.0,0.833,0.583,1.0,0.132,0.051,0.21
-TimesFM-3,FlowState,0.667,0.417,0.917,0.081,0.031,0.129
-TimesFM-3,TimesFM-2.5,0.917,0.75,1.0,0.106,0.037,0.198
-TimesFM-3,TabPFN-TS,0.833,0.583,1.0,0.097,0.041,0.159
-TimesFM-3,citras-fm,0.917,0.75,1.0,0.125,0.044,0.231
-TimesFM-3,t0-beta,0.833,0.583,1.0,0.123,0.054,0.209
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.176,0.096,0.254
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.427,0.327,0.525
-Toto-2.0-1B,TiRex-2,0.417,0.167,0.667,-0.058,-0.156,0.019
-Toto-2.0-1B,TimesFM-3,0.417,0.167,0.667,-0.068,-0.215,0.015
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-2.5B,0.5,0.25,0.75,-0.005,-0.023,0.01
-Toto-2.0-1B,Toto-2.0-313m,0.667,0.417,0.917,0.009,-0.017,0.033
-Toto-2.0-1B,Toto-2.0-22m,0.833,0.583,1.0,0.014,-0.085,0.08
-Toto-2.0-1B,TiRex,0.833,0.583,1.0,0.017,-0.022,0.044
-Toto-2.0-1B,Chronos-2,0.75,0.5,1.0,0.035,-0.015,0.078
-Toto-2.0-1B,Stat. Ensemble,0.75,0.5,1.0,0.01,-0.138,0.106
-Toto-2.0-1B,Toto-1.0,0.667,0.417,0.917,0.073,-0.013,0.157
-Toto-2.0-1B,FlowState,0.75,0.5,1.0,0.019,-0.152,0.114
-Toto-2.0-1B,TimesFM-2.5,0.75,0.5,0.917,0.045,-0.002,0.093
-Toto-2.0-1B,TabPFN-TS,0.75,0.5,1.0,0.036,-0.112,0.136
-Toto-2.0-1B,citras-fm,0.917,0.75,1.0,0.066,0.032,0.103
-Toto-2.0-1B,t0-beta,0.917,0.75,1.0,0.064,0.024,0.098
-Toto-2.0-1B,Chronos-Bolt,0.833,0.583,1.0,0.12,0.045,0.197
-Toto-2.0-1B,Seasonal Naive,0.917,0.75,1.0,0.388,0.248,0.515
-Toto-2.0-2.5B,TiRex-2,0.417,0.167,0.75,-0.052,-0.132,0.021
-Toto-2.0-2.5B,TimesFM-3,0.5,0.25,0.75,-0.063,-0.192,0.015
-Toto-2.0-2.5B,Toto-2.0-1B,0.5,0.25,0.75,0.005,-0.01,0.022
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.667,0.417,0.917,0.014,-0.007,0.033
-Toto-2.0-2.5B,Toto-2.0-22m,0.833,0.583,1.0,0.019,-0.065,0.083
-Toto-2.0-2.5B,TiRex,0.75,0.5,1.0,0.022,-0.004,0.046
-Toto-2.0-2.5B,Chronos-2,0.667,0.417,0.917,0.04,0.0,0.076
-Toto-2.0-2.5B,Stat. Ensemble,0.75,0.5,1.0,0.015,-0.114,0.104
-Toto-2.0-2.5B,Toto-1.0,0.667,0.417,0.917,0.078,-0.001,0.164
-Toto-2.0-2.5B,FlowState,0.75,0.5,1.0,0.023,-0.13,0.115
-Toto-2.0-2.5B,TimesFM-2.5,0.75,0.5,0.917,0.05,0.012,0.094
-Toto-2.0-2.5B,TabPFN-TS,0.75,0.5,1.0,0.041,-0.09,0.131
-Toto-2.0-2.5B,citras-fm,0.833,0.583,1.0,0.07,0.035,0.107
-Toto-2.0-2.5B,t0-beta,0.917,0.75,1.0,0.068,0.039,0.103
-Toto-2.0-2.5B,Chronos-Bolt,0.833,0.583,1.0,0.124,0.054,0.199
-Toto-2.0-2.5B,Seasonal Naive,0.917,0.75,1.0,0.391,0.26,0.511
-Toto-2.0-313m,TiRex-2,0.25,0.0,0.5,-0.067,-0.156,0.007
-Toto-2.0-313m,TimesFM-3,0.25,0.0,0.5,-0.077,-0.202,-0.001
-Toto-2.0-313m,Toto-2.0-1B,0.333,0.083,0.583,-0.009,-0.034,0.017
-Toto-2.0-313m,Toto-2.0-2.5B,0.333,0.083,0.583,-0.014,-0.034,0.007
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-22m,0.667,0.417,0.917,0.006,-0.071,0.063
-Toto-2.0-313m,TiRex,0.583,0.333,0.833,0.008,-0.021,0.035
-Toto-2.0-313m,Chronos-2,0.583,0.333,0.833,0.027,-0.018,0.066
-Toto-2.0-313m,Stat. Ensemble,0.75,0.5,1.0,0.001,-0.131,0.091
-Toto-2.0-313m,Toto-1.0,0.667,0.417,0.917,0.065,-0.011,0.147
-Toto-2.0-313m,FlowState,0.75,0.5,1.0,0.01,-0.142,0.106
-Toto-2.0-313m,TimesFM-2.5,0.667,0.417,0.917,0.037,-0.004,0.079
-Toto-2.0-313m,TabPFN-TS,0.75,0.5,1.0,0.027,-0.108,0.124
-Toto-2.0-313m,citras-fm,0.833,0.583,1.0,0.058,0.014,0.098
-Toto-2.0-313m,t0-beta,0.833,0.583,1.0,0.055,0.03,0.084
-Toto-2.0-313m,Chronos-Bolt,0.833,0.583,1.0,0.112,0.053,0.179
-Toto-2.0-313m,Seasonal Naive,0.917,0.75,1.0,0.383,0.252,0.506
-Toto-2.0-22m,TiRex-2,0.333,0.083,0.583,-0.073,-0.145,-0.018
-Toto-2.0-22m,TimesFM-3,0.25,0.0,0.5,-0.084,-0.147,-0.026
-Toto-2.0-22m,Toto-2.0-1B,0.167,0.0,0.417,-0.015,-0.086,0.078
-Toto-2.0-22m,Toto-2.0-2.5B,0.167,0.0,0.417,-0.02,-0.091,0.061
-Toto-2.0-22m,Toto-2.0-313m,0.333,0.083,0.583,-0.006,-0.067,0.066
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TiRex,0.5,0.248,0.75,0.002,-0.05,0.058
-Toto-2.0-22m,Chronos-2,0.75,0.5,1.0,0.021,-0.055,0.091
-Toto-2.0-22m,Stat. Ensemble,0.583,0.333,0.833,-0.004,-0.084,0.066
-Toto-2.0-22m,Toto-1.0,0.75,0.5,1.0,0.059,-0.005,0.12
-Toto-2.0-22m,FlowState,0.667,0.417,0.917,0.004,-0.084,0.08
-Toto-2.0-22m,TimesFM-2.5,0.667,0.417,0.917,0.031,-0.046,0.105
-Toto-2.0-22m,TabPFN-TS,0.583,0.333,0.833,0.022,-0.074,0.112
-Toto-2.0-22m,citras-fm,0.75,0.5,1.0,0.052,-0.018,0.13
-Toto-2.0-22m,t0-beta,0.833,0.583,1.0,0.05,0.011,0.101
-Toto-2.0-22m,Chronos-Bolt,0.917,0.75,1.0,0.107,0.057,0.155
-Toto-2.0-22m,Seasonal Naive,0.917,0.75,1.0,0.379,0.262,0.497
-TiRex,TiRex-2,0.083,0.0,0.25,-0.076,-0.135,-0.023
-TiRex,TimesFM-3,0.25,0.0,0.5,-0.086,-0.195,-0.018
-TiRex,Toto-2.0-1B,0.167,0.0,0.417,-0.017,-0.046,0.022
-TiRex,Toto-2.0-2.5B,0.25,0.0,0.5,-0.022,-0.048,0.004
-TiRex,Toto-2.0-313m,0.417,0.167,0.667,-0.008,-0.036,0.021
-TiRex,Toto-2.0-22m,0.5,0.25,0.752,-0.002,-0.061,0.048
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,Chronos-2,0.667,0.333,0.917,0.019,-0.026,0.055
-TiRex,Stat. Ensemble,0.583,0.333,0.833,-0.007,-0.118,0.073
-TiRex,Toto-1.0,0.5,0.25,0.833,0.057,-0.011,0.131
-TiRex,FlowState,0.667,0.417,0.917,0.002,-0.132,0.081
-TiRex,TimesFM-2.5,0.833,0.667,1.0,0.029,-0.01,0.066
-TiRex,TabPFN-TS,0.75,0.5,1.0,0.019,-0.098,0.11
-TiRex,citras-fm,0.583,0.333,0.833,0.05,0.012,0.089
-TiRex,t0-beta,0.833,0.583,1.0,0.047,0.02,0.078
-TiRex,Chronos-Bolt,0.917,0.75,1.0,0.105,0.043,0.176
-TiRex,Seasonal Naive,0.917,0.75,1.0,0.378,0.252,0.503
-Chronos-2,TiRex-2,0.25,0.0,0.5,-0.096,-0.178,-0.018
-Chronos-2,TimesFM-3,0.167,0.0,0.417,-0.107,-0.237,-0.015
-Chronos-2,Toto-2.0-1B,0.25,0.0,0.5,-0.037,-0.085,0.015
-Chronos-2,Toto-2.0-2.5B,0.333,0.083,0.583,-0.042,-0.082,-0.0
-Chronos-2,Toto-2.0-313m,0.417,0.167,0.667,-0.028,-0.07,0.018
-Chronos-2,Toto-2.0-22m,0.25,0.0,0.5,-0.022,-0.1,0.052
-Chronos-2,TiRex,0.333,0.083,0.667,-0.019,-0.059,0.025
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Stat. Ensemble,0.667,0.417,0.917,-0.026,-0.142,0.05
-Chronos-2,Toto-1.0,0.5,0.25,0.833,0.039,-0.047,0.129
-Chronos-2,FlowState,0.583,0.333,0.833,-0.017,-0.169,0.081
-Chronos-2,TimesFM-2.5,0.5,0.167,0.75,0.01,-0.025,0.05
-Chronos-2,TabPFN-TS,0.667,0.417,0.917,0.0,-0.134,0.102
-Chronos-2,citras-fm,0.583,0.333,0.833,0.032,-0.004,0.065
-Chronos-2,t0-beta,0.667,0.417,0.917,0.029,-0.024,0.092
-Chronos-2,Chronos-Bolt,0.75,0.5,1.0,0.087,0.014,0.175
-Chronos-2,Seasonal Naive,0.917,0.75,1.0,0.366,0.237,0.489
-Stat. Ensemble,TiRex-2,0.167,0.0,0.417,-0.068,-0.163,0.008
-Stat. Ensemble,TimesFM-3,0.25,0.0,0.5,-0.079,-0.121,-0.037
-Stat. Ensemble,Toto-2.0-1B,0.25,0.0,0.5,-0.01,-0.119,0.121
-Stat. Ensemble,Toto-2.0-2.5B,0.25,0.0,0.5,-0.015,-0.116,0.103
-Stat. Ensemble,Toto-2.0-313m,0.25,0.0,0.5,-0.001,-0.1,0.116
-Stat. Ensemble,Toto-2.0-22m,0.417,0.167,0.667,0.004,-0.071,0.077
-Stat. Ensemble,TiRex,0.417,0.167,0.667,0.007,-0.079,0.105
-Stat. Ensemble,Chronos-2,0.333,0.083,0.583,0.026,-0.052,0.124
-Stat. Ensemble,Stat. Ensemble,0.5,0.5,0.5,0.0,0.0,0.0
-Stat. Ensemble,Toto-1.0,0.583,0.25,0.833,0.064,-0.025,0.153
-Stat. Ensemble,FlowState,0.667,0.417,0.917,0.009,-0.049,0.064
-Stat. Ensemble,TimesFM-2.5,0.5,0.25,0.75,0.036,-0.044,0.138
-Stat. Ensemble,TabPFN-TS,0.583,0.333,0.833,0.026,-0.033,0.082
-Stat. Ensemble,citras-fm,0.417,0.167,0.667,0.056,-0.041,0.172
-Stat. Ensemble,t0-beta,0.5,0.25,0.75,0.054,-0.039,0.157
-Stat. Ensemble,Chronos-Bolt,0.75,0.5,1.0,0.111,0.016,0.202
-Stat. Ensemble,Seasonal Naive,1.0,1.0,1.0,0.382,0.284,0.478
-Toto-1.0,TiRex-2,0.083,0.0,0.25,-0.141,-0.249,-0.045
-Toto-1.0,TimesFM-3,0.167,0.0,0.417,-0.152,-0.266,-0.054
-Toto-1.0,Toto-2.0-1B,0.333,0.083,0.583,-0.079,-0.187,0.013
-Toto-1.0,Toto-2.0-2.5B,0.333,0.083,0.583,-0.084,-0.196,0.001
-Toto-1.0,Toto-2.0-313m,0.333,0.083,0.583,-0.069,-0.173,0.011
-Toto-1.0,Toto-2.0-22m,0.25,0.0,0.5,-0.063,-0.136,0.005
-Toto-1.0,TiRex,0.5,0.167,0.75,-0.061,-0.151,0.011
-Toto-1.0,Chronos-2,0.5,0.167,0.75,-0.041,-0.149,0.045
-Toto-1.0,Stat. Ensemble,0.417,0.167,0.75,-0.068,-0.181,0.024
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,FlowState,0.5,0.25,0.75,-0.059,-0.205,0.059
-Toto-1.0,TimesFM-2.5,0.583,0.333,0.833,-0.03,-0.139,0.05
-Toto-1.0,TabPFN-TS,0.583,0.333,0.833,-0.04,-0.192,0.084
-Toto-1.0,citras-fm,0.5,0.167,0.75,-0.008,-0.106,0.078
-Toto-1.0,t0-beta,0.5,0.167,0.75,-0.01,-0.086,0.055
-Toto-1.0,Chronos-Bolt,0.75,0.542,0.958,0.05,0.006,0.093
-Toto-1.0,Seasonal Naive,0.917,0.75,1.0,0.34,0.203,0.463
-FlowState,TiRex-2,0.083,0.0,0.25,-0.078,-0.144,0.004
-FlowState,TimesFM-3,0.333,0.083,0.583,-0.088,-0.148,-0.032
-FlowState,Toto-2.0-1B,0.25,0.0,0.5,-0.019,-0.129,0.132
-FlowState,Toto-2.0-2.5B,0.25,0.0,0.5,-0.024,-0.13,0.115
-FlowState,Toto-2.0-313m,0.25,0.0,0.5,-0.01,-0.119,0.124
-FlowState,Toto-2.0-22m,0.333,0.083,0.583,-0.004,-0.087,0.077
-FlowState,TiRex,0.333,0.083,0.583,-0.002,-0.088,0.117
-FlowState,Chronos-2,0.417,0.167,0.667,0.017,-0.088,0.144
-FlowState,Stat. Ensemble,0.333,0.083,0.583,-0.009,-0.068,0.047
-FlowState,Toto-1.0,0.5,0.25,0.75,0.056,-0.062,0.17
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TimesFM-2.5,0.583,0.333,0.833,0.027,-0.064,0.149
-FlowState,TabPFN-TS,0.667,0.417,0.917,0.018,-0.056,0.079
-FlowState,citras-fm,0.417,0.167,0.667,0.048,-0.056,0.183
-FlowState,t0-beta,0.5,0.25,0.75,0.046,-0.055,0.164
-FlowState,Chronos-Bolt,0.583,0.332,0.833,0.103,-0.011,0.214
-FlowState,Seasonal Naive,0.917,0.75,1.0,0.376,0.258,0.488
-TimesFM-2.5,TiRex-2,0.083,0.0,0.25,-0.108,-0.182,-0.045
-TimesFM-2.5,TimesFM-3,0.083,0.0,0.25,-0.119,-0.247,-0.038
-TimesFM-2.5,Toto-2.0-1B,0.25,0.083,0.5,-0.048,-0.103,0.002
-TimesFM-2.5,Toto-2.0-2.5B,0.25,0.083,0.5,-0.053,-0.103,-0.012
-TimesFM-2.5,Toto-2.0-313m,0.333,0.083,0.583,-0.038,-0.085,0.004
-TimesFM-2.5,Toto-2.0-22m,0.333,0.083,0.583,-0.032,-0.118,0.044
-TimesFM-2.5,TiRex,0.167,0.0,0.333,-0.03,-0.071,0.01
-TimesFM-2.5,Chronos-2,0.5,0.25,0.833,-0.011,-0.052,0.025
-TimesFM-2.5,Stat. Ensemble,0.5,0.25,0.75,-0.037,-0.161,0.042
-TimesFM-2.5,Toto-1.0,0.417,0.167,0.667,0.029,-0.053,0.122
-TimesFM-2.5,FlowState,0.417,0.167,0.667,-0.028,-0.174,0.06
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,TabPFN-TS,0.5,0.25,0.75,-0.01,-0.144,0.086
-TimesFM-2.5,citras-fm,0.667,0.417,0.917,0.021,-0.032,0.058
-TimesFM-2.5,t0-beta,0.5,0.25,0.75,0.019,-0.042,0.081
-TimesFM-2.5,Chronos-Bolt,0.667,0.417,0.875,0.078,0.002,0.167
-TimesFM-2.5,Seasonal Naive,0.917,0.75,1.0,0.359,0.235,0.479
-TabPFN-TS,TiRex-2,0.25,0.0,0.5,-0.097,-0.209,-0.001
-TabPFN-TS,TimesFM-3,0.167,0.0,0.417,-0.108,-0.188,-0.043
-TabPFN-TS,Toto-2.0-1B,0.25,0.0,0.5,-0.037,-0.158,0.101
-TabPFN-TS,Toto-2.0-2.5B,0.25,0.0,0.5,-0.042,-0.151,0.082
-TabPFN-TS,Toto-2.0-313m,0.25,0.0,0.5,-0.028,-0.142,0.097
-TabPFN-TS,Toto-2.0-22m,0.417,0.167,0.667,-0.022,-0.126,0.069
-TabPFN-TS,TiRex,0.25,0.0,0.5,-0.02,-0.124,0.089
-TabPFN-TS,Chronos-2,0.333,0.083,0.583,-0.0,-0.113,0.119
-TabPFN-TS,Stat. Ensemble,0.417,0.167,0.667,-0.027,-0.089,0.032
-TabPFN-TS,Toto-1.0,0.417,0.167,0.667,0.039,-0.092,0.161
-TabPFN-TS,FlowState,0.333,0.083,0.583,-0.018,-0.086,0.053
-TabPFN-TS,TimesFM-2.5,0.5,0.25,0.75,0.01,-0.095,0.126
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,citras-fm,0.5,0.25,0.75,0.031,-0.101,0.16
-TabPFN-TS,t0-beta,0.5,0.25,0.75,0.029,-0.082,0.14
-TabPFN-TS,Chronos-Bolt,0.583,0.331,0.833,0.087,-0.047,0.2
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.365,0.273,0.457
-citras-fm,TiRex-2,0.083,0.0,0.25,-0.132,-0.229,-0.056
-citras-fm,TimesFM-3,0.083,0.0,0.25,-0.143,-0.3,-0.046
-citras-fm,Toto-2.0-1B,0.083,0.0,0.25,-0.071,-0.115,-0.033
-citras-fm,Toto-2.0-2.5B,0.167,0.0,0.417,-0.076,-0.119,-0.036
-citras-fm,Toto-2.0-313m,0.167,0.0,0.417,-0.061,-0.108,-0.014
-citras-fm,Toto-2.0-22m,0.25,0.0,0.5,-0.055,-0.15,0.017
-citras-fm,TiRex,0.417,0.167,0.667,-0.053,-0.098,-0.012
-citras-fm,Chronos-2,0.417,0.167,0.667,-0.033,-0.069,0.003
-citras-fm,Stat. Ensemble,0.583,0.333,0.833,-0.06,-0.208,0.04
-citras-fm,Toto-1.0,0.5,0.25,0.833,0.008,-0.085,0.096
-citras-fm,FlowState,0.583,0.333,0.833,-0.051,-0.224,0.053
-citras-fm,TimesFM-2.5,0.333,0.083,0.583,-0.022,-0.062,0.031
-citras-fm,TabPFN-TS,0.5,0.25,0.75,-0.032,-0.191,0.092
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,t0-beta,0.5,0.25,0.75,-0.003,-0.06,0.052
-citras-fm,Chronos-Bolt,0.667,0.417,0.917,0.058,-0.021,0.147
-citras-fm,Seasonal Naive,0.917,0.75,1.0,0.345,0.198,0.487
-t0-beta,TiRex-2,0.083,0.0,0.25,-0.129,-0.219,-0.052
-t0-beta,TimesFM-3,0.167,0.0,0.417,-0.14,-0.265,-0.057
-t0-beta,Toto-2.0-1B,0.083,0.0,0.25,-0.068,-0.108,-0.024
-t0-beta,Toto-2.0-2.5B,0.083,0.0,0.25,-0.073,-0.115,-0.04
-t0-beta,Toto-2.0-313m,0.167,0.0,0.417,-0.058,-0.092,-0.03
-t0-beta,Toto-2.0-22m,0.167,0.0,0.417,-0.052,-0.112,-0.011
-t0-beta,TiRex,0.167,0.0,0.417,-0.05,-0.085,-0.02
-t0-beta,Chronos-2,0.333,0.083,0.583,-0.03,-0.102,0.024
-t0-beta,Stat. Ensemble,0.5,0.25,0.75,-0.057,-0.186,0.038
-t0-beta,Toto-1.0,0.5,0.25,0.833,0.01,-0.059,0.079
-t0-beta,FlowState,0.5,0.25,0.75,-0.048,-0.196,0.052
-t0-beta,TimesFM-2.5,0.5,0.25,0.75,-0.019,-0.088,0.041
-t0-beta,TabPFN-TS,0.5,0.25,0.75,-0.03,-0.163,0.076
-t0-beta,citras-fm,0.5,0.25,0.75,0.003,-0.054,0.057
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Chronos-Bolt,0.667,0.417,0.917,0.06,0.007,0.113
-t0-beta,Seasonal Naive,0.833,0.583,1.0,0.347,0.213,0.475
-Chronos-Bolt,TiRex-2,0.0,0.0,0.0,-0.201,-0.34,-0.098
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.213,-0.341,-0.106
-Chronos-Bolt,Toto-2.0-1B,0.167,0.0,0.417,-0.136,-0.246,-0.047
-Chronos-Bolt,Toto-2.0-2.5B,0.167,0.0,0.417,-0.142,-0.249,-0.058
-Chronos-Bolt,Toto-2.0-313m,0.167,0.0,0.417,-0.126,-0.218,-0.055
-Chronos-Bolt,Toto-2.0-22m,0.083,0.0,0.25,-0.12,-0.184,-0.061
-Chronos-Bolt,TiRex,0.083,0.0,0.25,-0.117,-0.213,-0.045
-Chronos-Bolt,Chronos-2,0.25,0.0,0.5,-0.096,-0.213,-0.014
-Chronos-Bolt,Stat. Ensemble,0.25,0.0,0.5,-0.125,-0.253,-0.016
-Chronos-Bolt,Toto-1.0,0.25,0.042,0.458,-0.053,-0.102,-0.006
-Chronos-Bolt,FlowState,0.417,0.167,0.668,-0.115,-0.272,0.01
-Chronos-Bolt,TimesFM-2.5,0.333,0.125,0.583,-0.084,-0.2,-0.002
-Chronos-Bolt,TabPFN-TS,0.417,0.167,0.669,-0.095,-0.249,0.045
-Chronos-Bolt,citras-fm,0.333,0.083,0.583,-0.061,-0.173,0.021
-Chronos-Bolt,t0-beta,0.333,0.083,0.583,-0.064,-0.128,-0.007
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.833,0.583,1.0,0.305,0.17,0.432
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.728,-1.165,-0.439
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.745,-1.104,-0.486
-Seasonal Naive,Toto-2.0-1B,0.083,0.0,0.25,-0.634,-1.063,-0.329
-Seasonal Naive,Toto-2.0-2.5B,0.083,0.0,0.25,-0.642,-1.045,-0.352
-Seasonal Naive,Toto-2.0-313m,0.083,0.0,0.25,-0.62,-1.022,-0.337
-Seasonal Naive,Toto-2.0-22m,0.083,0.0,0.25,-0.61,-0.988,-0.356
-Seasonal Naive,TiRex,0.083,0.0,0.25,-0.607,-1.014,-0.337
-Seasonal Naive,Chronos-2,0.083,0.0,0.25,-0.576,-0.957,-0.311
-Seasonal Naive,Stat. Ensemble,0.0,0.0,0.0,-0.618,-0.915,-0.396
-Seasonal Naive,Toto-1.0,0.083,0.0,0.25,-0.515,-0.863,-0.255
-Seasonal Naive,FlowState,0.083,0.0,0.25,-0.604,-0.954,-0.348
-Seasonal Naive,TimesFM-2.5,0.083,0.0,0.25,-0.56,-0.92,-0.308
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.576,-0.842,-0.375
-Seasonal Naive,citras-fm,0.083,0.0,0.25,-0.526,-0.95,-0.247
-Seasonal Naive,t0-beta,0.167,0.0,0.417,-0.53,-0.906,-0.271
-Seasonal Naive,Chronos-Bolt,0.167,0.0,0.417,-0.438,-0.76,-0.205
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_econ/pairwise_WQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-3,0.417,0.167,0.667,-0.006,-0.073,0.064
-TiRex-2,Toto-2.0-1B,0.667,0.333,0.917,0.055,-0.019,0.139
-TiRex-2,Toto-2.0-2.5B,0.583,0.25,0.833,0.048,-0.025,0.117
-TiRex-2,Toto-2.0-313m,0.833,0.583,1.0,0.06,-0.008,0.128
-TiRex-2,TiRex,0.917,0.75,1.0,0.06,0.02,0.102
-TiRex-2,Toto-2.0-22m,0.75,0.5,0.917,0.056,-0.002,0.12
-TiRex-2,Chronos-2,0.833,0.583,1.0,0.078,0.01,0.141
-TiRex-2,citras-fm,0.917,0.75,1.0,0.106,0.043,0.178
-TiRex-2,Toto-1.0,0.917,0.75,1.0,0.12,0.047,0.19
-TiRex-2,FlowState,0.917,0.75,1.0,0.078,-0.002,0.138
-TiRex-2,TabPFN-TS,0.667,0.417,0.917,0.089,0.016,0.164
-TiRex-2,t0-beta,0.833,0.583,1.0,0.099,0.03,0.172
-TiRex-2,TimesFM-2.5,0.917,0.75,1.0,0.103,0.049,0.166
-TiRex-2,Toto-2.0-4m,0.917,0.75,1.0,0.116,0.049,0.192
-TiRex-2,Chronos-Bolt,1.0,1.0,1.0,0.155,0.081,0.238
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.455,0.337,0.57
-TimesFM-3,TiRex-2,0.583,0.333,0.833,0.006,-0.068,0.068
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Toto-2.0-1B,0.5,0.25,0.75,0.061,-0.012,0.171
-TimesFM-3,Toto-2.0-2.5B,0.5,0.25,0.75,0.053,-0.014,0.146
-TimesFM-3,Toto-2.0-313m,0.75,0.5,1.0,0.065,0.006,0.151
-TimesFM-3,TiRex,0.667,0.417,0.917,0.065,0.002,0.142
-TimesFM-3,Toto-2.0-22m,0.833,0.583,1.0,0.061,0.015,0.106
-TimesFM-3,Chronos-2,0.75,0.5,1.0,0.083,0.008,0.169
-TimesFM-3,citras-fm,0.75,0.5,1.0,0.112,0.027,0.218
-TimesFM-3,Toto-1.0,0.75,0.5,0.919,0.125,0.05,0.202
-TimesFM-3,FlowState,0.667,0.417,0.917,0.084,0.03,0.133
-TimesFM-3,TabPFN-TS,0.833,0.583,1.0,0.094,0.039,0.146
-TimesFM-3,t0-beta,0.833,0.583,1.0,0.105,0.041,0.183
-TimesFM-3,TimesFM-2.5,0.833,0.583,1.0,0.108,0.039,0.202
-TimesFM-3,Toto-2.0-4m,0.917,0.75,1.0,0.121,0.07,0.171
-TimesFM-3,Chronos-Bolt,0.917,0.75,1.0,0.16,0.088,0.23
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.458,0.347,0.56
-Toto-2.0-1B,TiRex-2,0.333,0.083,0.667,-0.059,-0.161,0.019
-Toto-2.0-1B,TimesFM-3,0.5,0.25,0.75,-0.065,-0.207,0.012
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-2.5B,0.333,0.083,0.583,-0.008,-0.037,0.017
-Toto-2.0-1B,Toto-2.0-313m,0.833,0.583,1.0,0.005,-0.033,0.035
-Toto-2.0-1B,TiRex,0.667,0.417,0.917,0.004,-0.047,0.042
-Toto-2.0-1B,Toto-2.0-22m,0.833,0.583,1.0,0.001,-0.102,0.066
-Toto-2.0-1B,Chronos-2,0.75,0.5,1.0,0.024,-0.03,0.068
-Toto-2.0-1B,citras-fm,0.917,0.75,1.0,0.054,0.018,0.088
-Toto-2.0-1B,Toto-1.0,0.75,0.5,1.0,0.069,-0.007,0.141
-Toto-2.0-1B,FlowState,0.833,0.583,1.0,0.024,-0.148,0.118
-Toto-2.0-1B,TabPFN-TS,0.833,0.583,1.0,0.036,-0.093,0.128
-Toto-2.0-1B,t0-beta,0.833,0.583,1.0,0.047,-0.004,0.089
-Toto-2.0-1B,TimesFM-2.5,0.75,0.5,0.917,0.051,0.008,0.092
-Toto-2.0-1B,Toto-2.0-4m,0.833,0.583,1.0,0.065,-0.05,0.147
-Toto-2.0-1B,Chronos-Bolt,0.917,0.75,1.0,0.106,0.031,0.179
-Toto-2.0-1B,Seasonal Naive,0.917,0.75,1.0,0.424,0.268,0.551
-Toto-2.0-2.5B,TiRex-2,0.417,0.167,0.75,-0.05,-0.132,0.024
-Toto-2.0-2.5B,TimesFM-3,0.5,0.25,0.75,-0.056,-0.171,0.014
-Toto-2.0-2.5B,Toto-2.0-1B,0.667,0.417,0.917,0.008,-0.017,0.035
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.667,0.417,0.917,0.012,-0.006,0.031
-Toto-2.0-2.5B,TiRex,0.5,0.25,0.752,0.012,-0.023,0.05
-Toto-2.0-2.5B,Toto-2.0-22m,0.667,0.417,0.917,0.008,-0.067,0.071
-Toto-2.0-2.5B,Chronos-2,0.667,0.417,0.917,0.031,-0.005,0.066
-Toto-2.0-2.5B,citras-fm,0.75,0.5,1.0,0.062,0.019,0.101
-Toto-2.0-2.5B,Toto-1.0,0.75,0.5,1.0,0.076,0.004,0.152
-Toto-2.0-2.5B,FlowState,0.75,0.5,1.0,0.032,-0.113,0.118
-Toto-2.0-2.5B,TabPFN-TS,0.75,0.5,1.0,0.043,-0.062,0.119
-Toto-2.0-2.5B,t0-beta,0.75,0.5,1.0,0.054,0.023,0.092
-Toto-2.0-2.5B,TimesFM-2.5,0.75,0.5,1.0,0.058,0.023,0.098
-Toto-2.0-2.5B,Toto-2.0-4m,0.833,0.583,1.0,0.072,-0.015,0.154
-Toto-2.0-2.5B,Chronos-Bolt,0.833,0.583,1.0,0.113,0.048,0.183
-Toto-2.0-2.5B,Seasonal Naive,0.917,0.75,1.0,0.428,0.293,0.546
-Toto-2.0-313m,TiRex-2,0.167,0.0,0.417,-0.063,-0.147,0.008
-Toto-2.0-313m,TimesFM-3,0.25,0.0,0.5,-0.069,-0.177,-0.006
-Toto-2.0-313m,Toto-2.0-1B,0.167,0.0,0.417,-0.005,-0.036,0.032
-Toto-2.0-313m,Toto-2.0-2.5B,0.333,0.083,0.583,-0.013,-0.032,0.006
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TiRex,0.667,0.417,0.917,-0.0,-0.036,0.031
-Toto-2.0-313m,Toto-2.0-22m,0.75,0.5,1.0,-0.004,-0.07,0.045
-Toto-2.0-313m,Chronos-2,0.583,0.333,0.833,0.019,-0.026,0.058
-Toto-2.0-313m,citras-fm,0.75,0.5,1.0,0.05,0.004,0.092
-Toto-2.0-313m,Toto-1.0,0.75,0.5,1.0,0.064,0.003,0.132
-Toto-2.0-313m,FlowState,0.75,0.5,1.0,0.02,-0.121,0.107
-Toto-2.0-313m,TabPFN-TS,0.667,0.417,0.917,0.032,-0.07,0.111
-Toto-2.0-313m,t0-beta,0.667,0.417,0.917,0.042,0.019,0.07
-Toto-2.0-313m,TimesFM-2.5,0.75,0.5,1.0,0.046,0.006,0.086
-Toto-2.0-313m,Toto-2.0-4m,0.833,0.583,1.0,0.06,-0.02,0.135
-Toto-2.0-313m,Chronos-Bolt,0.833,0.583,1.0,0.102,0.048,0.161
-Toto-2.0-313m,Seasonal Naive,0.917,0.75,1.0,0.421,0.285,0.539
-TiRex,TiRex-2,0.083,0.0,0.25,-0.063,-0.114,-0.021
-TiRex,TimesFM-3,0.333,0.083,0.583,-0.069,-0.165,-0.002
-TiRex,Toto-2.0-1B,0.333,0.083,0.583,-0.005,-0.044,0.045
-TiRex,Toto-2.0-2.5B,0.5,0.248,0.75,-0.012,-0.052,0.022
-TiRex,Toto-2.0-313m,0.333,0.083,0.583,0.0,-0.031,0.034
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,Toto-2.0-22m,0.417,0.167,0.667,-0.004,-0.057,0.046
-TiRex,Chronos-2,0.583,0.333,0.833,0.019,-0.029,0.058
-TiRex,citras-fm,0.667,0.417,0.917,0.05,0.008,0.096
-TiRex,Toto-1.0,0.667,0.333,0.917,0.064,0.009,0.124
-TiRex,FlowState,0.75,0.5,1.0,0.02,-0.099,0.09
-TiRex,TabPFN-TS,0.75,0.5,1.0,0.032,-0.059,0.112
-TiRex,t0-beta,0.833,0.583,1.0,0.042,0.006,0.084
-TiRex,TimesFM-2.5,0.833,0.667,1.0,0.047,0.005,0.084
-TiRex,Toto-2.0-4m,0.75,0.5,1.0,0.06,-0.009,0.128
-TiRex,Chronos-Bolt,0.917,0.75,1.0,0.102,0.047,0.167
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.421,0.287,0.546
-Toto-2.0-22m,TiRex-2,0.25,0.083,0.5,-0.059,-0.136,0.002
-Toto-2.0-22m,TimesFM-3,0.167,0.0,0.417,-0.065,-0.118,-0.015
-Toto-2.0-22m,Toto-2.0-1B,0.167,0.0,0.417,-0.001,-0.071,0.093
-Toto-2.0-22m,Toto-2.0-2.5B,0.333,0.083,0.583,-0.008,-0.076,0.063
-Toto-2.0-22m,Toto-2.0-313m,0.25,0.0,0.5,0.004,-0.047,0.066
-Toto-2.0-22m,TiRex,0.583,0.333,0.833,0.004,-0.048,0.054
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Chronos-2,0.75,0.5,1.0,0.023,-0.054,0.089
-Toto-2.0-22m,citras-fm,0.75,0.5,1.0,0.054,-0.017,0.137
-Toto-2.0-22m,Toto-1.0,0.833,0.583,1.0,0.068,0.015,0.122
-Toto-2.0-22m,FlowState,0.583,0.333,0.833,0.024,-0.06,0.092
-Toto-2.0-22m,TabPFN-TS,0.583,0.333,0.833,0.035,-0.049,0.113
-Toto-2.0-22m,t0-beta,0.917,0.75,1.0,0.046,0.011,0.091
-Toto-2.0-22m,TimesFM-2.5,0.75,0.5,1.0,0.05,-0.027,0.127
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.064,0.041,0.091
-Toto-2.0-22m,Chronos-Bolt,0.917,0.75,1.0,0.105,0.063,0.147
-Toto-2.0-22m,Seasonal Naive,0.917,0.75,1.0,0.423,0.3,0.539
-Chronos-2,TiRex-2,0.167,0.0,0.417,-0.084,-0.164,-0.01
-Chronos-2,TimesFM-3,0.25,0.0,0.5,-0.09,-0.203,-0.008
-Chronos-2,Toto-2.0-1B,0.25,0.0,0.5,-0.024,-0.072,0.029
-Chronos-2,Toto-2.0-2.5B,0.333,0.083,0.583,-0.032,-0.07,0.005
-Chronos-2,Toto-2.0-313m,0.417,0.167,0.667,-0.019,-0.061,0.025
-Chronos-2,TiRex,0.417,0.167,0.667,-0.02,-0.062,0.028
-Chronos-2,Toto-2.0-22m,0.25,0.0,0.5,-0.024,-0.098,0.052
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,citras-fm,0.5,0.248,0.75,0.031,-0.013,0.075
-Chronos-2,Toto-1.0,0.5,0.25,0.833,0.046,-0.028,0.132
-Chronos-2,FlowState,0.583,0.333,0.833,0.001,-0.142,0.096
-Chronos-2,TabPFN-TS,0.667,0.417,0.917,0.013,-0.089,0.095
-Chronos-2,t0-beta,0.5,0.167,0.833,0.024,-0.03,0.088
-Chronos-2,TimesFM-2.5,0.667,0.333,0.917,0.028,-0.008,0.061
-Chronos-2,Toto-2.0-4m,0.667,0.415,0.917,0.042,-0.047,0.135
-Chronos-2,Chronos-Bolt,0.667,0.417,0.917,0.084,0.014,0.167
-Chronos-2,Seasonal Naive,0.917,0.75,1.0,0.41,0.281,0.527
-citras-fm,TiRex-2,0.083,0.0,0.25,-0.119,-0.217,-0.044
-citras-fm,TimesFM-3,0.25,0.0,0.5,-0.126,-0.279,-0.028
-citras-fm,Toto-2.0-1B,0.083,0.0,0.25,-0.057,-0.096,-0.018
-citras-fm,Toto-2.0-2.5B,0.25,0.0,0.5,-0.066,-0.112,-0.019
-citras-fm,Toto-2.0-313m,0.25,0.0,0.5,-0.052,-0.102,-0.004
-citras-fm,TiRex,0.333,0.083,0.583,-0.053,-0.107,-0.008
-citras-fm,Toto-2.0-22m,0.25,0.0,0.5,-0.057,-0.159,0.017
-citras-fm,Chronos-2,0.5,0.25,0.752,-0.032,-0.081,0.013
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,Toto-1.0,0.583,0.25,0.833,0.015,-0.06,0.087
-citras-fm,FlowState,0.667,0.417,0.917,-0.031,-0.207,0.066
-citras-fm,TabPFN-TS,0.5,0.25,0.75,-0.019,-0.156,0.092
-citras-fm,t0-beta,0.583,0.333,0.833,-0.008,-0.072,0.05
-citras-fm,TimesFM-2.5,0.417,0.167,0.667,-0.004,-0.039,0.044
-citras-fm,Toto-2.0-4m,0.667,0.417,0.917,0.011,-0.103,0.102
-citras-fm,Chronos-Bolt,0.667,0.417,0.917,0.055,-0.02,0.134
-citras-fm,Seasonal Naive,0.917,0.75,1.0,0.39,0.236,0.523
-Toto-1.0,TiRex-2,0.083,0.0,0.25,-0.137,-0.234,-0.049
-Toto-1.0,TimesFM-3,0.25,0.081,0.5,-0.143,-0.253,-0.052
-Toto-1.0,Toto-2.0-1B,0.25,0.0,0.5,-0.074,-0.164,0.007
-Toto-1.0,Toto-2.0-2.5B,0.25,0.0,0.5,-0.082,-0.179,-0.004
-Toto-1.0,Toto-2.0-313m,0.25,0.0,0.5,-0.069,-0.151,-0.003
-Toto-1.0,TiRex,0.333,0.083,0.667,-0.069,-0.142,-0.009
-Toto-1.0,Toto-2.0-22m,0.167,0.0,0.417,-0.073,-0.139,-0.015
-Toto-1.0,Chronos-2,0.5,0.167,0.75,-0.048,-0.153,0.028
-Toto-1.0,citras-fm,0.417,0.167,0.75,-0.016,-0.096,0.057
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,FlowState,0.417,0.167,0.668,-0.047,-0.184,0.06
-Toto-1.0,TabPFN-TS,0.583,0.333,0.833,-0.035,-0.158,0.074
-Toto-1.0,t0-beta,0.583,0.333,0.833,-0.024,-0.087,0.032
-Toto-1.0,TimesFM-2.5,0.583,0.333,0.833,-0.019,-0.113,0.05
-Toto-1.0,Toto-2.0-4m,0.583,0.333,0.833,-0.004,-0.072,0.047
-Toto-1.0,Chronos-Bolt,0.833,0.667,1.0,0.04,0.003,0.076
-Toto-1.0,Seasonal Naive,0.833,0.583,1.0,0.381,0.237,0.506
-FlowState,TiRex-2,0.083,0.0,0.25,-0.085,-0.16,0.002
-FlowState,TimesFM-3,0.333,0.083,0.583,-0.091,-0.154,-0.031
-FlowState,Toto-2.0-1B,0.167,0.0,0.417,-0.025,-0.134,0.129
-FlowState,Toto-2.0-2.5B,0.25,0.0,0.5,-0.033,-0.134,0.102
-FlowState,Toto-2.0-313m,0.25,0.0,0.5,-0.02,-0.119,0.108
-FlowState,TiRex,0.25,0.0,0.5,-0.02,-0.099,0.09
-FlowState,Toto-2.0-22m,0.417,0.167,0.667,-0.025,-0.101,0.057
-FlowState,Chronos-2,0.417,0.167,0.667,-0.001,-0.106,0.124
-FlowState,citras-fm,0.333,0.083,0.583,0.03,-0.07,0.171
-FlowState,Toto-1.0,0.583,0.332,0.833,0.045,-0.064,0.156
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TabPFN-TS,0.667,0.417,0.917,0.012,-0.07,0.076
-FlowState,t0-beta,0.5,0.25,0.75,0.023,-0.071,0.138
-FlowState,TimesFM-2.5,0.583,0.333,0.833,0.027,-0.07,0.156
-FlowState,Toto-2.0-4m,0.5,0.25,0.75,0.041,-0.039,0.119
-FlowState,Chronos-Bolt,0.583,0.332,0.833,0.083,-0.022,0.187
-FlowState,Seasonal Naive,0.917,0.75,1.0,0.409,0.289,0.52
-TabPFN-TS,TiRex-2,0.333,0.083,0.583,-0.098,-0.197,-0.016
-TabPFN-TS,TimesFM-3,0.167,0.0,0.417,-0.104,-0.171,-0.041
-TabPFN-TS,Toto-2.0-1B,0.167,0.0,0.417,-0.037,-0.147,0.085
-TabPFN-TS,Toto-2.0-2.5B,0.25,0.0,0.5,-0.045,-0.135,0.059
-TabPFN-TS,Toto-2.0-313m,0.333,0.083,0.583,-0.033,-0.125,0.065
-TabPFN-TS,TiRex,0.25,0.0,0.5,-0.033,-0.126,0.056
-TabPFN-TS,Toto-2.0-22m,0.417,0.167,0.667,-0.037,-0.127,0.046
-TabPFN-TS,Chronos-2,0.333,0.083,0.583,-0.013,-0.105,0.082
-TabPFN-TS,citras-fm,0.5,0.25,0.75,0.019,-0.101,0.135
-TabPFN-TS,Toto-1.0,0.417,0.167,0.667,0.034,-0.08,0.137
-TabPFN-TS,FlowState,0.333,0.083,0.583,-0.012,-0.082,0.066
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,t0-beta,0.417,0.167,0.667,0.011,-0.086,0.106
-TabPFN-TS,TimesFM-2.5,0.5,0.25,0.75,0.015,-0.08,0.115
-TabPFN-TS,Toto-2.0-4m,0.583,0.331,0.833,0.03,-0.068,0.123
-TabPFN-TS,Chronos-Bolt,0.583,0.331,0.833,0.072,-0.043,0.173
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.402,0.302,0.502
-t0-beta,TiRex-2,0.167,0.0,0.417,-0.11,-0.207,-0.031
-t0-beta,TimesFM-3,0.167,0.0,0.417,-0.117,-0.223,-0.042
-t0-beta,Toto-2.0-1B,0.167,0.0,0.417,-0.049,-0.098,0.004
-t0-beta,Toto-2.0-2.5B,0.25,0.0,0.5,-0.057,-0.101,-0.023
-t0-beta,Toto-2.0-313m,0.333,0.083,0.583,-0.044,-0.075,-0.019
-t0-beta,TiRex,0.167,0.0,0.417,-0.044,-0.092,-0.006
-t0-beta,Toto-2.0-22m,0.083,0.0,0.25,-0.048,-0.1,-0.011
-t0-beta,Chronos-2,0.5,0.167,0.833,-0.024,-0.097,0.029
-t0-beta,citras-fm,0.417,0.167,0.667,0.008,-0.053,0.067
-t0-beta,Toto-1.0,0.417,0.167,0.667,0.023,-0.033,0.08
-t0-beta,FlowState,0.5,0.25,0.75,-0.023,-0.16,0.066
-t0-beta,TabPFN-TS,0.583,0.333,0.833,-0.011,-0.119,0.079
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,TimesFM-2.5,0.667,0.417,0.917,0.004,-0.065,0.063
-t0-beta,Toto-2.0-4m,0.583,0.333,0.833,0.019,-0.045,0.073
-t0-beta,Chronos-Bolt,0.75,0.5,1.0,0.062,0.017,0.105
-t0-beta,Seasonal Naive,0.833,0.583,1.0,0.395,0.252,0.521
-TimesFM-2.5,TiRex-2,0.083,0.0,0.25,-0.115,-0.199,-0.052
-TimesFM-2.5,TimesFM-3,0.167,0.0,0.417,-0.122,-0.252,-0.04
-TimesFM-2.5,Toto-2.0-1B,0.25,0.083,0.5,-0.054,-0.101,-0.008
-TimesFM-2.5,Toto-2.0-2.5B,0.25,0.0,0.5,-0.062,-0.108,-0.023
-TimesFM-2.5,Toto-2.0-313m,0.25,0.0,0.5,-0.049,-0.094,-0.006
-TimesFM-2.5,TiRex,0.167,0.0,0.333,-0.049,-0.092,-0.005
-TimesFM-2.5,Toto-2.0-22m,0.25,0.0,0.5,-0.053,-0.146,0.027
-TimesFM-2.5,Chronos-2,0.333,0.083,0.667,-0.029,-0.064,0.008
-TimesFM-2.5,citras-fm,0.583,0.333,0.833,0.004,-0.046,0.038
-TimesFM-2.5,Toto-1.0,0.417,0.167,0.667,0.019,-0.052,0.102
-TimesFM-2.5,FlowState,0.417,0.167,0.667,-0.028,-0.185,0.066
-TimesFM-2.5,TabPFN-TS,0.5,0.25,0.75,-0.016,-0.13,0.074
-TimesFM-2.5,t0-beta,0.333,0.083,0.583,-0.004,-0.068,0.061
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Toto-2.0-4m,0.5,0.25,0.75,0.015,-0.091,0.11
-TimesFM-2.5,Chronos-Bolt,0.583,0.333,0.833,0.058,-0.015,0.143
-TimesFM-2.5,Seasonal Naive,0.917,0.75,1.0,0.393,0.257,0.517
-Toto-2.0-4m,TiRex-2,0.083,0.0,0.25,-0.132,-0.238,-0.051
-Toto-2.0-4m,TimesFM-3,0.083,0.0,0.25,-0.138,-0.206,-0.075
-Toto-2.0-4m,Toto-2.0-1B,0.167,0.0,0.417,-0.069,-0.172,0.048
-Toto-2.0-4m,Toto-2.0-2.5B,0.167,0.0,0.417,-0.078,-0.182,0.015
-Toto-2.0-4m,Toto-2.0-313m,0.167,0.0,0.417,-0.064,-0.156,0.019
-Toto-2.0-4m,TiRex,0.25,0.0,0.5,-0.064,-0.147,0.009
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.069,-0.101,-0.043
-Toto-2.0-4m,Chronos-2,0.333,0.083,0.585,-0.044,-0.156,0.045
-Toto-2.0-4m,citras-fm,0.333,0.083,0.583,-0.011,-0.114,0.093
-Toto-2.0-4m,Toto-1.0,0.417,0.167,0.667,0.004,-0.049,0.067
-Toto-2.0-4m,FlowState,0.5,0.25,0.75,-0.043,-0.135,0.037
-Toto-2.0-4m,TabPFN-TS,0.417,0.167,0.669,-0.031,-0.14,0.063
-Toto-2.0-4m,t0-beta,0.417,0.167,0.667,-0.019,-0.079,0.043
-Toto-2.0-4m,TimesFM-2.5,0.5,0.25,0.75,-0.015,-0.124,0.083
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,Chronos-Bolt,0.75,0.5,1.0,0.044,0.007,0.091
-Toto-2.0-4m,Seasonal Naive,0.917,0.75,1.0,0.384,0.244,0.506
-Chronos-Bolt,TiRex-2,0.0,0.0,0.0,-0.184,-0.312,-0.088
-Chronos-Bolt,TimesFM-3,0.083,0.0,0.25,-0.19,-0.299,-0.096
-Chronos-Bolt,Toto-2.0-1B,0.083,0.0,0.25,-0.118,-0.219,-0.032
-Chronos-Bolt,Toto-2.0-2.5B,0.167,0.0,0.417,-0.127,-0.224,-0.051
-Chronos-Bolt,Toto-2.0-313m,0.167,0.0,0.417,-0.113,-0.192,-0.051
-Chronos-Bolt,TiRex,0.083,0.0,0.25,-0.113,-0.2,-0.049
-Chronos-Bolt,Toto-2.0-22m,0.083,0.0,0.25,-0.118,-0.172,-0.068
-Chronos-Bolt,Chronos-2,0.333,0.083,0.583,-0.092,-0.2,-0.014
-Chronos-Bolt,citras-fm,0.333,0.083,0.583,-0.058,-0.155,0.019
-Chronos-Bolt,Toto-1.0,0.167,0.0,0.333,-0.041,-0.083,-0.003
-Chronos-Bolt,FlowState,0.417,0.167,0.668,-0.091,-0.23,0.021
-Chronos-Bolt,TabPFN-TS,0.417,0.167,0.669,-0.078,-0.208,0.042
-Chronos-Bolt,t0-beta,0.25,0.0,0.5,-0.066,-0.117,-0.017
-Chronos-Bolt,TimesFM-2.5,0.417,0.167,0.667,-0.061,-0.167,0.014
-Chronos-Bolt,Toto-2.0-4m,0.25,0.0,0.5,-0.046,-0.101,-0.007
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.833,0.583,1.0,0.355,0.212,0.48
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.836,-1.325,-0.508
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.847,-1.274,-0.533
-Seasonal Naive,Toto-2.0-1B,0.083,0.0,0.25,-0.735,-1.226,-0.367
-Seasonal Naive,Toto-2.0-2.5B,0.083,0.0,0.25,-0.748,-1.202,-0.414
-Seasonal Naive,Toto-2.0-313m,0.083,0.0,0.25,-0.727,-1.169,-0.398
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.727,-1.204,-0.402
-Seasonal Naive,Toto-2.0-22m,0.083,0.0,0.25,-0.734,-1.169,-0.429
-Seasonal Naive,Chronos-2,0.083,0.0,0.25,-0.694,-1.116,-0.391
-Seasonal Naive,citras-fm,0.083,0.0,0.25,-0.641,-1.097,-0.31
-Seasonal Naive,Toto-1.0,0.167,0.0,0.417,-0.616,-1.022,-0.311
-Seasonal Naive,FlowState,0.083,0.0,0.25,-0.692,-1.082,-0.407
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.672,-1.007,-0.432
-Seasonal Naive,t0-beta,0.167,0.0,0.417,-0.654,-1.088,-0.337
-Seasonal Naive,TimesFM-2.5,0.083,0.0,0.25,-0.647,-1.071,-0.346
-Seasonal Naive,Toto-2.0-4m,0.083,0.0,0.25,-0.622,-1.024,-0.323
-Seasonal Naive,Chronos-Bolt,0.167,0.0,0.417,-0.551,-0.924,-0.269
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_energy/leaderboard_MASE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,83.49875930521092,37.89578916031996,0.0,30.871185062890923,0.0,0.0
-Chronos-2,82.25806451612904,35.398351985937104,0.0,3.4120501715909093,0.0,0.0
-t0-beta,80.27295285359803,35.73606514099753,0.0,8.57529421037312,0.0,0.0
-Toto-2.0-1B,73.20099255583126,27.64063711794009,0.0,3.1623076374715904,0.0,0.0
-Toto-2.0-2.5B,72.95285359801488,27.403361161284135,0.0,6.4650776003125,0.0,0.0
-TiRex-2,72.45657568238212,32.34547171146631,0.0,1.0366915774648078,0.0,0.0
-TabPFN-TS-3,72.33250620347394,34.00489490838103,0.0,822.0435218492969,0.0,0.0
-Toto-2.0-313m,70.71960297766749,27.247610226794162,0.0,1.5456846913541669,0.0,0.0
-citras-fm,66.87344913151365,29.70839682432842,0.0,7.748614246350674,0.0,0.0
-TS-ICL,64.51612903225806,29.724948642495818,0.0,3.3364023637841456,0.0,0.0
-TiRex,62.28287841191068,25.111125954829205,0.0,1.3324642875,0.038461538461538464,0.0
-TabPFN-TS,60.7940446650124,29.948417313219487,0.0,308.48925294219475,0.0,0.0
-Toto-2.0-22m,59.057071960297755,25.222517255488896,0.0,0.7798815821022727,0.0,0.0
-TimesFM-2.5,58.80893300248139,24.470577229456005,0.0,35.73234459616477,0.15384615384615385,0.0
-Chronos-Bolt,55.83126550868486,24.79493112223894,0.0,1.1602838375000002,0.0,0.0
-FlowState,55.08684863523573,24.74097538777954,0.0,3.7859752799626865,0.15384615384615385,0.0
-Moirai-2.0,53.349875930521094,23.276855703905884,0.0,2.549116965535714,0.3076923076923077,0.0
-Sundial-Base,50.62034739454094,25.973733886600225,0.0,8.734264116875,0.038461538461538464,0.0
-Toto-2.0-4m,50.37220843672456,21.834602126597346,0.0,0.7024468823376624,0.0,0.0
-Toto-1.0,50.0,22.17352687153604,0.0,64.32606581959577,0.15384615384615385,0.0
-TFT,44.66501240694789,24.332626654075018,7067.210990843215,5.868696277689394,0.0,0.0
-DeepAR,39.143920595533494,20.515410969632153,13498.838423148572,8.687442574285715,0.0,11.538461538461538
-PatchTST,36.72456575682382,18.853426287300014,7221.856288165601,6.349855852499999,0.0,0.0
-CatBoost,35.60794044665012,17.15191259995018,498.1807509,5.586804820681818,0.0,0.0
-LightGBM,33.00248138957816,14.854815383201469,47.29828941238095,4.303395228143939,0.0,0.0
-Stat. Ensemble,24.875930521091814,4.447406228151163,0.0,2051.548594149911,0.0,7.6923076923076925
-AutoARIMA,23.26302729528536,2.212327431466543,0.0,1885.5145473599553,0.0,7.6923076923076925
-Seasonal Naive,19.602977667493796,0.0,0.0,1.042975715,0.0,0.0
-AutoTheta,17.617866004962778,1.1815956958414753,0.0,6.6345268946875,0.0,0.0
-AutoETS,14.267990074441686,-34.97549884253801,0.0,13.387819541051137,0.0,0.0
-Naive,11.352357320099255,-44.773921203129,0.0,1.0805920684374999,0.0,0.0
-Drift,4.590570719602978,-52.29912347479908,0.0,1.081847729375,0.0,0.0

tables/domain_energy/leaderboard_SQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,86.35235732009924,45.939225989105516,0.0,30.871185062890923,0.0,0.0
-Chronos-2,83.12655086848636,43.696037899366445,0.0,3.4120501715909093,0.0,0.0
-t0-beta,82.13399503722084,43.60305342081109,0.0,8.57529421037312,0.0,0.0
-TiRex-2,76.67493796526054,40.955040522328076,0.0,1.0366915774648078,0.0,0.0
-Toto-2.0-1B,76.55086848635236,37.19233498724061,0.0,3.1623076374715904,0.0,0.0
-Toto-2.0-2.5B,75.68238213399503,36.942973998246586,0.0,6.4650776003125,0.0,0.0
-TabPFN-TS-3,74.56575682382133,42.12648526492014,0.0,822.0435218492969,0.0,0.0
-Toto-2.0-313m,73.44913151364764,36.69282240000613,0.0,1.5456846913541669,0.0,0.0
-TiRex,66.62531017369727,34.44791484004565,0.0,1.3324642875,0.038461538461538464,0.0
-TS-ICL,66.12903225806451,38.54265308034851,0.0,3.3364023637841456,0.0,0.0
-citras-fm,65.63275434243177,37.06311174153901,0.0,7.748614246350674,0.0,0.0
-TabPFN-TS,64.01985111662532,38.63838178079146,0.0,308.48925294219475,0.0,0.0
-Toto-2.0-22m,63.52357320099256,34.72199927167168,0.0,0.7798815821022727,0.0,0.0
-TimesFM-2.5,60.42183622828785,33.040194549839576,0.0,35.73234459616477,0.15384615384615385,0.0
-FlowState,55.83126550868486,32.4100685185642,0.0,3.7859752799626865,0.15384615384615385,0.0
-Chronos-Bolt,54.09429280397022,32.881689430291104,0.0,1.1602838375000002,0.0,0.0
-Toto-2.0-4m,52.60545905707197,31.473352334477845,0.0,0.7024468823376624,0.0,0.0
-Moirai-2.0,52.48138957816377,31.52282472603488,0.0,2.549116965535714,0.3076923076923077,0.0
-Toto-1.0,51.11662531017369,31.112045696230428,0.0,64.32606581959577,0.15384615384615385,0.0
-TFT,49.13151364764268,32.085719324643314,7067.210990843215,5.868696277689394,0.0,0.0
-Sundial-Base,40.446650124069485,28.52842311909273,0.0,8.734264116875,0.038461538461538464,0.0
-DeepAR,39.88833746898263,26.66949092254881,13498.838423148572,8.687442574285715,0.0,11.538461538461538
-PatchTST,39.454094292803966,25.60679591439182,7221.856288165601,6.349855852499999,0.0,0.0
-AutoARIMA,26.116625310173696,9.139931178596383,0.0,1885.5145473599553,0.0,7.6923076923076925
-Stat. Ensemble,24.25558312655087,6.196332966589502,0.0,2051.548594149911,0.0,7.6923076923076925
-CatBoost,22.8287841191067,8.874064288365757,498.1807509,5.586804820681818,0.0,0.0
-LightGBM,19.851116625310173,6.34745033907752,47.29828941238095,4.303395228143939,0.0,0.0
-Seasonal Naive,16.625310173697272,0.0,0.0,1.042975715,0.0,0.0
-AutoETS,16.129032258064516,-30.210229740669558,0.0,13.387819541051137,0.0,0.0
-AutoTheta,13.77171215880893,-10.643501874241924,0.0,6.6345268946875,0.0,0.0
-Naive,7.754342431761787,-60.57154490567112,0.0,1.0805920684374999,0.0,0.0
-Drift,2.729528535980149,-67.3016518958006,0.0,1.081847729375,0.0,0.0

tables/domain_energy/leaderboard_WAPE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,80.89330024813896,39.30237020429301,0.0,30.871185062890923,0.0,0.0
-Chronos-2,79.65260545905709,37.557901536977845,0.0,3.4120501715909093,0.0,0.0
-t0-beta,77.66749379652606,38.02726402289019,0.0,8.57529421037312,0.0,0.0
-Toto-2.0-1B,72.33250620347394,31.032868019309202,0.0,3.1623076374715904,0.0,0.0
-Toto-2.0-313m,71.96029776674938,30.705322754813878,0.0,1.5456846913541669,0.0,0.0
-Toto-2.0-2.5B,69.72704714640197,30.308651726585033,0.0,6.4650776003125,0.0,0.0
-TS-ICL,68.4863523573201,34.05152672280454,0.0,3.3364023637841456,0.0,0.0
-TiRex-2,67.86600496277916,34.43124058342566,0.0,1.0366915774648078,0.0,0.0
-TabPFN-TS-3,67.24565756823822,34.61666637481101,0.0,822.0435218492969,0.0,0.0
-citras-fm,64.39205955334988,31.682561212984318,0.0,7.748614246350674,0.0,0.0
-Toto-2.0-22m,61.662531017369716,28.863859566477203,0.0,0.7798815821022727,0.0,0.0
-TiRex,58.31265508684863,27.322662354204475,0.0,1.3324642875,0.038461538461538464,0.0
-TabPFN-TS,56.82382133995038,30.36322876478197,0.0,308.48925294219475,0.0,0.0
-TimesFM-2.5,56.203473945409435,26.65794953458317,0.0,35.73234459616477,0.15384615384615385,0.0
-Chronos-Bolt,53.349875930521094,26.606852502371968,0.0,1.1602838375000002,0.0,0.0
-Moirai-2.0,52.605459057071954,25.99988075597758,0.0,2.549116965535714,0.3076923076923077,0.0
-FlowState,50.12406947890818,26.89142712985859,0.0,3.7859752799626865,0.15384615384615385,0.0
-Sundial-Base,49.131513647642684,28.265544600882,0.0,8.734264116875,0.038461538461538464,0.0
-TFT,47.64267990074442,26.59412613673687,7067.210990843215,5.868696277689394,0.0,0.0
-Toto-1.0,47.394540942928046,24.207524581618266,0.0,64.32606581959577,0.15384615384615385,0.0
-Toto-2.0-4m,45.6575682382134,23.82250300845572,0.0,0.7024468823376624,0.0,0.0
-PatchTST,40.94292803970224,20.65325504182872,7221.856288165601,6.349855852499999,0.0,0.0
-DeepAR,38.52357320099256,21.82047445619971,13498.838423148572,8.687442574285715,0.0,11.538461538461538
-LightGBM,37.96526054590571,20.63835609604817,47.29828941238095,4.303395228143939,0.0,0.0
-CatBoost,36.22828784119106,20.174610152005823,498.1807509,5.586804820681818,0.0,0.0
-Stat. Ensemble,31.079404466501238,8.430993583997726,0.0,2051.548594149911,0.0,7.6923076923076925
-AutoARIMA,22.518610421836225,3.8316800542679386,0.0,1885.5145473599553,0.0,7.6923076923076925
-AutoETS,21.33995037220844,-24.06197476117884,0.0,13.387819541051137,0.0,0.0
-Naive,20.905707196029777,-29.595393529303713,0.0,1.0805920684374999,0.0,0.0
-AutoTheta,19.727047146401983,4.200265666572001,0.0,6.6345268946875,0.0,0.0
-Seasonal Naive,18.11414392059553,0.0,0.0,1.042975715,0.0,0.0
-Drift,13.523573200992555,-36.91555319026642,0.0,1.081847729375,0.0,0.0

tables/domain_energy/leaderboard_WQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,83.00248138957818,47.66386559962355,0.0,30.871185062890923,0.0,0.0
-Chronos-2,82.63027295285359,45.99295404026385,0.0,3.4120501715909093,0.0,0.0
-t0-beta,81.14143920595534,46.08070495651517,0.0,8.57529421037312,0.0,0.0
-Toto-2.0-1B,78.53598014888338,40.95974538328001,0.0,3.1623076374715904,0.0,0.0
-Toto-2.0-313m,76.30272952853598,40.431908864449696,0.0,1.5456846913541669,0.0,0.0
-Toto-2.0-2.5B,75.68238213399503,40.25120913531922,0.0,6.4650776003125,0.0,0.0
-TiRex-2,74.19354838709677,43.430525812131435,0.0,1.0366915774648078,0.0,0.0
-TabPFN-TS-3,71.46401985111662,43.103980194426214,0.0,822.0435218492969,0.0,0.0
-TS-ICL,70.34739454094291,43.02532257188423,0.0,3.3364023637841456,0.0,0.0
-Toto-2.0-22m,66.25310173697271,38.501099243397576,0.0,0.7798815821022727,0.0,0.0
-citras-fm,64.88833746898263,39.746283079915145,0.0,7.748614246350674,0.0,0.0
-TiRex,64.39205955334987,37.015923795326046,0.0,1.3324642875,0.038461538461538464,0.0
-TabPFN-TS,62.531017369727046,39.634990899313024,0.0,308.48925294219475,0.0,0.0
-TimesFM-2.5,58.56079404466501,35.74711028493935,0.0,35.73234459616477,0.15384615384615385,0.0
-FlowState,54.09429280397022,35.238708603025636,0.0,3.7859752799626865,0.15384615384615385,0.0
-Chronos-Bolt,53.97022332506204,35.346534587472554,0.0,1.1602838375000002,0.0,0.0
-Moirai-2.0,52.853598014888334,34.54029716114274,0.0,2.549116965535714,0.3076923076923077,0.0
-Toto-2.0-4m,50.86848635235732,33.916952411684484,0.0,0.7024468823376624,0.0,0.0
-Toto-1.0,50.24813895781638,33.68160197994784,0.0,64.32606581959577,0.15384615384615385,0.0
-TFT,49.75186104218363,34.858358688960024,7067.210990843215,5.868696277689394,0.0,0.0
-PatchTST,41.06699751861042,28.17762114987711,7221.856288165601,6.349855852499999,0.0,0.0
-Sundial-Base,40.94292803970223,31.420585268607393,0.0,8.734264116875,0.038461538461538464,0.0
-DeepAR,38.89578163771712,28.82551876839535,13498.838423148572,8.687442574285715,0.0,11.538461538461538
-LightGBM,26.550868486352353,13.804281918946282,47.29828941238095,4.303395228143939,0.0,0.0
-Stat. Ensemble,26.240694789081886,11.001763956139254,0.0,2051.548594149911,0.0,7.6923076923076925
-AutoARIMA,24.751861042183624,10.956865003323434,0.0,1885.5145473599553,0.0,7.6923076923076925
-CatBoost,23.69727047146402,13.30060154143199,498.1807509,5.586804820681818,0.0,0.0
-AutoETS,15.012406947890817,-24.269495322854407,0.0,13.387819541051137,0.0,0.0
-Seasonal Naive,14.640198511166252,0.0,0.0,1.042975715,0.0,0.0
-AutoTheta,14.1439205955335,-4.896832310667398,0.0,6.6345268946875,0.0,0.0
-Naive,8.37468982630273,-50.976730476610335,0.0,1.0805920684374999,0.0,0.0
-Drift,3.970223325062035,-57.44553171159505,0.0,1.081847729375,0.0,0.0

tables/domain_energy/pairwise_MASE.csv

@@ -1,257 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.5,0.308,0.692,0.039,-0.007,0.085
-TimesFM-3,t0-beta,0.654,0.462,0.846,0.034,-0.015,0.077
-TimesFM-3,Toto-2.0-1B,0.692,0.5,0.846,0.142,0.051,0.223
-TimesFM-3,Toto-2.0-2.5B,0.692,0.5,0.846,0.145,0.055,0.224
-TimesFM-3,TabPFN-TS-3,0.615,0.423,0.808,0.059,0.014,0.103
-TimesFM-3,TiRex-2,0.731,0.538,0.885,0.082,0.022,0.14
-TimesFM-3,Toto-2.0-313m,0.731,0.538,0.885,0.146,0.06,0.229
-TimesFM-3,citras-fm,0.769,0.615,0.923,0.116,0.052,0.18
-TimesFM-3,TS-ICL,0.769,0.614,0.923,0.116,0.066,0.162
-TimesFM-3,TiRex,0.846,0.692,0.962,0.171,0.083,0.249
-TimesFM-3,TabPFN-TS,0.731,0.538,0.885,0.113,0.052,0.174
-TimesFM-3,Toto-2.0-22m,0.769,0.615,0.923,0.169,0.083,0.246
-TimesFM-3,TimesFM-2.5,0.846,0.692,0.962,0.178,0.093,0.254
-TimesFM-3,Chronos-Bolt,0.846,0.692,0.962,0.174,0.091,0.248
-TimesFM-3,Seasonal Naive,0.962,0.885,1.0,0.379,0.294,0.455
-Chronos-2,TimesFM-3,0.5,0.308,0.692,-0.04,-0.093,0.007
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,t0-beta,0.538,0.346,0.731,-0.005,-0.031,0.018
-Chronos-2,Toto-2.0-1B,0.577,0.385,0.769,0.107,0.04,0.174
-Chronos-2,Toto-2.0-2.5B,0.654,0.462,0.808,0.11,0.043,0.177
-Chronos-2,TabPFN-TS-3,0.654,0.462,0.846,0.021,-0.014,0.058
-Chronos-2,TiRex-2,0.577,0.385,0.769,0.045,0.001,0.092
-Chronos-2,Toto-2.0-313m,0.654,0.462,0.846,0.112,0.04,0.182
-Chronos-2,citras-fm,0.731,0.538,0.885,0.081,0.038,0.119
-Chronos-2,TS-ICL,0.846,0.692,0.962,0.081,0.04,0.122
-Chronos-2,TiRex,0.769,0.615,0.923,0.137,0.066,0.203
-Chronos-2,TabPFN-TS,0.769,0.615,0.923,0.078,0.038,0.118
-Chronos-2,Toto-2.0-22m,0.885,0.769,1.0,0.136,0.072,0.201
-Chronos-2,TimesFM-2.5,0.769,0.577,0.923,0.145,0.072,0.212
-Chronos-2,Chronos-Bolt,0.962,0.885,1.0,0.141,0.078,0.202
-Chronos-2,Seasonal Naive,0.962,0.885,1.0,0.354,0.278,0.422
-t0-beta,TimesFM-3,0.346,0.154,0.538,-0.035,-0.083,0.014
-t0-beta,Chronos-2,0.462,0.269,0.654,0.005,-0.018,0.03
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-2.0-1B,0.615,0.423,0.808,0.112,0.028,0.19
-t0-beta,Toto-2.0-2.5B,0.654,0.462,0.846,0.115,0.033,0.193
-t0-beta,TabPFN-TS-3,0.654,0.462,0.846,0.026,-0.011,0.061
-t0-beta,TiRex-2,0.538,0.346,0.731,0.05,0.006,0.094
-t0-beta,Toto-2.0-313m,0.692,0.5,0.846,0.117,0.034,0.195
-t0-beta,citras-fm,0.808,0.654,0.923,0.086,0.037,0.131
-t0-beta,TS-ICL,0.846,0.692,0.962,0.086,0.039,0.131
-t0-beta,TiRex,0.731,0.538,0.885,0.142,0.062,0.217
-t0-beta,TabPFN-TS,0.731,0.538,0.885,0.083,0.037,0.125
-t0-beta,Toto-2.0-22m,0.808,0.654,0.923,0.141,0.064,0.214
-t0-beta,TimesFM-2.5,0.769,0.577,0.923,0.149,0.067,0.228
-t0-beta,Chronos-Bolt,0.808,0.654,0.962,0.145,0.072,0.217
-t0-beta,Seasonal Naive,0.962,0.885,1.0,0.357,0.273,0.431
-Toto-2.0-1B,TimesFM-3,0.308,0.154,0.5,-0.165,-0.286,-0.054
-Toto-2.0-1B,Chronos-2,0.423,0.231,0.615,-0.12,-0.211,-0.042
-Toto-2.0-1B,t0-beta,0.385,0.192,0.577,-0.126,-0.234,-0.029
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-2.5B,0.5,0.308,0.654,0.003,-0.004,0.011
-Toto-2.0-1B,TabPFN-TS-3,0.423,0.231,0.615,-0.096,-0.205,0.001
-Toto-2.0-1B,TiRex-2,0.615,0.423,0.808,-0.07,-0.162,0.004
-Toto-2.0-1B,Toto-2.0-313m,0.5,0.308,0.692,0.005,-0.008,0.019
-Toto-2.0-1B,citras-fm,0.577,0.385,0.769,-0.029,-0.097,0.024
-Toto-2.0-1B,TS-ICL,0.538,0.346,0.731,-0.03,-0.103,0.038
-Toto-2.0-1B,TiRex,0.654,0.462,0.808,0.034,0.011,0.059
-Toto-2.0-1B,TabPFN-TS,0.615,0.423,0.808,-0.033,-0.13,0.048
-Toto-2.0-1B,Toto-2.0-22m,0.846,0.692,0.962,0.032,0.02,0.046
-Toto-2.0-1B,TimesFM-2.5,0.769,0.577,0.923,0.042,0.012,0.074
-Toto-2.0-1B,Chronos-Bolt,0.846,0.692,0.962,0.038,0.007,0.066
-Toto-2.0-1B,Seasonal Naive,0.923,0.808,1.0,0.276,0.21,0.34
-Toto-2.0-2.5B,TimesFM-3,0.308,0.154,0.5,-0.169,-0.289,-0.058
-Toto-2.0-2.5B,Chronos-2,0.346,0.192,0.538,-0.124,-0.214,-0.045
-Toto-2.0-2.5B,t0-beta,0.346,0.154,0.538,-0.13,-0.239,-0.034
-Toto-2.0-2.5B,Toto-2.0-1B,0.5,0.346,0.692,-0.003,-0.011,0.004
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TabPFN-TS-3,0.462,0.269,0.654,-0.1,-0.208,-0.003
-Toto-2.0-2.5B,TiRex-2,0.5,0.308,0.692,-0.073,-0.162,-0.001
-Toto-2.0-2.5B,Toto-2.0-313m,0.615,0.423,0.808,0.002,-0.013,0.016
-Toto-2.0-2.5B,citras-fm,0.538,0.346,0.731,-0.033,-0.098,0.02
-Toto-2.0-2.5B,TS-ICL,0.577,0.385,0.769,-0.033,-0.106,0.033
-Toto-2.0-2.5B,TiRex,0.692,0.5,0.846,0.031,0.007,0.055
-Toto-2.0-2.5B,TabPFN-TS,0.654,0.462,0.846,-0.036,-0.133,0.042
-Toto-2.0-2.5B,Toto-2.0-22m,0.808,0.654,0.962,0.029,0.016,0.042
-Toto-2.0-2.5B,TimesFM-2.5,0.692,0.5,0.846,0.039,0.01,0.071
-Toto-2.0-2.5B,Chronos-Bolt,0.846,0.692,0.962,0.035,0.005,0.062
-Toto-2.0-2.5B,Seasonal Naive,0.962,0.885,1.0,0.274,0.211,0.335
-TabPFN-TS-3,TimesFM-3,0.385,0.192,0.577,-0.063,-0.114,-0.015
-TabPFN-TS-3,Chronos-2,0.346,0.154,0.538,-0.022,-0.062,0.013
-TabPFN-TS-3,t0-beta,0.346,0.154,0.538,-0.027,-0.065,0.011
-TabPFN-TS-3,Toto-2.0-1B,0.577,0.385,0.769,0.088,-0.001,0.17
-TabPFN-TS-3,Toto-2.0-2.5B,0.538,0.346,0.731,0.091,0.003,0.172
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TiRex-2,0.5,0.308,0.692,0.025,-0.029,0.08
-TabPFN-TS-3,Toto-2.0-313m,0.538,0.346,0.731,0.093,0.002,0.175
-TabPFN-TS-3,citras-fm,0.538,0.346,0.731,0.061,0.003,0.113
-TabPFN-TS-3,TS-ICL,0.654,0.462,0.808,0.061,0.009,0.116
-TabPFN-TS-3,TiRex,0.538,0.346,0.731,0.119,0.032,0.197
-TabPFN-TS-3,TabPFN-TS,0.731,0.577,0.885,0.058,0.011,0.101
-TabPFN-TS-3,Toto-2.0-22m,0.615,0.423,0.77,0.117,0.034,0.194
-TabPFN-TS-3,TimesFM-2.5,0.692,0.5,0.846,0.126,0.038,0.206
-TabPFN-TS-3,Chronos-Bolt,0.654,0.462,0.809,0.122,0.043,0.198
-TabPFN-TS-3,Seasonal Naive,0.962,0.885,1.0,0.34,0.265,0.41
-TiRex-2,TimesFM-3,0.269,0.115,0.462,-0.089,-0.163,-0.022
-TiRex-2,Chronos-2,0.423,0.231,0.615,-0.047,-0.101,-0.001
-TiRex-2,t0-beta,0.462,0.269,0.654,-0.053,-0.103,-0.006
-TiRex-2,Toto-2.0-1B,0.385,0.192,0.577,0.065,-0.004,0.139
-TiRex-2,Toto-2.0-2.5B,0.5,0.308,0.692,0.068,0.001,0.14
-TiRex-2,TabPFN-TS-3,0.5,0.308,0.692,-0.025,-0.087,0.028
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,Toto-2.0-313m,0.5,0.308,0.692,0.07,-0.001,0.147
-TiRex-2,citras-fm,0.654,0.462,0.809,0.038,-0.02,0.091
-TiRex-2,TS-ICL,0.615,0.423,0.808,0.037,-0.012,0.084
-TiRex-2,TiRex,0.769,0.615,0.923,0.097,0.031,0.165
-TiRex-2,TabPFN-TS,0.654,0.462,0.846,0.034,-0.02,0.085
-TiRex-2,Toto-2.0-22m,0.577,0.385,0.769,0.095,0.029,0.163
-TiRex-2,TimesFM-2.5,0.654,0.462,0.808,0.104,0.032,0.177
-TiRex-2,Chronos-Bolt,0.654,0.462,0.846,0.1,0.031,0.175
-TiRex-2,Seasonal Naive,0.962,0.885,1.0,0.323,0.243,0.395
-Toto-2.0-313m,TimesFM-3,0.269,0.115,0.462,-0.171,-0.297,-0.064
-Toto-2.0-313m,Chronos-2,0.346,0.154,0.538,-0.126,-0.222,-0.042
-Toto-2.0-313m,t0-beta,0.308,0.154,0.5,-0.132,-0.242,-0.035
-Toto-2.0-313m,Toto-2.0-1B,0.5,0.308,0.692,-0.005,-0.019,0.008
-Toto-2.0-313m,Toto-2.0-2.5B,0.385,0.192,0.577,-0.002,-0.016,0.013
-Toto-2.0-313m,TabPFN-TS-3,0.462,0.269,0.654,-0.102,-0.213,-0.002
-Toto-2.0-313m,TiRex-2,0.5,0.308,0.692,-0.075,-0.172,0.001
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,citras-fm,0.538,0.346,0.731,-0.035,-0.101,0.016
-Toto-2.0-313m,TS-ICL,0.577,0.385,0.769,-0.035,-0.11,0.029
-Toto-2.0-313m,TiRex,0.615,0.423,0.808,0.029,0.011,0.048
-Toto-2.0-313m,TabPFN-TS,0.654,0.462,0.846,-0.039,-0.142,0.043
-Toto-2.0-313m,Toto-2.0-22m,0.731,0.538,0.885,0.027,0.014,0.041
-Toto-2.0-313m,TimesFM-2.5,0.692,0.5,0.847,0.037,0.012,0.062
-Toto-2.0-313m,Chronos-Bolt,0.731,0.576,0.885,0.033,0.004,0.06
-Toto-2.0-313m,Seasonal Naive,0.923,0.808,1.0,0.272,0.206,0.336
-citras-fm,TimesFM-3,0.231,0.077,0.385,-0.132,-0.22,-0.055
-citras-fm,Chronos-2,0.269,0.115,0.462,-0.088,-0.135,-0.039
-citras-fm,t0-beta,0.192,0.077,0.346,-0.094,-0.151,-0.038
-citras-fm,Toto-2.0-1B,0.423,0.231,0.615,0.029,-0.025,0.088
-citras-fm,Toto-2.0-2.5B,0.462,0.269,0.654,0.032,-0.021,0.089
-citras-fm,TabPFN-TS-3,0.462,0.269,0.654,-0.065,-0.127,-0.003
-citras-fm,TiRex-2,0.346,0.191,0.538,-0.039,-0.1,0.019
-citras-fm,Toto-2.0-313m,0.462,0.269,0.654,0.034,-0.016,0.091
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,TS-ICL,0.5,0.308,0.692,-0.0,-0.048,0.048
-citras-fm,TiRex,0.538,0.346,0.731,0.061,0.015,0.112
-citras-fm,TabPFN-TS,0.5,0.308,0.692,-0.003,-0.052,0.044
-citras-fm,Toto-2.0-22m,0.615,0.423,0.769,0.06,0.015,0.113
-citras-fm,TimesFM-2.5,0.692,0.5,0.846,0.069,0.02,0.123
-citras-fm,Chronos-Bolt,0.692,0.538,0.846,0.065,0.024,0.112
-citras-fm,Seasonal Naive,0.962,0.885,1.0,0.297,0.224,0.36
-TS-ICL,TimesFM-3,0.231,0.077,0.386,-0.132,-0.193,-0.071
-TS-ICL,Chronos-2,0.154,0.038,0.308,-0.088,-0.14,-0.041
-TS-ICL,t0-beta,0.154,0.038,0.308,-0.094,-0.151,-0.041
-TS-ICL,Toto-2.0-1B,0.462,0.269,0.654,0.029,-0.039,0.094
-TS-ICL,Toto-2.0-2.5B,0.423,0.231,0.615,0.032,-0.034,0.096
-TS-ICL,TabPFN-TS-3,0.346,0.192,0.538,-0.065,-0.131,-0.009
-TS-ICL,TiRex-2,0.385,0.192,0.577,-0.039,-0.091,0.012
-TS-ICL,Toto-2.0-313m,0.423,0.231,0.615,0.034,-0.029,0.099
-TS-ICL,citras-fm,0.5,0.308,0.692,0.0,-0.051,0.046
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TiRex,0.538,0.346,0.731,0.062,-0.002,0.125
-TS-ICL,TabPFN-TS,0.615,0.423,0.808,-0.003,-0.066,0.055
-TS-ICL,Toto-2.0-22m,0.538,0.346,0.731,0.06,0.002,0.121
-TS-ICL,TimesFM-2.5,0.692,0.538,0.885,0.07,0.006,0.132
-TS-ICL,Chronos-Bolt,0.615,0.423,0.808,0.066,-0.001,0.132
-TS-ICL,Seasonal Naive,0.885,0.731,1.0,0.297,0.215,0.37
-TiRex,TimesFM-3,0.154,0.038,0.308,-0.206,-0.332,-0.091
-TiRex,Chronos-2,0.231,0.077,0.385,-0.159,-0.255,-0.07
-TiRex,t0-beta,0.269,0.115,0.462,-0.165,-0.278,-0.066
-TiRex,Toto-2.0-1B,0.346,0.192,0.538,-0.035,-0.063,-0.011
-TiRex,Toto-2.0-2.5B,0.308,0.154,0.5,-0.032,-0.059,-0.007
-TiRex,TabPFN-TS-3,0.462,0.269,0.654,-0.135,-0.246,-0.034
-TiRex,TiRex-2,0.231,0.077,0.385,-0.107,-0.198,-0.032
-TiRex,Toto-2.0-313m,0.385,0.192,0.577,-0.029,-0.051,-0.011
-TiRex,citras-fm,0.462,0.269,0.654,-0.065,-0.126,-0.015
-TiRex,TS-ICL,0.462,0.269,0.654,-0.066,-0.143,0.002
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TabPFN-TS,0.5,0.308,0.692,-0.069,-0.171,0.013
-TiRex,Toto-2.0-22m,0.577,0.385,0.769,-0.001,-0.024,0.017
-TiRex,TimesFM-2.5,0.519,0.327,0.731,0.008,-0.015,0.033
-TiRex,Chronos-Bolt,0.558,0.385,0.731,0.004,-0.021,0.032
-TiRex,Seasonal Naive,0.923,0.808,1.0,0.251,0.191,0.308
-TabPFN-TS,TimesFM-3,0.269,0.115,0.462,-0.128,-0.21,-0.055
-TabPFN-TS,Chronos-2,0.231,0.077,0.385,-0.084,-0.133,-0.039
-TabPFN-TS,t0-beta,0.269,0.115,0.462,-0.09,-0.143,-0.038
-TabPFN-TS,Toto-2.0-1B,0.385,0.192,0.577,0.032,-0.05,0.115
-TabPFN-TS,Toto-2.0-2.5B,0.346,0.154,0.538,0.035,-0.043,0.117
-TabPFN-TS,TabPFN-TS-3,0.269,0.115,0.423,-0.061,-0.112,-0.012
-TabPFN-TS,TiRex-2,0.346,0.154,0.538,-0.035,-0.093,0.02
-TabPFN-TS,Toto-2.0-313m,0.346,0.154,0.538,0.037,-0.045,0.124
-TabPFN-TS,citras-fm,0.5,0.308,0.692,0.003,-0.046,0.049
-TabPFN-TS,TS-ICL,0.385,0.192,0.577,0.003,-0.059,0.062
-TabPFN-TS,TiRex,0.5,0.308,0.692,0.065,-0.014,0.146
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,Toto-2.0-22m,0.5,0.308,0.692,0.063,-0.016,0.142
-TabPFN-TS,TimesFM-2.5,0.5,0.308,0.692,0.073,-0.003,0.152
-TabPFN-TS,Chronos-Bolt,0.538,0.346,0.731,0.069,0.002,0.143
-TabPFN-TS,Seasonal Naive,0.923,0.808,1.0,0.299,0.216,0.373
-Toto-2.0-22m,TimesFM-3,0.231,0.077,0.385,-0.204,-0.326,-0.09
-Toto-2.0-22m,Chronos-2,0.115,0.0,0.231,-0.158,-0.252,-0.077
-Toto-2.0-22m,t0-beta,0.192,0.077,0.346,-0.164,-0.272,-0.069
-Toto-2.0-22m,Toto-2.0-1B,0.154,0.038,0.308,-0.033,-0.048,-0.021
-Toto-2.0-22m,Toto-2.0-2.5B,0.192,0.038,0.346,-0.03,-0.044,-0.016
-Toto-2.0-22m,TabPFN-TS-3,0.385,0.23,0.577,-0.133,-0.241,-0.035
-Toto-2.0-22m,TiRex-2,0.423,0.231,0.615,-0.105,-0.195,-0.029
-Toto-2.0-22m,Toto-2.0-313m,0.269,0.115,0.462,-0.028,-0.043,-0.014
-Toto-2.0-22m,citras-fm,0.385,0.231,0.577,-0.064,-0.128,-0.015
-Toto-2.0-22m,TS-ICL,0.462,0.269,0.654,-0.064,-0.138,-0.002
-Toto-2.0-22m,TiRex,0.423,0.231,0.615,0.001,-0.018,0.024
-Toto-2.0-22m,TabPFN-TS,0.5,0.308,0.692,-0.067,-0.166,0.016
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TimesFM-2.5,0.538,0.346,0.731,0.01,-0.02,0.042
-Toto-2.0-22m,Chronos-Bolt,0.538,0.346,0.731,0.006,-0.025,0.036
-Toto-2.0-22m,Seasonal Naive,0.885,0.731,1.0,0.252,0.188,0.315
-TimesFM-2.5,TimesFM-3,0.154,0.038,0.308,-0.216,-0.34,-0.103
-TimesFM-2.5,Chronos-2,0.231,0.077,0.423,-0.169,-0.269,-0.077
-TimesFM-2.5,t0-beta,0.231,0.077,0.423,-0.175,-0.296,-0.072
-TimesFM-2.5,Toto-2.0-1B,0.231,0.077,0.423,-0.044,-0.08,-0.012
-TimesFM-2.5,Toto-2.0-2.5B,0.308,0.154,0.5,-0.04,-0.076,-0.01
-TimesFM-2.5,TabPFN-TS-3,0.308,0.154,0.5,-0.144,-0.259,-0.04
-TimesFM-2.5,TiRex-2,0.346,0.192,0.538,-0.116,-0.214,-0.033
-TimesFM-2.5,Toto-2.0-313m,0.308,0.153,0.5,-0.038,-0.066,-0.012
-TimesFM-2.5,citras-fm,0.308,0.154,0.5,-0.075,-0.14,-0.02
-TimesFM-2.5,TS-ICL,0.308,0.115,0.462,-0.075,-0.152,-0.006
-TimesFM-2.5,TiRex,0.481,0.269,0.673,-0.009,-0.034,0.014
-TimesFM-2.5,TabPFN-TS,0.5,0.308,0.692,-0.078,-0.179,0.003
-TimesFM-2.5,Toto-2.0-22m,0.462,0.269,0.654,-0.01,-0.044,0.02
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Chronos-Bolt,0.577,0.404,0.769,-0.004,-0.033,0.024
-TimesFM-2.5,Seasonal Naive,0.923,0.808,1.0,0.245,0.182,0.306
-Chronos-Bolt,TimesFM-3,0.154,0.038,0.308,-0.211,-0.33,-0.101
-Chronos-Bolt,Chronos-2,0.038,0.0,0.115,-0.164,-0.254,-0.085
-Chronos-Bolt,t0-beta,0.192,0.038,0.346,-0.17,-0.277,-0.078
-Chronos-Bolt,Toto-2.0-1B,0.154,0.038,0.308,-0.039,-0.071,-0.007
-Chronos-Bolt,Toto-2.0-2.5B,0.154,0.038,0.308,-0.036,-0.066,-0.005
-Chronos-Bolt,TabPFN-TS-3,0.346,0.191,0.538,-0.14,-0.248,-0.045
-Chronos-Bolt,TiRex-2,0.346,0.154,0.538,-0.112,-0.213,-0.032
-Chronos-Bolt,Toto-2.0-313m,0.269,0.115,0.424,-0.034,-0.064,-0.004
-Chronos-Bolt,citras-fm,0.308,0.154,0.462,-0.07,-0.126,-0.024
-Chronos-Bolt,TS-ICL,0.385,0.192,0.577,-0.07,-0.153,0.001
-Chronos-Bolt,TiRex,0.442,0.269,0.615,-0.004,-0.034,0.02
-Chronos-Bolt,TabPFN-TS,0.462,0.269,0.654,-0.074,-0.167,-0.002
-Chronos-Bolt,Toto-2.0-22m,0.462,0.269,0.654,-0.006,-0.037,0.025
-Chronos-Bolt,TimesFM-2.5,0.423,0.231,0.596,0.004,-0.025,0.032
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.923,0.808,1.0,0.248,0.188,0.306
-Seasonal Naive,TimesFM-3,0.038,0.0,0.115,-0.61,-0.835,-0.417
-Seasonal Naive,Chronos-2,0.038,0.0,0.115,-0.548,-0.729,-0.384
-Seasonal Naive,t0-beta,0.038,0.0,0.115,-0.556,-0.758,-0.375
-Seasonal Naive,Toto-2.0-1B,0.077,0.0,0.192,-0.382,-0.514,-0.266
-Seasonal Naive,Toto-2.0-2.5B,0.038,0.0,0.115,-0.377,-0.504,-0.267
-Seasonal Naive,TabPFN-TS-3,0.038,0.0,0.115,-0.515,-0.695,-0.36
-Seasonal Naive,TiRex-2,0.038,0.0,0.115,-0.478,-0.652,-0.321
-Seasonal Naive,Toto-2.0-313m,0.077,0.0,0.192,-0.375,-0.505,-0.259
-Seasonal Naive,citras-fm,0.038,0.0,0.115,-0.423,-0.563,-0.289
-Seasonal Naive,TS-ICL,0.115,0.0,0.269,-0.423,-0.586,-0.273
-Seasonal Naive,TiRex,0.077,0.0,0.192,-0.335,-0.445,-0.237
-Seasonal Naive,TabPFN-TS,0.077,0.0,0.192,-0.428,-0.596,-0.276
-Seasonal Naive,Toto-2.0-22m,0.115,0.0,0.269,-0.337,-0.46,-0.231
-Seasonal Naive,TimesFM-2.5,0.077,0.0,0.192,-0.324,-0.441,-0.223
-Seasonal Naive,Chronos-Bolt,0.077,0.0,0.192,-0.33,-0.44,-0.232
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_energy/pairwise_SQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.615,0.423,0.808,0.04,-0.003,0.084
-TimesFM-3,t0-beta,0.654,0.462,0.846,0.041,-0.004,0.085
-TimesFM-3,Toto-2.0-1B,0.769,0.615,0.923,0.139,0.048,0.219
-TimesFM-3,TiRex-2,0.769,0.577,0.923,0.084,0.024,0.144
-TimesFM-3,Toto-2.0-2.5B,0.731,0.538,0.885,0.143,0.052,0.223
-TimesFM-3,TabPFN-TS-3,0.654,0.462,0.808,0.066,0.022,0.11
-TimesFM-3,Toto-2.0-313m,0.731,0.538,0.885,0.146,0.057,0.228
-TimesFM-3,TiRex,0.769,0.615,0.923,0.175,0.087,0.251
-TimesFM-3,TS-ICL,0.846,0.692,0.962,0.12,0.073,0.166
-TimesFM-3,citras-fm,0.769,0.615,0.923,0.141,0.074,0.206
-TimesFM-3,TabPFN-TS,0.731,0.538,0.885,0.119,0.059,0.177
-TimesFM-3,Toto-2.0-22m,0.885,0.769,1.0,0.172,0.084,0.249
-TimesFM-3,TimesFM-2.5,0.885,0.769,1.0,0.193,0.102,0.266
-TimesFM-3,FlowState,0.808,0.654,0.923,0.2,0.112,0.276
-TimesFM-3,Chronos-Bolt,0.885,0.769,1.0,0.195,0.112,0.268
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.459,0.379,0.528
-Chronos-2,TimesFM-3,0.385,0.192,0.577,-0.041,-0.092,0.003
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,t0-beta,0.615,0.423,0.77,0.002,-0.019,0.02
-Chronos-2,Toto-2.0-1B,0.615,0.423,0.808,0.104,0.037,0.17
-Chronos-2,TiRex-2,0.462,0.269,0.654,0.046,0.003,0.094
-Chronos-2,Toto-2.0-2.5B,0.654,0.462,0.808,0.107,0.041,0.173
-Chronos-2,TabPFN-TS-3,0.654,0.462,0.846,0.027,-0.009,0.067
-Chronos-2,Toto-2.0-313m,0.615,0.423,0.808,0.111,0.041,0.178
-Chronos-2,TiRex,0.731,0.538,0.885,0.141,0.072,0.204
-Chronos-2,TS-ICL,0.846,0.692,0.962,0.084,0.048,0.12
-Chronos-2,citras-fm,0.808,0.654,0.962,0.105,0.06,0.145
-Chronos-2,TabPFN-TS,0.808,0.654,0.923,0.082,0.044,0.12
-Chronos-2,Toto-2.0-22m,0.808,0.654,0.923,0.137,0.072,0.202
-Chronos-2,TimesFM-2.5,0.769,0.577,0.923,0.159,0.083,0.225
-Chronos-2,FlowState,0.885,0.731,1.0,0.167,0.099,0.227
-Chronos-2,Chronos-Bolt,0.923,0.808,1.0,0.161,0.096,0.219
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.437,0.368,0.497
-t0-beta,TimesFM-3,0.346,0.154,0.538,-0.043,-0.093,0.004
-t0-beta,Chronos-2,0.385,0.23,0.577,-0.002,-0.021,0.019
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-2.0-1B,0.577,0.385,0.769,0.102,0.023,0.179
-t0-beta,TiRex-2,0.577,0.385,0.769,0.045,0.003,0.087
-t0-beta,Toto-2.0-2.5B,0.654,0.462,0.846,0.106,0.026,0.183
-t0-beta,TabPFN-TS-3,0.615,0.423,0.808,0.026,-0.012,0.064
-t0-beta,Toto-2.0-313m,0.615,0.423,0.808,0.109,0.031,0.184
-t0-beta,TiRex,0.808,0.654,0.962,0.14,0.062,0.211
-t0-beta,TS-ICL,0.885,0.769,1.0,0.082,0.043,0.121
-t0-beta,citras-fm,0.769,0.577,0.923,0.104,0.051,0.149
-t0-beta,TabPFN-TS,0.731,0.538,0.885,0.081,0.037,0.121
-t0-beta,Toto-2.0-22m,0.769,0.577,0.923,0.136,0.061,0.211
-t0-beta,TimesFM-2.5,0.769,0.577,0.923,0.158,0.072,0.234
-t0-beta,FlowState,0.846,0.692,0.962,0.166,0.09,0.234
-t0-beta,Chronos-Bolt,0.885,0.731,1.0,0.16,0.087,0.23
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.436,0.364,0.501
-Toto-2.0-1B,TimesFM-3,0.231,0.077,0.385,-0.162,-0.28,-0.051
-Toto-2.0-1B,Chronos-2,0.385,0.192,0.577,-0.116,-0.204,-0.038
-Toto-2.0-1B,t0-beta,0.423,0.231,0.615,-0.114,-0.219,-0.023
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,TiRex-2,0.5,0.308,0.692,-0.064,-0.157,0.009
-Toto-2.0-1B,Toto-2.0-2.5B,0.538,0.346,0.692,0.004,-0.003,0.012
-Toto-2.0-1B,TabPFN-TS-3,0.462,0.269,0.654,-0.085,-0.194,0.015
-Toto-2.0-1B,Toto-2.0-313m,0.577,0.385,0.769,0.008,-0.003,0.02
-Toto-2.0-1B,TiRex,0.692,0.5,0.846,0.042,0.016,0.07
-Toto-2.0-1B,TS-ICL,0.577,0.385,0.769,-0.022,-0.093,0.043
-Toto-2.0-1B,citras-fm,0.615,0.423,0.808,0.002,-0.064,0.055
-Toto-2.0-1B,TabPFN-TS,0.654,0.462,0.846,-0.024,-0.12,0.056
-Toto-2.0-1B,Toto-2.0-22m,0.885,0.731,1.0,0.038,0.025,0.054
-Toto-2.0-1B,TimesFM-2.5,0.808,0.654,0.962,0.062,0.029,0.096
-Toto-2.0-1B,FlowState,0.846,0.692,0.962,0.071,0.039,0.104
-Toto-2.0-1B,Chronos-Bolt,0.846,0.692,0.962,0.064,0.029,0.097
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.372,0.312,0.433
-TiRex-2,TimesFM-3,0.231,0.077,0.423,-0.092,-0.168,-0.025
-TiRex-2,Chronos-2,0.538,0.346,0.731,-0.049,-0.104,-0.003
-TiRex-2,t0-beta,0.423,0.231,0.615,-0.047,-0.096,-0.003
-TiRex-2,Toto-2.0-1B,0.5,0.308,0.692,0.06,-0.009,0.136
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,Toto-2.0-2.5B,0.5,0.308,0.692,0.064,-0.007,0.139
-TiRex-2,TabPFN-TS-3,0.577,0.385,0.769,-0.02,-0.087,0.038
-TiRex-2,Toto-2.0-313m,0.5,0.308,0.692,0.067,-0.004,0.147
-TiRex-2,TiRex,0.692,0.538,0.846,0.099,0.033,0.169
-TiRex-2,TS-ICL,0.731,0.538,0.923,0.039,-0.009,0.084
-TiRex-2,citras-fm,0.692,0.5,0.846,0.062,0.004,0.116
-TiRex-2,TabPFN-TS,0.654,0.462,0.846,0.038,-0.015,0.087
-TiRex-2,Toto-2.0-22m,0.577,0.385,0.769,0.095,0.027,0.165
-TiRex-2,TimesFM-2.5,0.731,0.538,0.885,0.118,0.044,0.193
-TiRex-2,FlowState,0.731,0.577,0.885,0.126,0.058,0.197
-TiRex-2,Chronos-Bolt,0.846,0.692,0.962,0.12,0.05,0.194
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.41,0.334,0.479
-Toto-2.0-2.5B,TimesFM-3,0.269,0.115,0.462,-0.166,-0.286,-0.055
-Toto-2.0-2.5B,Chronos-2,0.346,0.192,0.538,-0.12,-0.209,-0.043
-Toto-2.0-2.5B,t0-beta,0.346,0.154,0.538,-0.118,-0.224,-0.027
-Toto-2.0-2.5B,Toto-2.0-1B,0.462,0.308,0.654,-0.004,-0.012,0.003
-Toto-2.0-2.5B,TiRex-2,0.5,0.308,0.692,-0.068,-0.162,0.007
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TabPFN-TS-3,0.423,0.231,0.615,-0.09,-0.198,0.008
-Toto-2.0-2.5B,Toto-2.0-313m,0.692,0.538,0.846,0.004,-0.008,0.015
-Toto-2.0-2.5B,TiRex,0.731,0.538,0.885,0.038,0.013,0.065
-Toto-2.0-2.5B,TS-ICL,0.577,0.385,0.769,-0.026,-0.095,0.036
-Toto-2.0-2.5B,citras-fm,0.577,0.385,0.769,-0.002,-0.07,0.051
-Toto-2.0-2.5B,TabPFN-TS,0.654,0.462,0.846,-0.028,-0.125,0.049
-Toto-2.0-2.5B,Toto-2.0-22m,0.808,0.654,0.962,0.034,0.021,0.048
-Toto-2.0-2.5B,TimesFM-2.5,0.692,0.5,0.846,0.058,0.025,0.092
-Toto-2.0-2.5B,FlowState,0.846,0.692,0.962,0.067,0.035,0.101
-Toto-2.0-2.5B,Chronos-Bolt,0.885,0.768,1.0,0.061,0.028,0.091
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.369,0.312,0.43
-TabPFN-TS-3,TimesFM-3,0.346,0.192,0.538,-0.071,-0.124,-0.022
-TabPFN-TS-3,Chronos-2,0.346,0.154,0.538,-0.028,-0.072,0.009
-TabPFN-TS-3,t0-beta,0.385,0.192,0.577,-0.026,-0.069,0.012
-TabPFN-TS-3,Toto-2.0-1B,0.538,0.346,0.731,0.079,-0.015,0.163
-TabPFN-TS-3,TiRex-2,0.423,0.231,0.615,0.02,-0.04,0.08
-TabPFN-TS-3,Toto-2.0-2.5B,0.577,0.385,0.769,0.082,-0.008,0.165
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,Toto-2.0-313m,0.538,0.346,0.731,0.086,-0.006,0.169
-TabPFN-TS-3,TiRex,0.577,0.385,0.769,0.117,0.03,0.195
-TabPFN-TS-3,TS-ICL,0.654,0.462,0.808,0.058,0.005,0.113
-TabPFN-TS-3,citras-fm,0.692,0.538,0.885,0.08,0.022,0.134
-TabPFN-TS-3,TabPFN-TS,0.769,0.615,0.923,0.057,0.008,0.098
-TabPFN-TS-3,Toto-2.0-22m,0.615,0.423,0.808,0.113,0.029,0.192
-TabPFN-TS-3,TimesFM-2.5,0.654,0.462,0.809,0.136,0.046,0.217
-TabPFN-TS-3,FlowState,0.731,0.538,0.885,0.144,0.053,0.217
-TabPFN-TS-3,Chronos-Bolt,0.769,0.615,0.923,0.138,0.059,0.21
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.421,0.35,0.49
-Toto-2.0-313m,TimesFM-3,0.269,0.115,0.462,-0.171,-0.296,-0.061
-Toto-2.0-313m,Chronos-2,0.385,0.192,0.577,-0.124,-0.216,-0.043
-Toto-2.0-313m,t0-beta,0.385,0.192,0.577,-0.123,-0.226,-0.032
-Toto-2.0-313m,Toto-2.0-1B,0.423,0.231,0.615,-0.008,-0.02,0.003
-Toto-2.0-313m,TiRex-2,0.5,0.308,0.692,-0.072,-0.172,0.004
-Toto-2.0-313m,Toto-2.0-2.5B,0.308,0.154,0.462,-0.004,-0.015,0.008
-Toto-2.0-313m,TabPFN-TS-3,0.462,0.269,0.654,-0.094,-0.204,0.006
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TiRex,0.654,0.462,0.846,0.034,0.013,0.057
-Toto-2.0-313m,TS-ICL,0.577,0.385,0.769,-0.03,-0.101,0.034
-Toto-2.0-313m,citras-fm,0.615,0.423,0.808,-0.006,-0.069,0.044
-Toto-2.0-313m,TabPFN-TS,0.615,0.423,0.808,-0.032,-0.133,0.048
-Toto-2.0-313m,Toto-2.0-22m,0.769,0.614,0.923,0.03,0.017,0.045
-Toto-2.0-313m,TimesFM-2.5,0.731,0.538,0.885,0.055,0.025,0.084
-Toto-2.0-313m,FlowState,0.808,0.654,0.962,0.063,0.034,0.094
-Toto-2.0-313m,Chronos-Bolt,0.808,0.654,0.962,0.057,0.023,0.089
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.367,0.309,0.428
-TiRex,TimesFM-3,0.231,0.077,0.385,-0.213,-0.336,-0.096
-TiRex,Chronos-2,0.269,0.115,0.462,-0.164,-0.257,-0.078
-TiRex,t0-beta,0.192,0.038,0.346,-0.162,-0.267,-0.067
-TiRex,Toto-2.0-1B,0.308,0.154,0.5,-0.044,-0.075,-0.016
-TiRex,TiRex-2,0.308,0.154,0.462,-0.11,-0.204,-0.034
-TiRex,Toto-2.0-2.5B,0.269,0.115,0.462,-0.04,-0.069,-0.013
-TiRex,TabPFN-TS-3,0.423,0.231,0.615,-0.133,-0.242,-0.031
-TiRex,Toto-2.0-313m,0.346,0.154,0.538,-0.035,-0.061,-0.013
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TS-ICL,0.5,0.308,0.692,-0.067,-0.14,-0.0
-TiRex,citras-fm,0.577,0.385,0.769,-0.042,-0.101,0.005
-TiRex,TabPFN-TS,0.5,0.308,0.692,-0.068,-0.171,0.014
-TiRex,Toto-2.0-22m,0.538,0.346,0.731,-0.004,-0.029,0.02
-TiRex,TimesFM-2.5,0.673,0.481,0.846,0.021,-0.002,0.045
-TiRex,FlowState,0.635,0.461,0.808,0.03,0.003,0.06
-TiRex,Chronos-Bolt,0.75,0.577,0.885,0.023,-0.005,0.052
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.344,0.286,0.404
-TS-ICL,TimesFM-3,0.154,0.038,0.308,-0.137,-0.199,-0.079
-TS-ICL,Chronos-2,0.154,0.038,0.308,-0.092,-0.136,-0.051
-TS-ICL,t0-beta,0.115,0.0,0.231,-0.09,-0.138,-0.045
-TS-ICL,Toto-2.0-1B,0.423,0.231,0.615,0.021,-0.045,0.085
-TS-ICL,TiRex-2,0.269,0.077,0.462,-0.041,-0.092,0.008
-TS-ICL,Toto-2.0-2.5B,0.423,0.231,0.615,0.025,-0.038,0.087
-TS-ICL,TabPFN-TS-3,0.346,0.192,0.538,-0.062,-0.127,-0.005
-TS-ICL,Toto-2.0-313m,0.423,0.231,0.615,0.029,-0.035,0.092
-TS-ICL,TiRex,0.5,0.308,0.692,0.062,0.0,0.123
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,citras-fm,0.538,0.346,0.731,0.024,-0.026,0.069
-TS-ICL,TabPFN-TS,0.654,0.462,0.846,-0.002,-0.063,0.053
-TS-ICL,Toto-2.0-22m,0.5,0.345,0.692,0.059,-0.003,0.119
-TS-ICL,TimesFM-2.5,0.615,0.423,0.769,0.082,0.014,0.146
-TS-ICL,FlowState,0.615,0.423,0.808,0.091,0.024,0.151
-TS-ICL,Chronos-Bolt,0.654,0.462,0.808,0.084,0.02,0.148
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.385,0.316,0.455
-citras-fm,TimesFM-3,0.231,0.077,0.385,-0.164,-0.259,-0.08
-citras-fm,Chronos-2,0.192,0.038,0.346,-0.118,-0.17,-0.063
-citras-fm,t0-beta,0.231,0.077,0.423,-0.116,-0.175,-0.054
-citras-fm,Toto-2.0-1B,0.385,0.192,0.577,-0.002,-0.058,0.06
-citras-fm,TiRex-2,0.308,0.154,0.5,-0.066,-0.131,-0.004
-citras-fm,Toto-2.0-2.5B,0.423,0.231,0.615,0.002,-0.053,0.065
-citras-fm,TabPFN-TS-3,0.308,0.115,0.462,-0.087,-0.155,-0.022
-citras-fm,Toto-2.0-313m,0.385,0.192,0.577,0.006,-0.046,0.065
-citras-fm,TiRex,0.423,0.231,0.615,0.04,-0.005,0.091
-citras-fm,TS-ICL,0.462,0.269,0.654,-0.024,-0.074,0.025
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,TabPFN-TS,0.423,0.231,0.615,-0.026,-0.077,0.023
-citras-fm,Toto-2.0-22m,0.577,0.385,0.769,0.036,-0.015,0.094
-citras-fm,TimesFM-2.5,0.5,0.308,0.654,0.06,0.012,0.114
-citras-fm,FlowState,0.692,0.5,0.846,0.069,0.021,0.117
-citras-fm,Chronos-Bolt,0.731,0.538,0.885,0.062,0.024,0.108
-citras-fm,Seasonal Naive,1.0,1.0,1.0,0.371,0.307,0.432
-TabPFN-TS,TimesFM-3,0.269,0.115,0.462,-0.135,-0.215,-0.062
-TabPFN-TS,Chronos-2,0.192,0.077,0.346,-0.09,-0.136,-0.046
-TabPFN-TS,t0-beta,0.269,0.115,0.462,-0.088,-0.138,-0.038
-TabPFN-TS,Toto-2.0-1B,0.346,0.154,0.538,0.023,-0.059,0.107
-TabPFN-TS,TiRex-2,0.346,0.154,0.538,-0.039,-0.095,0.015
-TabPFN-TS,Toto-2.0-2.5B,0.346,0.154,0.538,0.027,-0.051,0.111
-TabPFN-TS,TabPFN-TS-3,0.231,0.077,0.385,-0.06,-0.109,-0.008
-TabPFN-TS,Toto-2.0-313m,0.385,0.192,0.577,0.031,-0.05,0.117
-TabPFN-TS,TiRex,0.5,0.308,0.692,0.064,-0.014,0.146
-TabPFN-TS,TS-ICL,0.346,0.154,0.538,0.002,-0.056,0.059
-TabPFN-TS,citras-fm,0.577,0.385,0.769,0.025,-0.023,0.071
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,Toto-2.0-22m,0.5,0.308,0.692,0.06,-0.022,0.145
-TabPFN-TS,TimesFM-2.5,0.5,0.308,0.692,0.084,0.006,0.167
-TabPFN-TS,FlowState,0.615,0.423,0.808,0.092,0.015,0.166
-TabPFN-TS,Chronos-Bolt,0.654,0.462,0.846,0.086,0.022,0.16
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.386,0.308,0.462
-Toto-2.0-22m,TimesFM-3,0.115,0.0,0.231,-0.207,-0.331,-0.092
-Toto-2.0-22m,Chronos-2,0.192,0.077,0.346,-0.159,-0.254,-0.077
-Toto-2.0-22m,t0-beta,0.231,0.077,0.423,-0.157,-0.267,-0.065
-Toto-2.0-22m,Toto-2.0-1B,0.115,0.0,0.269,-0.039,-0.057,-0.025
-Toto-2.0-22m,TiRex-2,0.423,0.231,0.615,-0.106,-0.198,-0.028
-Toto-2.0-22m,Toto-2.0-2.5B,0.192,0.038,0.346,-0.035,-0.05,-0.021
-Toto-2.0-22m,TabPFN-TS-3,0.385,0.192,0.577,-0.128,-0.238,-0.029
-Toto-2.0-22m,Toto-2.0-313m,0.231,0.077,0.386,-0.031,-0.047,-0.018
-Toto-2.0-22m,TiRex,0.462,0.269,0.654,0.004,-0.02,0.028
-Toto-2.0-22m,TS-ICL,0.5,0.308,0.655,-0.062,-0.135,0.003
-Toto-2.0-22m,citras-fm,0.423,0.231,0.615,-0.037,-0.104,0.015
-Toto-2.0-22m,TabPFN-TS,0.5,0.308,0.692,-0.064,-0.17,0.021
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TimesFM-2.5,0.615,0.423,0.808,0.025,-0.009,0.059
-Toto-2.0-22m,FlowState,0.615,0.423,0.808,0.034,-0.001,0.07
-Toto-2.0-22m,Chronos-Bolt,0.692,0.5,0.885,0.027,-0.009,0.062
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.347,0.288,0.407
-TimesFM-2.5,TimesFM-3,0.115,0.0,0.231,-0.239,-0.363,-0.114
-TimesFM-2.5,Chronos-2,0.231,0.077,0.423,-0.189,-0.291,-0.09
-TimesFM-2.5,t0-beta,0.231,0.077,0.423,-0.187,-0.306,-0.078
-TimesFM-2.5,Toto-2.0-1B,0.192,0.038,0.346,-0.066,-0.106,-0.029
-TimesFM-2.5,TiRex-2,0.269,0.115,0.462,-0.134,-0.24,-0.046
-TimesFM-2.5,Toto-2.0-2.5B,0.308,0.154,0.5,-0.062,-0.102,-0.025
-TimesFM-2.5,TabPFN-TS-3,0.346,0.191,0.538,-0.157,-0.277,-0.048
-TimesFM-2.5,Toto-2.0-313m,0.269,0.115,0.462,-0.058,-0.092,-0.026
-TimesFM-2.5,TiRex,0.327,0.154,0.519,-0.021,-0.047,0.002
-TimesFM-2.5,TS-ICL,0.385,0.231,0.577,-0.09,-0.17,-0.014
-TimesFM-2.5,citras-fm,0.5,0.346,0.692,-0.064,-0.128,-0.012
-TimesFM-2.5,TabPFN-TS,0.5,0.308,0.692,-0.091,-0.2,-0.006
-TimesFM-2.5,Toto-2.0-22m,0.385,0.192,0.577,-0.026,-0.062,0.009
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,FlowState,0.577,0.404,0.75,0.009,-0.023,0.04
-TimesFM-2.5,Chronos-Bolt,0.538,0.365,0.712,0.002,-0.028,0.029
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.33,0.269,0.394
-FlowState,TimesFM-3,0.192,0.077,0.346,-0.25,-0.381,-0.126
-FlowState,Chronos-2,0.115,0.0,0.269,-0.2,-0.294,-0.11
-FlowState,t0-beta,0.154,0.038,0.308,-0.198,-0.306,-0.098
-FlowState,Toto-2.0-1B,0.154,0.038,0.308,-0.076,-0.116,-0.04
-FlowState,TiRex-2,0.269,0.115,0.423,-0.145,-0.245,-0.061
-FlowState,Toto-2.0-2.5B,0.154,0.038,0.308,-0.072,-0.113,-0.036
-FlowState,TabPFN-TS-3,0.269,0.115,0.462,-0.168,-0.277,-0.057
-FlowState,Toto-2.0-313m,0.192,0.038,0.346,-0.068,-0.104,-0.035
-FlowState,TiRex,0.365,0.192,0.539,-0.031,-0.064,-0.003
-FlowState,TS-ICL,0.385,0.192,0.577,-0.1,-0.178,-0.025
-FlowState,citras-fm,0.308,0.154,0.5,-0.074,-0.133,-0.021
-FlowState,TabPFN-TS,0.385,0.192,0.577,-0.102,-0.199,-0.015
-FlowState,Toto-2.0-22m,0.385,0.192,0.577,-0.035,-0.075,0.001
-FlowState,TimesFM-2.5,0.423,0.25,0.596,-0.009,-0.042,0.022
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Chronos-Bolt,0.538,0.365,0.712,-0.007,-0.041,0.029
-FlowState,Seasonal Naive,0.962,0.885,1.0,0.324,0.259,0.389
-Chronos-Bolt,TimesFM-3,0.115,0.0,0.231,-0.242,-0.365,-0.126
-Chronos-Bolt,Chronos-2,0.077,0.0,0.192,-0.192,-0.28,-0.106
-Chronos-Bolt,t0-beta,0.115,0.0,0.269,-0.19,-0.299,-0.096
-Chronos-Bolt,Toto-2.0-1B,0.154,0.038,0.308,-0.069,-0.108,-0.029
-Chronos-Bolt,TiRex-2,0.154,0.038,0.308,-0.137,-0.24,-0.053
-Chronos-Bolt,Toto-2.0-2.5B,0.115,0.0,0.232,-0.064,-0.101,-0.028
-Chronos-Bolt,TabPFN-TS-3,0.231,0.077,0.385,-0.16,-0.266,-0.063
-Chronos-Bolt,Toto-2.0-313m,0.192,0.038,0.346,-0.06,-0.097,-0.024
-Chronos-Bolt,TiRex,0.25,0.115,0.423,-0.024,-0.055,0.005
-Chronos-Bolt,TS-ICL,0.346,0.192,0.538,-0.092,-0.174,-0.02
-Chronos-Bolt,citras-fm,0.269,0.115,0.462,-0.066,-0.121,-0.024
-Chronos-Bolt,TabPFN-TS,0.346,0.154,0.538,-0.094,-0.19,-0.023
-Chronos-Bolt,Toto-2.0-22m,0.308,0.115,0.5,-0.028,-0.066,0.009
-Chronos-Bolt,TimesFM-2.5,0.462,0.288,0.635,-0.002,-0.03,0.027
-Chronos-Bolt,FlowState,0.462,0.288,0.635,0.007,-0.03,0.039
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.329,0.273,0.388
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.85,-1.117,-0.611
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.776,-0.987,-0.581
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.773,-1.002,-0.571
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.592,-0.765,-0.454
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.694,-0.92,-0.5
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.586,-0.754,-0.453
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.728,-0.962,-0.539
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.58,-0.749,-0.446
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.526,-0.679,-0.401
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.627,-0.834,-0.462
-Seasonal Naive,citras-fm,0.0,0.0,0.0,-0.589,-0.761,-0.444
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.63,-0.858,-0.445
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.532,-0.686,-0.404
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.493,-0.65,-0.368
-Seasonal Naive,FlowState,0.038,0.0,0.115,-0.48,-0.638,-0.35
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.49,-0.633,-0.376
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_energy/pairwise_WAPE.csv

@@ -1,257 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.577,0.385,0.769,0.028,-0.032,0.083
-TimesFM-3,t0-beta,0.654,0.462,0.846,0.021,-0.049,0.08
-TimesFM-3,Toto-2.0-313m,0.692,0.5,0.885,0.124,0.031,0.209
-TimesFM-3,Toto-2.0-1B,0.615,0.423,0.808,0.12,0.026,0.205
-TimesFM-3,Toto-2.0-2.5B,0.615,0.423,0.808,0.129,0.04,0.212
-TimesFM-3,TiRex-2,0.731,0.538,0.885,0.074,-0.003,0.147
-TimesFM-3,TabPFN-TS-3,0.692,0.5,0.846,0.072,0.016,0.125
-TimesFM-3,TS-ICL,0.654,0.462,0.846,0.08,0.017,0.136
-TimesFM-3,citras-fm,0.731,0.577,0.885,0.112,0.039,0.184
-TimesFM-3,Toto-2.0-22m,0.769,0.615,0.923,0.147,0.06,0.227
-TimesFM-3,TabPFN-TS,0.731,0.538,0.885,0.128,0.048,0.206
-TimesFM-3,TiRex,0.769,0.577,0.923,0.165,0.075,0.246
-TimesFM-3,TimesFM-2.5,0.885,0.731,1.0,0.172,0.09,0.249
-TimesFM-3,Chronos-Bolt,0.846,0.692,0.962,0.173,0.082,0.257
-TimesFM-3,Seasonal Naive,0.962,0.885,1.0,0.393,0.294,0.48
-Chronos-2,TimesFM-3,0.423,0.231,0.615,-0.029,-0.091,0.031
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,t0-beta,0.462,0.269,0.654,-0.008,-0.036,0.02
-Chronos-2,Toto-2.0-313m,0.615,0.423,0.808,0.099,0.028,0.168
-Chronos-2,Toto-2.0-1B,0.615,0.423,0.808,0.095,0.019,0.17
-Chronos-2,Toto-2.0-2.5B,0.615,0.423,0.808,0.104,0.03,0.173
-Chronos-2,TiRex-2,0.615,0.423,0.808,0.048,0.002,0.096
-Chronos-2,TabPFN-TS-3,0.731,0.538,0.885,0.045,-0.012,0.099
-Chronos-2,TS-ICL,0.769,0.577,0.923,0.053,-0.002,0.103
-Chronos-2,citras-fm,0.731,0.577,0.885,0.086,0.041,0.13
-Chronos-2,Toto-2.0-22m,0.692,0.5,0.846,0.122,0.054,0.188
-Chronos-2,TabPFN-TS,0.808,0.654,0.923,0.103,0.035,0.178
-Chronos-2,TiRex,0.846,0.692,0.962,0.141,0.074,0.204
-Chronos-2,TimesFM-2.5,0.731,0.538,0.885,0.149,0.075,0.214
-Chronos-2,Chronos-Bolt,0.923,0.808,1.0,0.149,0.081,0.219
-Chronos-2,Seasonal Naive,0.923,0.808,1.0,0.376,0.282,0.449
-t0-beta,TimesFM-3,0.346,0.154,0.538,-0.021,-0.087,0.046
-t0-beta,Chronos-2,0.538,0.346,0.731,0.008,-0.021,0.035
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-2.0-313m,0.615,0.423,0.808,0.106,0.02,0.191
-t0-beta,Toto-2.0-1B,0.577,0.385,0.769,0.101,0.013,0.187
-t0-beta,Toto-2.0-2.5B,0.654,0.462,0.846,0.111,0.026,0.194
-t0-beta,TiRex-2,0.577,0.385,0.769,0.055,0.006,0.102
-t0-beta,TabPFN-TS-3,0.654,0.462,0.846,0.052,-0.005,0.107
-t0-beta,TS-ICL,0.731,0.538,0.885,0.06,-0.002,0.113
-t0-beta,citras-fm,0.808,0.654,0.923,0.093,0.04,0.141
-t0-beta,Toto-2.0-22m,0.692,0.5,0.846,0.129,0.048,0.206
-t0-beta,TabPFN-TS,0.731,0.538,0.885,0.11,0.043,0.176
-t0-beta,TiRex,0.769,0.615,0.923,0.147,0.067,0.222
-t0-beta,TimesFM-2.5,0.808,0.615,0.923,0.155,0.069,0.235
-t0-beta,Chronos-Bolt,0.808,0.654,0.962,0.156,0.078,0.233
-t0-beta,Seasonal Naive,0.962,0.885,1.0,0.38,0.281,0.459
-Toto-2.0-313m,TimesFM-3,0.308,0.115,0.5,-0.142,-0.264,-0.032
-Toto-2.0-313m,Chronos-2,0.385,0.192,0.577,-0.11,-0.202,-0.029
-Toto-2.0-313m,t0-beta,0.385,0.192,0.577,-0.118,-0.236,-0.021
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-1B,0.538,0.346,0.731,-0.005,-0.026,0.012
-Toto-2.0-313m,Toto-2.0-2.5B,0.423,0.231,0.615,0.006,-0.007,0.018
-Toto-2.0-313m,TiRex-2,0.538,0.346,0.731,-0.057,-0.158,0.028
-Toto-2.0-313m,TabPFN-TS-3,0.577,0.385,0.769,-0.06,-0.174,0.05
-Toto-2.0-313m,TS-ICL,0.577,0.385,0.769,-0.051,-0.139,0.026
-Toto-2.0-313m,citras-fm,0.615,0.423,0.808,-0.014,-0.084,0.042
-Toto-2.0-313m,Toto-2.0-22m,0.731,0.538,0.885,0.026,0.005,0.044
-Toto-2.0-313m,TabPFN-TS,0.692,0.5,0.846,0.005,-0.109,0.1
-Toto-2.0-313m,TiRex,0.654,0.462,0.846,0.047,0.019,0.079
-Toto-2.0-313m,TimesFM-2.5,0.769,0.615,0.923,0.055,0.019,0.099
-Toto-2.0-313m,Chronos-Bolt,0.846,0.692,0.962,0.056,0.014,0.105
-Toto-2.0-313m,Seasonal Naive,0.923,0.808,1.0,0.307,0.221,0.386
-Toto-2.0-1B,TimesFM-3,0.385,0.192,0.577,-0.136,-0.257,-0.026
-Toto-2.0-1B,Chronos-2,0.385,0.192,0.577,-0.104,-0.204,-0.02
-Toto-2.0-1B,t0-beta,0.423,0.231,0.615,-0.113,-0.231,-0.013
-Toto-2.0-1B,Toto-2.0-313m,0.462,0.269,0.654,0.005,-0.012,0.025
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-2.5B,0.5,0.308,0.692,0.01,-0.003,0.026
-Toto-2.0-1B,TiRex-2,0.577,0.385,0.769,-0.052,-0.153,0.034
-Toto-2.0-1B,TabPFN-TS-3,0.462,0.269,0.654,-0.055,-0.17,0.057
-Toto-2.0-1B,TS-ICL,0.462,0.269,0.654,-0.046,-0.136,0.034
-Toto-2.0-1B,citras-fm,0.615,0.423,0.808,-0.01,-0.081,0.053
-Toto-2.0-1B,Toto-2.0-22m,0.769,0.577,0.923,0.03,0.006,0.053
-Toto-2.0-1B,TabPFN-TS,0.577,0.385,0.769,0.01,-0.1,0.109
-Toto-2.0-1B,TiRex,0.769,0.615,0.923,0.051,0.016,0.094
-Toto-2.0-1B,TimesFM-2.5,0.808,0.654,0.962,0.06,0.02,0.109
-Toto-2.0-1B,Chronos-Bolt,0.808,0.654,0.962,0.06,0.011,0.118
-Toto-2.0-1B,Seasonal Naive,0.962,0.885,1.0,0.31,0.223,0.392
-Toto-2.0-2.5B,TimesFM-3,0.385,0.192,0.577,-0.148,-0.269,-0.042
-Toto-2.0-2.5B,Chronos-2,0.385,0.192,0.577,-0.116,-0.209,-0.031
-Toto-2.0-2.5B,t0-beta,0.346,0.154,0.538,-0.125,-0.241,-0.027
-Toto-2.0-2.5B,Toto-2.0-313m,0.577,0.385,0.769,-0.006,-0.018,0.007
-Toto-2.0-2.5B,Toto-2.0-1B,0.5,0.308,0.692,-0.011,-0.027,0.003
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TiRex-2,0.577,0.385,0.769,-0.063,-0.16,0.02
-Toto-2.0-2.5B,TabPFN-TS-3,0.5,0.346,0.692,-0.066,-0.174,0.041
-Toto-2.0-2.5B,TS-ICL,0.462,0.269,0.654,-0.057,-0.143,0.019
-Toto-2.0-2.5B,citras-fm,0.5,0.308,0.692,-0.02,-0.088,0.038
-Toto-2.0-2.5B,Toto-2.0-22m,0.731,0.538,0.885,0.02,0.002,0.037
-Toto-2.0-2.5B,TabPFN-TS,0.615,0.423,0.808,-0.001,-0.108,0.094
-Toto-2.0-2.5B,TiRex,0.692,0.5,0.885,0.041,0.011,0.077
-Toto-2.0-2.5B,TimesFM-2.5,0.692,0.5,0.885,0.05,0.012,0.097
-Toto-2.0-2.5B,Chronos-Bolt,0.808,0.654,0.962,0.05,0.005,0.099
-Toto-2.0-2.5B,Seasonal Naive,0.923,0.808,1.0,0.303,0.219,0.384
-TiRex-2,TimesFM-3,0.269,0.115,0.462,-0.08,-0.173,0.003
-TiRex-2,Chronos-2,0.385,0.192,0.577,-0.05,-0.106,-0.002
-TiRex-2,t0-beta,0.423,0.231,0.615,-0.058,-0.114,-0.006
-TiRex-2,Toto-2.0-313m,0.462,0.269,0.654,0.054,-0.029,0.137
-TiRex-2,Toto-2.0-1B,0.423,0.231,0.615,0.049,-0.035,0.133
-TiRex-2,Toto-2.0-2.5B,0.423,0.231,0.615,0.059,-0.02,0.138
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TabPFN-TS-3,0.538,0.346,0.731,-0.003,-0.078,0.069
-TiRex-2,TS-ICL,0.5,0.308,0.692,0.006,-0.049,0.06
-TiRex-2,citras-fm,0.577,0.385,0.769,0.04,-0.024,0.102
-TiRex-2,Toto-2.0-22m,0.538,0.346,0.731,0.078,0.004,0.154
-TiRex-2,TabPFN-TS,0.692,0.5,0.846,0.058,-0.019,0.139
-TiRex-2,TiRex,0.577,0.385,0.769,0.098,0.027,0.167
-TiRex-2,TimesFM-2.5,0.615,0.423,0.769,0.106,0.033,0.182
-TiRex-2,Chronos-Bolt,0.654,0.462,0.846,0.107,0.025,0.193
-TiRex-2,Seasonal Naive,0.962,0.885,1.0,0.344,0.247,0.425
-TabPFN-TS-3,TimesFM-3,0.308,0.154,0.5,-0.077,-0.142,-0.016
-TabPFN-TS-3,Chronos-2,0.269,0.115,0.462,-0.047,-0.11,0.012
-TabPFN-TS-3,t0-beta,0.346,0.154,0.538,-0.055,-0.119,0.005
-TabPFN-TS-3,Toto-2.0-313m,0.423,0.231,0.615,0.056,-0.053,0.148
-TabPFN-TS-3,Toto-2.0-1B,0.538,0.346,0.731,0.052,-0.061,0.145
-TabPFN-TS-3,Toto-2.0-2.5B,0.5,0.308,0.654,0.062,-0.043,0.148
-TabPFN-TS-3,TiRex-2,0.462,0.269,0.654,0.003,-0.074,0.072
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TS-ICL,0.538,0.346,0.731,0.009,-0.042,0.058
-TabPFN-TS-3,citras-fm,0.538,0.346,0.731,0.043,-0.024,0.104
-TabPFN-TS-3,Toto-2.0-22m,0.577,0.385,0.769,0.081,-0.016,0.164
-TabPFN-TS-3,TabPFN-TS,0.692,0.5,0.846,0.061,-0.003,0.119
-TabPFN-TS-3,TiRex,0.538,0.346,0.731,0.1,0.002,0.189
-TabPFN-TS-3,TimesFM-2.5,0.577,0.385,0.769,0.109,0.018,0.192
-TabPFN-TS-3,Chronos-Bolt,0.654,0.462,0.846,0.109,0.021,0.191
-TabPFN-TS-3,Seasonal Naive,0.962,0.885,1.0,0.346,0.261,0.422
-TS-ICL,TimesFM-3,0.346,0.154,0.538,-0.087,-0.158,-0.018
-TS-ICL,Chronos-2,0.231,0.077,0.423,-0.056,-0.114,0.002
-TS-ICL,t0-beta,0.269,0.115,0.462,-0.064,-0.127,0.002
-TS-ICL,Toto-2.0-313m,0.423,0.231,0.615,0.048,-0.027,0.122
-TS-ICL,Toto-2.0-1B,0.538,0.346,0.731,0.044,-0.035,0.12
-TS-ICL,Toto-2.0-2.5B,0.538,0.346,0.731,0.054,-0.02,0.125
-TS-ICL,TiRex-2,0.5,0.308,0.692,-0.006,-0.064,0.047
-TS-ICL,TabPFN-TS-3,0.462,0.269,0.654,-0.009,-0.061,0.04
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,citras-fm,0.615,0.423,0.808,0.035,-0.019,0.084
-TS-ICL,Toto-2.0-22m,0.577,0.385,0.769,0.073,0.01,0.137
-TS-ICL,TabPFN-TS,0.654,0.462,0.846,0.053,-0.008,0.111
-TS-ICL,TiRex,0.538,0.346,0.731,0.093,0.018,0.163
-TS-ICL,TimesFM-2.5,0.692,0.5,0.846,0.101,0.029,0.168
-TS-ICL,Chronos-Bolt,0.577,0.385,0.769,0.101,0.027,0.173
-TS-ICL,Seasonal Naive,0.962,0.885,1.0,0.341,0.266,0.408
-citras-fm,TimesFM-3,0.269,0.115,0.423,-0.126,-0.225,-0.041
-citras-fm,Chronos-2,0.269,0.115,0.423,-0.094,-0.149,-0.042
-citras-fm,t0-beta,0.192,0.077,0.346,-0.102,-0.165,-0.042
-citras-fm,Toto-2.0-313m,0.385,0.192,0.577,0.014,-0.044,0.078
-citras-fm,Toto-2.0-1B,0.385,0.192,0.577,0.009,-0.056,0.075
-citras-fm,Toto-2.0-2.5B,0.5,0.308,0.692,0.02,-0.039,0.081
-citras-fm,TiRex-2,0.423,0.231,0.615,-0.042,-0.114,0.024
-citras-fm,TabPFN-TS-3,0.462,0.269,0.654,-0.045,-0.117,0.023
-citras-fm,TS-ICL,0.385,0.192,0.577,-0.036,-0.091,0.019
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,Toto-2.0-22m,0.462,0.269,0.654,0.04,-0.013,0.095
-citras-fm,TabPFN-TS,0.615,0.423,0.808,0.019,-0.043,0.08
-citras-fm,TiRex,0.654,0.462,0.808,0.06,0.009,0.11
-citras-fm,TimesFM-2.5,0.577,0.385,0.769,0.069,0.014,0.126
-citras-fm,Chronos-Bolt,0.654,0.462,0.846,0.069,0.02,0.123
-citras-fm,Seasonal Naive,0.923,0.808,1.0,0.317,0.235,0.384
-Toto-2.0-22m,TimesFM-3,0.231,0.077,0.385,-0.172,-0.294,-0.064
-Toto-2.0-22m,Chronos-2,0.308,0.154,0.5,-0.139,-0.232,-0.057
-Toto-2.0-22m,t0-beta,0.308,0.154,0.5,-0.148,-0.26,-0.051
-Toto-2.0-22m,Toto-2.0-313m,0.269,0.115,0.462,-0.027,-0.046,-0.005
-Toto-2.0-22m,Toto-2.0-1B,0.231,0.077,0.423,-0.031,-0.055,-0.006
-Toto-2.0-22m,Toto-2.0-2.5B,0.269,0.115,0.462,-0.021,-0.039,-0.002
-Toto-2.0-22m,TiRex-2,0.462,0.269,0.654,-0.085,-0.181,-0.004
-Toto-2.0-22m,TabPFN-TS-3,0.423,0.231,0.615,-0.088,-0.197,0.015
-Toto-2.0-22m,TS-ICL,0.423,0.231,0.615,-0.079,-0.158,-0.01
-Toto-2.0-22m,citras-fm,0.538,0.346,0.731,-0.041,-0.105,0.013
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TabPFN-TS,0.5,0.308,0.692,-0.022,-0.126,0.071
-Toto-2.0-22m,TiRex,0.5,0.308,0.692,0.021,-0.012,0.058
-Toto-2.0-22m,TimesFM-2.5,0.5,0.308,0.692,0.03,-0.011,0.078
-Toto-2.0-22m,Chronos-Bolt,0.692,0.5,0.846,0.031,-0.011,0.077
-Toto-2.0-22m,Seasonal Naive,0.962,0.885,1.0,0.289,0.209,0.365
-TabPFN-TS,TimesFM-3,0.269,0.115,0.462,-0.147,-0.26,-0.051
-TabPFN-TS,Chronos-2,0.192,0.077,0.346,-0.115,-0.216,-0.036
-TabPFN-TS,t0-beta,0.269,0.115,0.462,-0.124,-0.213,-0.045
-TabPFN-TS,Toto-2.0-313m,0.308,0.154,0.5,-0.005,-0.112,0.098
-TabPFN-TS,Toto-2.0-1B,0.423,0.231,0.615,-0.01,-0.123,0.091
-TabPFN-TS,Toto-2.0-2.5B,0.385,0.192,0.577,0.001,-0.103,0.098
-TabPFN-TS,TiRex-2,0.308,0.154,0.5,-0.062,-0.161,0.018
-TabPFN-TS,TabPFN-TS-3,0.308,0.154,0.5,-0.065,-0.135,0.003
-TabPFN-TS,TS-ICL,0.346,0.154,0.538,-0.056,-0.125,0.008
-TabPFN-TS,citras-fm,0.385,0.192,0.577,-0.019,-0.086,0.041
-TabPFN-TS,Toto-2.0-22m,0.5,0.308,0.692,0.021,-0.076,0.112
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,TiRex,0.462,0.269,0.654,0.042,-0.07,0.138
-TabPFN-TS,TimesFM-2.5,0.538,0.346,0.731,0.051,-0.047,0.137
-TabPFN-TS,Chronos-Bolt,0.538,0.346,0.731,0.051,-0.035,0.132
-TabPFN-TS,Seasonal Naive,0.962,0.885,1.0,0.304,0.213,0.381
-TiRex,TimesFM-3,0.231,0.077,0.423,-0.197,-0.326,-0.081
-TiRex,Chronos-2,0.154,0.038,0.308,-0.164,-0.256,-0.08
-TiRex,t0-beta,0.231,0.077,0.385,-0.173,-0.285,-0.072
-TiRex,Toto-2.0-313m,0.346,0.154,0.538,-0.049,-0.085,-0.019
-TiRex,Toto-2.0-1B,0.231,0.077,0.385,-0.054,-0.104,-0.017
-TiRex,Toto-2.0-2.5B,0.308,0.115,0.5,-0.043,-0.084,-0.011
-TiRex,TiRex-2,0.423,0.231,0.615,-0.108,-0.201,-0.027
-TiRex,TabPFN-TS-3,0.462,0.269,0.654,-0.112,-0.233,-0.002
-TiRex,TS-ICL,0.462,0.269,0.654,-0.102,-0.195,-0.018
-TiRex,citras-fm,0.346,0.192,0.538,-0.064,-0.124,-0.009
-TiRex,Toto-2.0-22m,0.5,0.308,0.692,-0.022,-0.061,0.012
-TiRex,TabPFN-TS,0.538,0.346,0.731,-0.044,-0.161,0.065
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TimesFM-2.5,0.558,0.365,0.75,0.009,-0.023,0.041
-TiRex,Chronos-Bolt,0.481,0.308,0.673,0.01,-0.028,0.06
-TiRex,Seasonal Naive,0.885,0.731,1.0,0.273,0.184,0.352
-TimesFM-2.5,TimesFM-3,0.115,0.0,0.269,-0.208,-0.331,-0.099
-TimesFM-2.5,Chronos-2,0.269,0.115,0.462,-0.175,-0.273,-0.081
-TimesFM-2.5,t0-beta,0.192,0.077,0.385,-0.183,-0.307,-0.074
-TimesFM-2.5,Toto-2.0-313m,0.231,0.077,0.385,-0.058,-0.11,-0.019
-TimesFM-2.5,Toto-2.0-1B,0.192,0.038,0.346,-0.063,-0.122,-0.021
-TimesFM-2.5,Toto-2.0-2.5B,0.308,0.115,0.5,-0.052,-0.107,-0.012
-TimesFM-2.5,TiRex-2,0.385,0.231,0.577,-0.119,-0.222,-0.034
-TimesFM-2.5,TabPFN-TS-3,0.423,0.231,0.615,-0.122,-0.238,-0.019
-TimesFM-2.5,TS-ICL,0.308,0.154,0.5,-0.112,-0.202,-0.03
-TimesFM-2.5,citras-fm,0.423,0.231,0.615,-0.074,-0.144,-0.014
-TimesFM-2.5,Toto-2.0-22m,0.5,0.308,0.692,-0.031,-0.085,0.011
-TimesFM-2.5,TabPFN-TS,0.462,0.269,0.654,-0.053,-0.159,0.045
-TimesFM-2.5,TiRex,0.442,0.25,0.635,-0.009,-0.043,0.023
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Chronos-Bolt,0.5,0.327,0.674,0.001,-0.039,0.042
-TimesFM-2.5,Seasonal Naive,0.923,0.808,1.0,0.267,0.184,0.338
-Chronos-Bolt,TimesFM-3,0.154,0.038,0.308,-0.209,-0.346,-0.089
-Chronos-Bolt,Chronos-2,0.077,0.0,0.192,-0.175,-0.28,-0.089
-Chronos-Bolt,t0-beta,0.192,0.038,0.346,-0.184,-0.304,-0.084
-Chronos-Bolt,Toto-2.0-313m,0.154,0.038,0.308,-0.059,-0.118,-0.014
-Chronos-Bolt,Toto-2.0-1B,0.192,0.038,0.346,-0.064,-0.133,-0.011
-Chronos-Bolt,Toto-2.0-2.5B,0.192,0.038,0.346,-0.053,-0.109,-0.005
-Chronos-Bolt,TiRex-2,0.346,0.154,0.538,-0.119,-0.24,-0.026
-Chronos-Bolt,TabPFN-TS-3,0.346,0.154,0.538,-0.123,-0.236,-0.021
-Chronos-Bolt,TS-ICL,0.423,0.231,0.615,-0.113,-0.21,-0.028
-Chronos-Bolt,citras-fm,0.346,0.154,0.538,-0.074,-0.14,-0.02
-Chronos-Bolt,Toto-2.0-22m,0.308,0.154,0.5,-0.032,-0.083,0.011
-Chronos-Bolt,TabPFN-TS,0.462,0.269,0.654,-0.054,-0.152,0.034
-Chronos-Bolt,TiRex,0.519,0.327,0.692,-0.01,-0.064,0.027
-Chronos-Bolt,TimesFM-2.5,0.5,0.326,0.673,-0.001,-0.044,0.038
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.923,0.808,1.0,0.266,0.183,0.339
-Seasonal Naive,TimesFM-3,0.038,0.0,0.115,-0.648,-0.922,-0.417
-Seasonal Naive,Chronos-2,0.077,0.0,0.192,-0.601,-0.814,-0.393
-Seasonal Naive,t0-beta,0.038,0.0,0.115,-0.614,-0.848,-0.392
-Seasonal Naive,Toto-2.0-313m,0.077,0.0,0.192,-0.443,-0.63,-0.284
-Seasonal Naive,Toto-2.0-1B,0.038,0.0,0.115,-0.45,-0.645,-0.288
-Seasonal Naive,Toto-2.0-2.5B,0.077,0.0,0.192,-0.435,-0.623,-0.28
-Seasonal Naive,TiRex-2,0.038,0.0,0.115,-0.525,-0.739,-0.328
-Seasonal Naive,TabPFN-TS-3,0.038,0.0,0.115,-0.529,-0.73,-0.353
-Seasonal Naive,TS-ICL,0.038,0.0,0.115,-0.516,-0.69,-0.363
-Seasonal Naive,citras-fm,0.077,0.0,0.192,-0.464,-0.622,-0.308
-Seasonal Naive,Toto-2.0-22m,0.038,0.0,0.115,-0.406,-0.574,-0.264
-Seasonal Naive,TabPFN-TS,0.038,0.0,0.115,-0.436,-0.616,-0.27
-Seasonal Naive,TiRex,0.115,0.0,0.269,-0.376,-0.544,-0.225
-Seasonal Naive,TimesFM-2.5,0.077,0.0,0.192,-0.363,-0.511,-0.225
-Seasonal Naive,Chronos-Bolt,0.077,0.0,0.192,-0.363,-0.513,-0.225
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_energy/pairwise_WQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.577,0.385,0.769,0.031,-0.026,0.085
-TimesFM-3,t0-beta,0.654,0.462,0.846,0.029,-0.037,0.088
-TimesFM-3,Toto-2.0-1B,0.615,0.423,0.808,0.114,0.015,0.205
-TimesFM-3,Toto-2.0-313m,0.692,0.5,0.846,0.121,0.026,0.208
-TimesFM-3,Toto-2.0-2.5B,0.692,0.5,0.846,0.124,0.031,0.207
-TimesFM-3,TiRex-2,0.731,0.538,0.885,0.075,-0.001,0.149
-TimesFM-3,TabPFN-TS-3,0.654,0.462,0.808,0.08,0.025,0.133
-TimesFM-3,TS-ICL,0.692,0.5,0.846,0.081,0.022,0.139
-TimesFM-3,Toto-2.0-22m,0.731,0.577,0.885,0.149,0.057,0.234
-TimesFM-3,TiRex,0.769,0.615,0.923,0.169,0.077,0.251
-TimesFM-3,citras-fm,0.769,0.615,0.923,0.131,0.056,0.206
-TimesFM-3,TabPFN-TS,0.692,0.5,0.846,0.133,0.056,0.205
-TimesFM-3,TimesFM-2.5,0.846,0.692,0.962,0.185,0.097,0.264
-TimesFM-3,FlowState,0.846,0.692,0.962,0.192,0.102,0.276
-TimesFM-3,Chronos-Bolt,0.846,0.692,0.962,0.191,0.103,0.273
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.477,0.393,0.549
-Chronos-2,TimesFM-3,0.423,0.231,0.615,-0.032,-0.092,0.025
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,t0-beta,0.5,0.308,0.692,-0.002,-0.027,0.024
-Chronos-2,Toto-2.0-1B,0.5,0.308,0.692,0.085,0.012,0.16
-Chronos-2,Toto-2.0-313m,0.538,0.346,0.731,0.093,0.022,0.164
-Chronos-2,Toto-2.0-2.5B,0.577,0.385,0.769,0.096,0.024,0.164
-Chronos-2,TiRex-2,0.577,0.385,0.769,0.045,-0.001,0.094
-Chronos-2,TabPFN-TS-3,0.692,0.5,0.846,0.051,-0.003,0.106
-Chronos-2,TS-ICL,0.808,0.654,0.962,0.052,-0.0,0.095
-Chronos-2,Toto-2.0-22m,0.692,0.5,0.846,0.122,0.052,0.188
-Chronos-2,TiRex,0.808,0.654,0.962,0.143,0.076,0.204
-Chronos-2,citras-fm,0.846,0.731,0.962,0.104,0.057,0.146
-Chronos-2,TabPFN-TS,0.846,0.692,0.962,0.105,0.046,0.172
-Chronos-2,TimesFM-2.5,0.808,0.654,0.962,0.159,0.086,0.224
-Chronos-2,FlowState,0.846,0.692,0.962,0.166,0.098,0.224
-Chronos-2,Chronos-Bolt,0.962,0.885,1.0,0.165,0.099,0.23
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.46,0.384,0.522
-t0-beta,TimesFM-3,0.346,0.154,0.538,-0.03,-0.097,0.036
-t0-beta,Chronos-2,0.5,0.308,0.692,0.002,-0.024,0.026
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-2.0-1B,0.577,0.385,0.769,0.087,-0.003,0.176
-t0-beta,Toto-2.0-313m,0.577,0.385,0.769,0.095,0.011,0.177
-t0-beta,Toto-2.0-2.5B,0.615,0.423,0.808,0.098,0.014,0.179
-t0-beta,TiRex-2,0.538,0.346,0.731,0.047,-0.001,0.095
-t0-beta,TabPFN-TS-3,0.615,0.385,0.77,0.052,-0.005,0.114
-t0-beta,TS-ICL,0.769,0.614,0.923,0.054,-0.003,0.1
-t0-beta,Toto-2.0-22m,0.692,0.5,0.847,0.123,0.042,0.2
-t0-beta,TiRex,0.808,0.654,0.962,0.144,0.066,0.215
-t0-beta,citras-fm,0.846,0.692,0.962,0.105,0.052,0.153
-t0-beta,TabPFN-TS,0.769,0.577,0.923,0.107,0.047,0.165
-t0-beta,TimesFM-2.5,0.808,0.615,0.924,0.161,0.073,0.238
-t0-beta,FlowState,0.808,0.654,0.923,0.167,0.089,0.234
-t0-beta,Chronos-Bolt,0.846,0.692,0.962,0.166,0.089,0.241
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.461,0.38,0.524
-Toto-2.0-1B,TimesFM-3,0.385,0.192,0.577,-0.128,-0.258,-0.015
-Toto-2.0-1B,Chronos-2,0.5,0.308,0.692,-0.093,-0.19,-0.012
-Toto-2.0-1B,t0-beta,0.423,0.231,0.615,-0.095,-0.213,0.003
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-313m,0.5,0.308,0.692,0.009,-0.011,0.036
-Toto-2.0-1B,Toto-2.0-2.5B,0.654,0.462,0.808,0.012,-0.002,0.029
-Toto-2.0-1B,TiRex-2,0.577,0.385,0.769,-0.044,-0.148,0.041
-Toto-2.0-1B,TabPFN-TS-3,0.5,0.308,0.692,-0.038,-0.155,0.074
-Toto-2.0-1B,TS-ICL,0.5,0.308,0.692,-0.036,-0.116,0.038
-Toto-2.0-1B,Toto-2.0-22m,0.885,0.731,1.0,0.04,0.019,0.065
-Toto-2.0-1B,TiRex,0.731,0.577,0.885,0.063,0.022,0.115
-Toto-2.0-1B,citras-fm,0.731,0.538,0.885,0.02,-0.053,0.085
-Toto-2.0-1B,TabPFN-TS,0.654,0.462,0.808,0.022,-0.085,0.112
-Toto-2.0-1B,TimesFM-2.5,0.846,0.692,0.962,0.081,0.037,0.131
-Toto-2.0-1B,FlowState,0.808,0.654,0.962,0.088,0.047,0.131
-Toto-2.0-1B,Chronos-Bolt,0.923,0.808,1.0,0.087,0.036,0.138
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.41,0.333,0.481
-Toto-2.0-313m,TimesFM-3,0.308,0.154,0.5,-0.138,-0.262,-0.027
-Toto-2.0-313m,Chronos-2,0.462,0.269,0.654,-0.103,-0.196,-0.022
-Toto-2.0-313m,t0-beta,0.423,0.231,0.615,-0.105,-0.215,-0.011
-Toto-2.0-313m,Toto-2.0-1B,0.5,0.308,0.692,-0.009,-0.037,0.011
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-2.5B,0.385,0.231,0.577,0.003,-0.012,0.018
-Toto-2.0-313m,TiRex-2,0.538,0.346,0.731,-0.053,-0.156,0.03
-Toto-2.0-313m,TabPFN-TS-3,0.5,0.308,0.692,-0.047,-0.16,0.066
-Toto-2.0-313m,TS-ICL,0.577,0.385,0.769,-0.046,-0.128,0.027
-Toto-2.0-313m,Toto-2.0-22m,0.846,0.692,0.962,0.031,0.014,0.049
-Toto-2.0-313m,TiRex,0.769,0.615,0.923,0.054,0.021,0.09
-Toto-2.0-313m,citras-fm,0.692,0.5,0.846,0.011,-0.056,0.066
-Toto-2.0-313m,TabPFN-TS,0.654,0.462,0.846,0.013,-0.097,0.104
-Toto-2.0-313m,TimesFM-2.5,0.769,0.615,0.923,0.073,0.032,0.121
-Toto-2.0-313m,FlowState,0.808,0.654,0.962,0.08,0.042,0.122
-Toto-2.0-313m,Chronos-Bolt,0.846,0.692,0.962,0.079,0.033,0.131
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.404,0.333,0.471
-Toto-2.0-2.5B,TimesFM-3,0.308,0.154,0.5,-0.142,-0.261,-0.032
-Toto-2.0-2.5B,Chronos-2,0.423,0.231,0.615,-0.106,-0.196,-0.025
-Toto-2.0-2.5B,t0-beta,0.385,0.192,0.577,-0.108,-0.218,-0.014
-Toto-2.0-2.5B,Toto-2.0-1B,0.346,0.192,0.538,-0.012,-0.03,0.002
-Toto-2.0-2.5B,Toto-2.0-313m,0.615,0.423,0.769,-0.003,-0.018,0.012
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TiRex-2,0.538,0.346,0.731,-0.056,-0.158,0.027
-Toto-2.0-2.5B,TabPFN-TS-3,0.5,0.308,0.692,-0.05,-0.161,0.059
-Toto-2.0-2.5B,TS-ICL,0.5,0.308,0.692,-0.049,-0.127,0.023
-Toto-2.0-2.5B,Toto-2.0-22m,0.769,0.615,0.923,0.028,0.011,0.045
-Toto-2.0-2.5B,TiRex,0.769,0.615,0.923,0.051,0.016,0.092
-Toto-2.0-2.5B,citras-fm,0.615,0.423,0.808,0.008,-0.058,0.068
-Toto-2.0-2.5B,TabPFN-TS,0.692,0.538,0.846,0.01,-0.093,0.098
-Toto-2.0-2.5B,TimesFM-2.5,0.769,0.615,0.923,0.07,0.031,0.118
-Toto-2.0-2.5B,FlowState,0.846,0.692,0.962,0.077,0.036,0.12
-Toto-2.0-2.5B,Chronos-Bolt,0.846,0.692,0.962,0.076,0.031,0.122
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.403,0.329,0.473
-TiRex-2,TimesFM-3,0.269,0.115,0.462,-0.081,-0.175,0.001
-TiRex-2,Chronos-2,0.423,0.231,0.615,-0.047,-0.104,0.001
-TiRex-2,t0-beta,0.462,0.269,0.654,-0.049,-0.105,0.001
-TiRex-2,Toto-2.0-1B,0.423,0.231,0.615,0.042,-0.043,0.129
-TiRex-2,Toto-2.0-313m,0.462,0.269,0.654,0.05,-0.031,0.135
-TiRex-2,Toto-2.0-2.5B,0.462,0.269,0.654,0.053,-0.028,0.137
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TabPFN-TS-3,0.5,0.308,0.692,0.006,-0.078,0.082
-TiRex-2,TS-ICL,0.538,0.346,0.731,0.007,-0.052,0.061
-TiRex-2,Toto-2.0-22m,0.5,0.308,0.692,0.08,0.002,0.161
-TiRex-2,TiRex,0.615,0.423,0.808,0.102,0.031,0.173
-TiRex-2,citras-fm,0.615,0.423,0.808,0.061,-0.001,0.121
-TiRex-2,TabPFN-TS,0.615,0.423,0.808,0.063,-0.006,0.135
-TiRex-2,TimesFM-2.5,0.731,0.538,0.885,0.12,0.044,0.196
-TiRex-2,FlowState,0.808,0.654,0.923,0.126,0.052,0.194
-TiRex-2,Chronos-Bolt,0.808,0.654,0.962,0.125,0.045,0.209
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.434,0.355,0.506
-TabPFN-TS-3,TimesFM-3,0.346,0.192,0.538,-0.087,-0.153,-0.026
-TabPFN-TS-3,Chronos-2,0.308,0.154,0.5,-0.053,-0.119,0.003
-TabPFN-TS-3,t0-beta,0.385,0.23,0.615,-0.055,-0.128,0.005
-TabPFN-TS-3,Toto-2.0-1B,0.5,0.308,0.692,0.036,-0.08,0.134
-TabPFN-TS-3,Toto-2.0-313m,0.5,0.308,0.692,0.045,-0.071,0.138
-TabPFN-TS-3,Toto-2.0-2.5B,0.5,0.308,0.692,0.048,-0.063,0.139
-TabPFN-TS-3,TiRex-2,0.5,0.308,0.692,-0.006,-0.089,0.073
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TS-ICL,0.538,0.346,0.731,0.001,-0.057,0.052
-TabPFN-TS-3,Toto-2.0-22m,0.577,0.385,0.769,0.075,-0.031,0.163
-TabPFN-TS-3,TiRex,0.538,0.346,0.731,0.097,-0.002,0.184
-TabPFN-TS-3,citras-fm,0.654,0.499,0.808,0.056,-0.016,0.118
-TabPFN-TS-3,TabPFN-TS,0.769,0.615,0.923,0.057,-0.009,0.113
-TabPFN-TS-3,TimesFM-2.5,0.615,0.423,0.808,0.114,0.023,0.198
-TabPFN-TS-3,FlowState,0.731,0.538,0.885,0.121,0.019,0.206
-TabPFN-TS-3,Chronos-Bolt,0.731,0.577,0.885,0.12,0.034,0.196
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.431,0.357,0.498
-TS-ICL,TimesFM-3,0.308,0.154,0.5,-0.089,-0.161,-0.023
-TS-ICL,Chronos-2,0.192,0.038,0.346,-0.055,-0.105,0.0
-TS-ICL,t0-beta,0.231,0.077,0.386,-0.057,-0.111,0.003
-TS-ICL,Toto-2.0-1B,0.5,0.308,0.692,0.035,-0.04,0.104
-TS-ICL,Toto-2.0-313m,0.423,0.231,0.615,0.044,-0.028,0.113
-TS-ICL,Toto-2.0-2.5B,0.5,0.308,0.692,0.046,-0.024,0.113
-TS-ICL,TiRex-2,0.462,0.269,0.654,-0.007,-0.064,0.05
-TS-ICL,TabPFN-TS-3,0.462,0.269,0.654,-0.001,-0.055,0.054
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,Toto-2.0-22m,0.5,0.308,0.692,0.074,0.006,0.139
-TS-ICL,TiRex,0.5,0.308,0.692,0.095,0.022,0.169
-TS-ICL,citras-fm,0.577,0.385,0.769,0.054,0.003,0.105
-TS-ICL,TabPFN-TS,0.654,0.462,0.808,0.056,-0.002,0.109
-TS-ICL,TimesFM-2.5,0.654,0.462,0.808,0.113,0.043,0.179
-TS-ICL,FlowState,0.692,0.5,0.846,0.12,0.047,0.185
-TS-ICL,Chronos-Bolt,0.731,0.538,0.885,0.119,0.048,0.187
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.43,0.361,0.492
-Toto-2.0-22m,TimesFM-3,0.269,0.115,0.423,-0.175,-0.306,-0.061
-Toto-2.0-22m,Chronos-2,0.308,0.154,0.5,-0.139,-0.231,-0.055
-Toto-2.0-22m,t0-beta,0.308,0.153,0.5,-0.141,-0.251,-0.044
-Toto-2.0-22m,Toto-2.0-1B,0.115,0.0,0.269,-0.042,-0.07,-0.019
-Toto-2.0-22m,Toto-2.0-313m,0.154,0.038,0.308,-0.032,-0.052,-0.014
-Toto-2.0-22m,Toto-2.0-2.5B,0.231,0.077,0.385,-0.029,-0.047,-0.011
-Toto-2.0-22m,TiRex-2,0.5,0.308,0.692,-0.087,-0.192,-0.002
-Toto-2.0-22m,TabPFN-TS-3,0.423,0.231,0.615,-0.081,-0.195,0.03
-Toto-2.0-22m,TS-ICL,0.5,0.308,0.692,-0.079,-0.161,-0.006
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TiRex,0.5,0.308,0.692,0.024,-0.012,0.064
-Toto-2.0-22m,citras-fm,0.462,0.269,0.654,-0.021,-0.091,0.038
-Toto-2.0-22m,TabPFN-TS,0.5,0.308,0.692,-0.019,-0.126,0.073
-Toto-2.0-22m,TimesFM-2.5,0.654,0.462,0.846,0.043,0.0,0.09
-Toto-2.0-22m,FlowState,0.769,0.615,0.923,0.05,0.007,0.089
-Toto-2.0-22m,Chronos-Bolt,0.769,0.615,0.923,0.049,0.002,0.098
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.385,0.315,0.453
-TiRex,TimesFM-3,0.231,0.077,0.385,-0.203,-0.335,-0.084
-TiRex,Chronos-2,0.192,0.038,0.346,-0.166,-0.256,-0.083
-TiRex,t0-beta,0.192,0.038,0.346,-0.168,-0.273,-0.071
-TiRex,Toto-2.0-1B,0.269,0.115,0.423,-0.067,-0.129,-0.023
-TiRex,Toto-2.0-313m,0.231,0.077,0.385,-0.057,-0.099,-0.021
-TiRex,Toto-2.0-2.5B,0.231,0.077,0.385,-0.054,-0.102,-0.016
-TiRex,TiRex-2,0.385,0.192,0.577,-0.113,-0.209,-0.032
-TiRex,TabPFN-TS-3,0.462,0.269,0.654,-0.107,-0.225,0.002
-TiRex,TS-ICL,0.5,0.308,0.692,-0.105,-0.203,-0.023
-TiRex,Toto-2.0-22m,0.5,0.308,0.692,-0.024,-0.068,0.012
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,citras-fm,0.5,0.308,0.692,-0.045,-0.103,0.007
-TiRex,TabPFN-TS,0.5,0.308,0.692,-0.043,-0.153,0.057
-TiRex,TimesFM-2.5,0.673,0.5,0.846,0.02,-0.015,0.053
-TiRex,FlowState,0.596,0.404,0.769,0.027,-0.013,0.066
-TiRex,Chronos-Bolt,0.712,0.538,0.865,0.026,-0.018,0.077
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.37,0.299,0.439
-citras-fm,TimesFM-3,0.231,0.077,0.385,-0.151,-0.259,-0.059
-citras-fm,Chronos-2,0.154,0.038,0.269,-0.116,-0.171,-0.061
-citras-fm,t0-beta,0.154,0.038,0.308,-0.117,-0.18,-0.055
-citras-fm,Toto-2.0-1B,0.269,0.115,0.462,-0.021,-0.093,0.051
-citras-fm,Toto-2.0-313m,0.308,0.154,0.5,-0.012,-0.071,0.053
-citras-fm,Toto-2.0-2.5B,0.385,0.192,0.577,-0.008,-0.073,0.055
-citras-fm,TiRex-2,0.385,0.192,0.577,-0.065,-0.138,0.001
-citras-fm,TabPFN-TS-3,0.346,0.192,0.501,-0.059,-0.134,0.015
-citras-fm,TS-ICL,0.423,0.231,0.615,-0.058,-0.118,-0.003
-citras-fm,Toto-2.0-22m,0.538,0.346,0.731,0.02,-0.04,0.083
-citras-fm,TiRex,0.5,0.308,0.692,0.043,-0.007,0.094
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,TabPFN-TS,0.5,0.308,0.692,0.002,-0.057,0.06
-citras-fm,TimesFM-2.5,0.538,0.346,0.731,0.062,0.007,0.12
-citras-fm,FlowState,0.731,0.538,0.885,0.07,0.017,0.118
-citras-fm,Chronos-Bolt,0.615,0.423,0.808,0.068,0.019,0.125
-citras-fm,Seasonal Naive,1.0,1.0,1.0,0.397,0.328,0.457
-TabPFN-TS,TimesFM-3,0.308,0.154,0.5,-0.153,-0.258,-0.06
-TabPFN-TS,Chronos-2,0.154,0.038,0.308,-0.118,-0.207,-0.048
-TabPFN-TS,t0-beta,0.231,0.077,0.423,-0.12,-0.197,-0.049
-TabPFN-TS,Toto-2.0-1B,0.346,0.192,0.538,-0.022,-0.126,0.078
-TabPFN-TS,Toto-2.0-313m,0.346,0.154,0.538,-0.013,-0.116,0.088
-TabPFN-TS,Toto-2.0-2.5B,0.308,0.154,0.462,-0.01,-0.109,0.085
-TabPFN-TS,TiRex-2,0.385,0.192,0.577,-0.067,-0.156,0.006
-TabPFN-TS,TabPFN-TS-3,0.231,0.077,0.385,-0.061,-0.128,0.009
-TabPFN-TS,TS-ICL,0.346,0.192,0.538,-0.06,-0.122,0.002
-TabPFN-TS,Toto-2.0-22m,0.5,0.308,0.692,0.018,-0.078,0.112
-TabPFN-TS,TiRex,0.5,0.308,0.692,0.042,-0.06,0.132
-TabPFN-TS,citras-fm,0.5,0.308,0.692,-0.002,-0.064,0.054
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,TimesFM-2.5,0.538,0.346,0.731,0.061,-0.032,0.147
-TabPFN-TS,FlowState,0.577,0.385,0.769,0.068,-0.037,0.15
-TabPFN-TS,Chronos-Bolt,0.577,0.385,0.769,0.066,-0.013,0.144
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.396,0.322,0.469
-TimesFM-2.5,TimesFM-3,0.154,0.038,0.308,-0.228,-0.359,-0.108
-TimesFM-2.5,Chronos-2,0.192,0.038,0.346,-0.19,-0.289,-0.094
-TimesFM-2.5,t0-beta,0.192,0.076,0.385,-0.192,-0.312,-0.079
-TimesFM-2.5,Toto-2.0-1B,0.154,0.038,0.308,-0.088,-0.15,-0.039
-TimesFM-2.5,Toto-2.0-313m,0.231,0.077,0.385,-0.079,-0.137,-0.033
-TimesFM-2.5,Toto-2.0-2.5B,0.231,0.077,0.385,-0.075,-0.134,-0.032
-TimesFM-2.5,TiRex-2,0.269,0.115,0.462,-0.136,-0.244,-0.046
-TimesFM-2.5,TabPFN-TS-3,0.385,0.192,0.577,-0.129,-0.247,-0.023
-TimesFM-2.5,TS-ICL,0.346,0.192,0.538,-0.128,-0.218,-0.045
-TimesFM-2.5,Toto-2.0-22m,0.346,0.154,0.538,-0.045,-0.098,-0.0
-TimesFM-2.5,TiRex,0.327,0.154,0.5,-0.02,-0.056,0.015
-TimesFM-2.5,citras-fm,0.462,0.269,0.654,-0.066,-0.136,-0.007
-TimesFM-2.5,TabPFN-TS,0.462,0.269,0.654,-0.064,-0.172,0.031
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,FlowState,0.538,0.365,0.712,0.008,-0.042,0.052
-TimesFM-2.5,Chronos-Bolt,0.577,0.404,0.75,0.006,-0.031,0.046
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.357,0.288,0.423
-FlowState,TimesFM-3,0.154,0.038,0.308,-0.237,-0.381,-0.113
-FlowState,Chronos-2,0.154,0.038,0.308,-0.199,-0.288,-0.109
-FlowState,t0-beta,0.192,0.077,0.346,-0.201,-0.306,-0.098
-FlowState,Toto-2.0-1B,0.192,0.038,0.346,-0.097,-0.151,-0.049
-FlowState,Toto-2.0-313m,0.192,0.038,0.346,-0.087,-0.139,-0.043
-FlowState,Toto-2.0-2.5B,0.154,0.038,0.308,-0.084,-0.136,-0.038
-FlowState,TiRex-2,0.192,0.077,0.346,-0.145,-0.241,-0.055
-FlowState,TabPFN-TS-3,0.269,0.115,0.462,-0.138,-0.259,-0.02
-FlowState,TS-ICL,0.308,0.154,0.5,-0.137,-0.226,-0.05
-FlowState,Toto-2.0-22m,0.231,0.077,0.385,-0.053,-0.098,-0.007
-FlowState,TiRex,0.404,0.231,0.596,-0.028,-0.071,0.013
-FlowState,citras-fm,0.269,0.115,0.462,-0.075,-0.134,-0.018
-FlowState,TabPFN-TS,0.423,0.231,0.615,-0.073,-0.177,0.036
-FlowState,TimesFM-2.5,0.462,0.288,0.635,-0.008,-0.055,0.04
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Chronos-Bolt,0.5,0.326,0.674,-0.002,-0.052,0.067
-FlowState,Seasonal Naive,0.923,0.808,1.0,0.352,0.275,0.427
-Chronos-Bolt,TimesFM-3,0.154,0.038,0.308,-0.235,-0.376,-0.115
-Chronos-Bolt,Chronos-2,0.038,0.0,0.115,-0.197,-0.299,-0.11
-Chronos-Bolt,t0-beta,0.154,0.038,0.308,-0.199,-0.318,-0.098
-Chronos-Bolt,Toto-2.0-1B,0.077,0.0,0.192,-0.095,-0.16,-0.038
-Chronos-Bolt,Toto-2.0-313m,0.154,0.038,0.308,-0.085,-0.15,-0.035
-Chronos-Bolt,Toto-2.0-2.5B,0.154,0.038,0.308,-0.082,-0.139,-0.032
-Chronos-Bolt,TiRex-2,0.192,0.038,0.346,-0.143,-0.264,-0.047
-Chronos-Bolt,TabPFN-TS-3,0.269,0.115,0.423,-0.136,-0.244,-0.035
-Chronos-Bolt,TS-ICL,0.269,0.115,0.462,-0.135,-0.23,-0.05
-Chronos-Bolt,Toto-2.0-22m,0.231,0.077,0.385,-0.051,-0.108,-0.002
-Chronos-Bolt,TiRex,0.288,0.135,0.462,-0.027,-0.084,0.018
-Chronos-Bolt,citras-fm,0.385,0.192,0.577,-0.073,-0.142,-0.019
-Chronos-Bolt,TabPFN-TS,0.423,0.231,0.615,-0.071,-0.168,0.013
-Chronos-Bolt,TimesFM-2.5,0.423,0.25,0.596,-0.006,-0.048,0.03
-Chronos-Bolt,FlowState,0.5,0.326,0.674,0.002,-0.072,0.05
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.353,0.287,0.417
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.911,-1.215,-0.648
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.852,-1.093,-0.622
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.855,-1.102,-0.612
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.694,-0.927,-0.5
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.679,-0.891,-0.5
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.674,-0.899,-0.491
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.768,-1.023,-0.55
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.758,-0.992,-0.556
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.755,-0.969,-0.565
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.626,-0.83,-0.46
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.588,-0.782,-0.427
-Seasonal Naive,citras-fm,0.0,0.0,0.0,-0.66,-0.841,-0.488
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.657,-0.882,-0.476
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.556,-0.734,-0.404
-Seasonal Naive,FlowState,0.077,0.0,0.192,-0.544,-0.745,-0.38
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.547,-0.716,-0.403
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_health/leaderboard_MASE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TiRex-2,78.38709677419354,34.9166343514373,0.0,0.3575023838736039,0.0,0.0
-TimesFM-3,76.77419354838709,34.29269995744054,0.0,2.004992396905436,0.0,0.0
-t0-beta,69.03225806451613,34.44032877005243,0.0,0.3917621968260694,0.0,0.0
-TimesFM-2.5,68.38709677419355,32.87474894024488,0.0,1.1256479395833334,0.0,0.0
-Chronos-2,66.45161290322581,31.78597649489514,0.0,0.3492251116666667,0.0,0.0
-TabPFN-TS-3,65.80645161290322,28.963255047296542,0.0,199.6776895770319,0.0,0.0
-TabPFN-TS,64.19354838709677,34.55373879766452,0.0,53.951610824166664,0.0,0.0
-FlowState,61.93548387096776,27.93729353213241,0.0,1.679734656979167,0.0,0.0
-TiRex,61.93548387096776,32.47588770643868,0.0,0.330588668125,0.0,0.0
-LightGBM,61.29032258064516,33.38915880315173,1.2161332720833333,0.19742606979166666,0.0,0.0
-CatBoost,60.00000000000001,33.16623383500657,13.210264008932292,0.19426541770833333,0.0,0.0
-citras-fm,60.0,32.759601774152436,0.0,0.3327079909164846,0.0,0.0
-TS-ICL,59.03225806451612,31.90295044124469,0.0,1.3692244438010608,0.0,0.0
-Moirai-2.0,58.87096774193549,33.79488506711863,0.0,0.3505868739583333,0.1,0.0
-Toto-2.0-313m,58.70967741935483,27.130941962281884,0.0,1.1242909435416668,0.0,0.0
-Toto-2.0-2.5B,57.41935483870968,27.02155839964281,0.0,5.925324101666666,0.0,0.0
-Toto-2.0-22m,54.19354838709677,27.354995059689568,0.0,0.4238227016666667,0.0,0.0
-Toto-2.0-1B,53.870967741935495,26.055688762834595,0.0,2.728815209166667,0.0,0.0
-Toto-1.0,51.935483870967744,31.700573837170467,0.0,9.804296426666667,0.0,0.0
-Chronos-Bolt,51.45161290322581,30.041136052707273,0.0,0.41178704374999997,0.0,0.0
-Toto-2.0-4m,50.967741935483865,28.997499277709025,0.0,0.36290417583333334,0.0,0.0
-Stat. Ensemble,47.096774193548384,29.22979017092695,0.0,191.30953815208332,0.0,0.0
-AutoETS,46.774193548387096,28.071655328734924,0.0,2.5273205354166666,0.0,0.0
-Sundial-Base,41.935483870967744,22.70787609837541,0.0,8.29280267,0.0,0.0
-AutoARIMA,30.64516129032258,5.881738752268506,0.0,7.6933014760416665,0.0,0.0
-TFT,26.7741935483871,8.056299346355855,577.3621929408333,0.91290832015625,0.0,0.0
-AutoTheta,23.870967741935484,15.20916710141943,0.0,2.3246237520833333,0.0,0.0
-DeepAR,21.29032258064516,8.848833829469338,1252.3585836206248,0.9790481578125001,0.0,0.0
-PatchTST,20.32258064516129,12.927869318522445,812.3820815818749,0.4485787422916667,0.0,0.0
-Seasonal Naive,18.225806451612904,0.0,0.0,1.2681127877083334,0.0,0.0
-Naive,16.29032258064516,0.30982947391161586,0.0,1.2969351423177082,0.0,0.0
-Drift,16.129032258064516,7.491051482058886,0.0,1.3917920932291667,0.0,0.0

tables/domain_health/leaderboard_SQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TiRex-2,80.96774193548387,39.425727939082535,0.0,0.3575023838736039,0.0,0.0
-TimesFM-3,80.96774193548386,39.683119126306366,0.0,2.004992396905436,0.0,0.0
-t0-beta,77.41935483870968,39.8125458246755,0.0,0.3917621968260694,0.0,0.0
-Chronos-2,75.48387096774192,38.08875531260849,0.0,0.3492251116666667,0.0,0.0
-TimesFM-2.5,70.64516129032258,38.03594071146331,0.0,1.1256479395833334,0.0,0.0
-Toto-2.0-313m,65.48387096774194,33.76977925435224,0.0,1.1242909435416668,0.0,0.0
-Moirai-2.0,64.03225806451613,38.69101646514035,0.0,0.3505868739583333,0.1,0.0
-TS-ICL,63.548387096774206,36.735170870136194,0.0,1.3692244438010608,0.0,0.0
-Toto-2.0-2.5B,62.58064516129031,33.54660585794915,0.0,5.925324101666666,0.0,0.0
-TabPFN-TS,62.58064516129031,37.79500412291329,0.0,53.951610824166664,0.0,0.0
-citras-fm,62.25806451612903,37.8794168351068,0.0,0.3327079909164846,0.0,0.0
-TiRex,61.935483870967744,36.908809542631595,0.0,0.330588668125,0.0,0.0
-TabPFN-TS-3,60.967741935483865,33.86938070997042,0.0,199.6776895770319,0.0,0.0
-Toto-2.0-22m,59.35483870967742,33.710262442699914,0.0,0.4238227016666667,0.0,0.0
-Toto-2.0-1B,59.354838709677416,32.77732666419397,0.0,2.728815209166667,0.0,0.0
-Toto-1.0,59.03225806451613,37.78506660666954,0.0,9.804296426666667,0.0,0.0
-Chronos-Bolt,58.54838709677419,36.49963478571547,0.0,0.41178704374999997,0.0,0.0
-FlowState,53.87096774193548,32.77403706037661,0.0,1.679734656979167,0.0,0.0
-Toto-2.0-4m,50.967741935483865,34.41096517434523,0.0,0.36290417583333334,0.0,0.0
-AutoETS,49.677419354838705,31.12404358258436,0.0,2.5273205354166666,0.0,0.0
-Stat. Ensemble,44.83870967741936,31.666899122864876,0.0,191.30953815208332,0.0,0.0
-LightGBM,38.064516129032256,24.996902028028057,1.2161332720833333,0.19742606979166666,0.0,0.0
-CatBoost,34.516129032258064,24.745890887412404,13.210264008932292,0.19426541770833333,0.0,0.0
-Sundial-Base,33.87096774193548,23.555776042271713,0.0,8.29280267,0.0,0.0
-AutoARIMA,31.612903225806456,8.15543220497067,0.0,7.6933014760416665,0.0,0.0
-TFT,29.354838709677416,13.487049535026774,577.3621929408333,0.91290832015625,0.0,0.0
-PatchTST,22.903225806451612,17.70708962424181,812.3820815818749,0.4485787422916667,0.0,0.0
-AutoTheta,22.258064516129032,17.733419411019135,0.0,2.3246237520833333,0.0,0.0
-DeepAR,20.64516129032258,13.730380882991922,1252.3585836206248,0.9790481578125001,0.0,0.0
-Seasonal Naive,17.258064516129032,0.0,0.0,1.2681127877083334,0.0,0.0
-Naive,13.064516129032262,-7.297793646802875,0.0,1.2969351423177082,0.0,0.0
-Drift,11.935483870967742,0.404190086867684,0.0,1.3917920932291667,0.0,0.0

tables/domain_health/leaderboard_WAPE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-t0-beta,69.35483870967742,31.825509329175105,0.0,0.3917621968260694,0.0,0.0
-TimesFM-2.5,68.06451612903226,30.236433011588616,0.0,1.1256479395833334,0.0,0.0
-TiRex-2,66.45161290322581,26.601930748682324,0.0,0.3575023838736039,0.0,0.0
-TabPFN-TS-3,65.80645161290323,27.06736057976333,0.0,199.6776895770319,0.0,0.0
-TimesFM-3,65.80645161290323,28.488597477387366,0.0,2.004992396905436,0.0,0.0
-Chronos-2,63.548387096774206,29.12048347898083,0.0,0.3492251116666667,0.0,0.0
-TS-ICL,61.61290322580646,28.45442598437944,0.0,1.3692244438010608,0.0,0.0
-Toto-2.0-2.5B,61.61290322580646,23.803402469752132,0.0,5.925324101666666,0.0,0.0
-TiRex,61.61290322580646,29.759653720585042,0.0,0.330588668125,0.0,0.0
-citras-fm,61.61290322580645,29.549083444333757,0.0,0.3327079909164846,0.0,0.0
-FlowState,60.64516129032258,25.714346434991153,0.0,1.679734656979167,0.0,0.0
-Moirai-2.0,57.90322580645161,31.595921669939887,0.0,0.3505868739583333,0.1,0.0
-Toto-1.0,57.41935483870968,28.753205083598854,0.0,9.804296426666667,0.0,0.0
-Toto-2.0-313m,56.774193548387096,23.159110215973843,0.0,1.1242909435416668,0.0,0.0
-Toto-2.0-22m,56.774193548387096,23.737937635347716,0.0,0.4238227016666667,0.0,0.0
-Toto-2.0-1B,56.12903225806451,22.479955103457115,0.0,2.728815209166667,0.0,0.0
-AutoETS,55.483870967741936,29.45241897965094,0.0,2.5273205354166666,0.0,0.0
-TabPFN-TS,54.83870967741935,29.1761523445201,0.0,53.951610824166664,0.0,0.0
-Stat. Ensemble,54.83870967741935,29.6956210738891,0.0,191.30953815208332,0.0,0.0
-Toto-2.0-4m,52.903225806451616,24.961571876693643,0.0,0.36290417583333334,0.0,0.0
-LightGBM,52.58064516129032,28.23998648969035,1.2161332720833333,0.19742606979166666,0.0,0.0
-Chronos-Bolt,49.83870967741935,25.883263022341175,0.0,0.41178704374999997,0.0,0.0
-CatBoost,46.774193548387096,24.80079887494443,13.210264008932292,0.19426541770833333,0.0,0.0
-Sundial-Base,39.03225806451613,16.462366143379946,0.0,8.29280267,0.0,0.0
-AutoARIMA,34.83870967741935,15.90999185953288,0.0,7.6933014760416665,0.0,0.0
-AutoTheta,28.064516129032256,14.265515876146328,0.0,2.3246237520833333,0.0,0.0
-DeepAR,26.129032258064523,4.835755105983619,1252.3585836206248,0.9790481578125001,0.0,0.0
-Drift,24.193548387096776,6.995102476216641,0.0,1.3917920932291667,0.0,0.0
-TFT,23.548387096774192,-0.6246028567987283,577.3621929408333,0.91290832015625,0.0,0.0
-Naive,22.741935483870968,0.09410405602899852,0.0,1.2969351423177082,0.0,0.0
-Seasonal Naive,22.741935483870968,0.0,0.0,1.2681127877083334,0.0,0.0
-PatchTST,20.32258064516129,2.754946880183251,812.3820815818749,0.4485787422916667,0.0,0.0

tables/domain_health/leaderboard_WQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-t0-beta,75.80645161290323,42.00290308322947,0.0,0.3917621968260694,0.0,0.0
-Chronos-2,70.64516129032258,40.421377709866235,0.0,0.3492251116666667,0.0,0.0
-TimesFM-3,70.3225806451613,39.61464192039935,0.0,2.004992396905436,0.0,0.0
-TimesFM-2.5,69.6774193548387,40.552489916172874,0.0,1.1256479395833334,0.0,0.0
-TiRex-2,68.06451612903226,37.313049400685664,0.0,0.3575023838736039,0.0,0.0
-citras-fm,67.74193548387096,40.356679864874486,0.0,0.3327079909164846,0.0,0.0
-TabPFN-TS-3,65.80645161290322,37.518925534209544,0.0,199.6776895770319,0.0,0.0
-Moirai-2.0,65.32258064516128,41.64215770095807,0.0,0.3505868739583333,0.1,0.0
-TS-ICL,62.58064516129031,38.86640859412728,0.0,1.3692244438010608,0.0,0.0
-Toto-2.0-2.5B,61.935483870967744,34.86494484839163,0.0,5.925324101666666,0.0,0.0
-Toto-2.0-313m,61.935483870967744,34.84636139478182,0.0,1.1242909435416668,0.0,0.0
-TiRex,61.29032258064516,38.88592212674449,0.0,0.330588668125,0.0,0.0
-Toto-2.0-22m,60.32258064516128,35.47613872211428,0.0,0.4238227016666667,0.0,0.0
-Toto-1.0,60.00000000000001,40.320844847410996,0.0,9.804296426666667,0.0,0.0
-Toto-2.0-1B,59.354838709677416,34.52744790415115,0.0,2.728815209166667,0.0,0.0
-FlowState,56.451612903225815,36.31335951896396,0.0,1.679734656979167,0.0,0.0
-Chronos-Bolt,55.96774193548387,38.083893021927985,0.0,0.41178704374999997,0.0,0.0
-TabPFN-TS,55.80645161290323,38.14282869293443,0.0,53.951610824166664,0.0,0.0
-Stat. Ensemble,52.58064516129033,33.50707751988894,0.0,191.30953815208332,0.0,0.0
-AutoETS,52.58064516129033,32.19312847125849,0.0,2.5273205354166666,0.0,0.0
-Toto-2.0-4m,52.25806451612903,35.62915272518256,0.0,0.36290417583333334,0.0,0.0
-LightGBM,35.16129032258065,25.255259089696292,1.2161332720833333,0.19742606979166666,0.0,0.0
-AutoARIMA,34.51612903225807,19.925031039747566,0.0,7.6933014760416665,0.0,0.0
-Sundial-Base,34.19354838709677,24.248203702135108,0.0,8.29280267,0.0,0.0
-CatBoost,29.03225806451613,21.67302472205549,13.210264008932292,0.19426541770833333,0.0,0.0
-DeepAR,28.70967741935484,15.68929320376099,1252.3585836206248,0.9790481578125001,0.0,0.0
-AutoTheta,27.419354838709676,18.143895495008643,0.0,2.3246237520833333,0.0,0.0
-PatchTST,24.516129032258068,15.548311275264371,812.3820815818749,0.4485787422916667,0.0,0.0
-TFT,23.87096774193548,6.246826522995086,577.3621929408333,0.91290832015625,0.0,0.0
-Seasonal Naive,20.806451612903224,0.0,0.0,1.2681127877083334,0.0,0.0
-Drift,18.387096774193544,0.8421348846480603,0.0,1.3917920932291667,0.0,0.0
-Naive,16.93548387096774,-6.552998310854519,0.0,1.2969351423177082,0.0,0.0

tables/domain_health/pairwise_MASE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,TiRex-2,0.5,0.2,0.8,-0.01,-0.092,0.039
-TimesFM-3,TimesFM-2.5,0.6,0.3,0.9,0.021,-0.019,0.07
-TimesFM-3,t0-beta,0.7,0.4,1.0,-0.002,-0.105,0.056
-TimesFM-3,Chronos-2,0.7,0.4,1.0,0.037,-0.053,0.108
-TimesFM-3,LightGBM,0.7,0.4,0.9,0.014,-0.118,0.138
-TimesFM-3,TabPFN-TS-3,0.6,0.3,0.9,0.075,-0.004,0.16
-TimesFM-3,FlowState,0.4,0.1,0.7,0.088,-0.011,0.198
-TimesFM-3,TabPFN-TS,0.8,0.5,1.0,-0.004,-0.143,0.075
-TimesFM-3,CatBoost,0.7,0.4,0.9,0.017,-0.118,0.135
-TimesFM-3,TiRex,0.7,0.4,0.9,0.027,-0.061,0.09
-TimesFM-3,citras-fm,0.8,0.5,1.0,0.023,-0.089,0.112
-TimesFM-3,TS-ICL,0.7,0.4,1.0,0.035,-0.099,0.121
-TimesFM-3,Toto-2.0-313m,0.7,0.4,0.902,0.098,0.045,0.148
-TimesFM-3,Moirai-2.0,0.7,0.4,1.0,0.008,-0.075,0.072
-TimesFM-3,Chronos-Bolt,0.8,0.5,1.0,0.061,-0.0,0.12
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.343,0.221,0.477
-TiRex-2,TimesFM-3,0.5,0.2,0.8,0.009,-0.041,0.084
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-2.5,0.6,0.3,0.9,0.03,-0.041,0.111
-TiRex-2,t0-beta,0.6,0.3,0.9,0.007,-0.022,0.035
-TiRex-2,Chronos-2,0.7,0.4,0.9,0.046,0.007,0.092
-TiRex-2,LightGBM,0.5,0.2,0.8,0.023,-0.068,0.13
-TiRex-2,TabPFN-TS-3,0.7,0.4,0.9,0.084,0.014,0.165
-TiRex-2,FlowState,0.6,0.3,0.9,0.097,-0.012,0.196
-TiRex-2,TabPFN-TS,0.7,0.4,1.0,0.006,-0.051,0.055
-TiRex-2,CatBoost,0.5,0.2,0.8,0.026,-0.061,0.126
-TiRex-2,TiRex,0.9,0.7,1.0,0.036,0.002,0.069
-TiRex-2,citras-fm,0.7,0.4,1.0,0.032,-0.021,0.091
-TiRex-2,TS-ICL,0.8,0.5,1.0,0.044,-0.014,0.093
-TiRex-2,Toto-2.0-313m,0.7,0.4,0.902,0.107,0.031,0.187
-TiRex-2,Moirai-2.0,0.8,0.6,1.0,0.017,-0.034,0.061
-TiRex-2,Chronos-Bolt,0.8,0.6,1.0,0.07,0.005,0.131
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.349,0.2,0.495
-TimesFM-2.5,TimesFM-3,0.4,0.1,0.7,-0.022,-0.075,0.019
-TimesFM-2.5,TiRex-2,0.4,0.1,0.7,-0.031,-0.125,0.04
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,t0-beta,0.6,0.3,0.9,-0.024,-0.142,0.061
-TimesFM-2.5,Chronos-2,0.5,0.2,0.8,0.016,-0.093,0.11
-TimesFM-2.5,LightGBM,0.5,0.2,0.8,-0.008,-0.151,0.132
-TimesFM-2.5,TabPFN-TS-3,0.4,0.1,0.7,0.055,-0.033,0.157
-TimesFM-2.5,FlowState,0.6,0.3,0.9,0.069,-0.018,0.168
-TimesFM-2.5,TabPFN-TS,0.7,0.4,1.0,-0.026,-0.178,0.069
-TimesFM-2.5,CatBoost,0.5,0.2,0.8,-0.004,-0.149,0.123
-TimesFM-2.5,TiRex,0.7,0.4,0.9,0.006,-0.088,0.075
-TimesFM-2.5,citras-fm,0.6,0.3,0.9,0.002,-0.132,0.117
-TimesFM-2.5,TS-ICL,0.6,0.3,0.9,0.014,-0.132,0.123
-TimesFM-2.5,Toto-2.0-313m,0.6,0.3,0.9,0.079,0.006,0.154
-TimesFM-2.5,Moirai-2.0,0.6,0.3,0.9,-0.014,-0.094,0.036
-TimesFM-2.5,Chronos-Bolt,0.8,0.6,1.0,0.041,-0.026,0.112
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.329,0.204,0.472
-t0-beta,TimesFM-3,0.3,0.0,0.6,0.002,-0.06,0.095
-t0-beta,TiRex-2,0.4,0.1,0.7,-0.007,-0.037,0.022
-t0-beta,TimesFM-2.5,0.4,0.1,0.7,0.023,-0.064,0.124
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Chronos-2,0.6,0.3,0.9,0.039,-0.001,0.079
-t0-beta,LightGBM,0.4,0.1,0.7,0.016,-0.083,0.125
-t0-beta,TabPFN-TS-3,0.5,0.2,0.8,0.077,0.001,0.158
-t0-beta,FlowState,0.5,0.2,0.8,0.09,-0.025,0.2
-t0-beta,TabPFN-TS,0.4,0.1,0.7,-0.002,-0.043,0.04
-t0-beta,CatBoost,0.5,0.2,0.8,0.019,-0.068,0.12
-t0-beta,TiRex,0.5,0.2,0.8,0.029,-0.009,0.067
-t0-beta,citras-fm,0.6,0.3,0.9,0.025,-0.024,0.076
-t0-beta,TS-ICL,0.7,0.4,1.0,0.037,0.0,0.073
-t0-beta,Toto-2.0-313m,0.8,0.5,1.0,0.1,0.014,0.194
-t0-beta,Moirai-2.0,0.7,0.4,0.902,0.01,-0.048,0.058
-t0-beta,Chronos-Bolt,0.7,0.4,0.902,0.063,0.003,0.127
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.344,0.186,0.49
-Chronos-2,TimesFM-3,0.3,0.0,0.6,-0.038,-0.121,0.051
-Chronos-2,TiRex-2,0.3,0.1,0.6,-0.048,-0.102,-0.007
-Chronos-2,TimesFM-2.5,0.5,0.2,0.8,-0.016,-0.124,0.085
-Chronos-2,t0-beta,0.4,0.1,0.7,-0.04,-0.085,0.001
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,LightGBM,0.4,0.1,0.7,-0.024,-0.166,0.118
-Chronos-2,TabPFN-TS-3,0.5,0.2,0.8,0.04,-0.012,0.095
-Chronos-2,FlowState,0.6,0.3,0.9,0.053,-0.056,0.143
-Chronos-2,TabPFN-TS,0.5,0.2,0.8,-0.042,-0.101,0.001
-Chronos-2,CatBoost,0.5,0.2,0.8,-0.021,-0.154,0.112
-Chronos-2,TiRex,0.6,0.3,0.9,-0.01,-0.052,0.023
-Chronos-2,citras-fm,0.6,0.3,0.9,-0.014,-0.054,0.022
-Chronos-2,TS-ICL,0.7,0.4,0.902,-0.002,-0.049,0.04
-Chronos-2,Toto-2.0-313m,0.6,0.3,0.9,0.064,-0.022,0.16
-Chronos-2,Moirai-2.0,0.7,0.4,0.9,-0.03,-0.114,0.028
-Chronos-2,Chronos-Bolt,0.8,0.6,1.0,0.025,-0.04,0.08
-Chronos-2,Seasonal Naive,0.9,0.7,1.0,0.318,0.17,0.455
-LightGBM,TimesFM-3,0.3,0.1,0.6,-0.014,-0.16,0.106
-LightGBM,TiRex-2,0.5,0.2,0.8,-0.023,-0.149,0.064
-LightGBM,TimesFM-2.5,0.5,0.2,0.8,0.008,-0.152,0.131
-LightGBM,t0-beta,0.6,0.3,0.9,-0.016,-0.143,0.076
-LightGBM,Chronos-2,0.6,0.3,0.9,0.024,-0.134,0.142
-LightGBM,LightGBM,0.5,0.5,0.5,0.0,0.0,0.0
-LightGBM,TabPFN-TS-3,0.5,0.2,0.8,0.062,-0.124,0.203
-LightGBM,FlowState,0.4,0.1,0.7,0.076,-0.119,0.233
-LightGBM,TabPFN-TS,0.5,0.2,0.8,-0.018,-0.155,0.089
-LightGBM,CatBoost,0.6,0.3,0.9,0.003,-0.02,0.028
-LightGBM,TiRex,0.5,0.2,0.8,0.014,-0.136,0.114
-LightGBM,citras-fm,0.5,0.2,0.8,0.009,-0.136,0.138
-LightGBM,TS-ICL,0.6,0.3,0.9,0.022,-0.128,0.138
-LightGBM,Toto-2.0-313m,0.7,0.4,0.902,0.086,-0.093,0.211
-LightGBM,Moirai-2.0,0.6,0.3,0.9,-0.006,-0.147,0.089
-LightGBM,Chronos-Bolt,0.6,0.3,0.9,0.048,-0.118,0.168
-LightGBM,Seasonal Naive,0.8,0.5,1.0,0.334,0.122,0.504
-TabPFN-TS-3,TimesFM-3,0.4,0.1,0.7,-0.081,-0.191,0.004
-TabPFN-TS-3,TiRex-2,0.3,0.1,0.6,-0.091,-0.198,-0.014
-TabPFN-TS-3,TimesFM-2.5,0.6,0.3,0.9,-0.058,-0.186,0.032
-TabPFN-TS-3,t0-beta,0.5,0.2,0.8,-0.084,-0.188,-0.001
-TabPFN-TS-3,Chronos-2,0.5,0.2,0.8,-0.041,-0.105,0.012
-TabPFN-TS-3,LightGBM,0.5,0.2,0.8,-0.066,-0.255,0.11
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,FlowState,0.6,0.3,0.9,0.014,-0.051,0.075
-TabPFN-TS-3,TabPFN-TS,0.4,0.1,0.7,-0.085,-0.189,-0.005
-TabPFN-TS-3,CatBoost,0.5,0.2,0.8,-0.063,-0.234,0.102
-TabPFN-TS-3,TiRex,0.4,0.1,0.7,-0.052,-0.134,0.003
-TabPFN-TS-3,citras-fm,0.4,0.1,0.7,-0.056,-0.156,0.029
-TabPFN-TS-3,TS-ICL,0.6,0.3,0.9,-0.043,-0.148,0.045
-TabPFN-TS-3,Toto-2.0-313m,0.7,0.4,1.0,0.025,-0.09,0.121
-TabPFN-TS-3,Moirai-2.0,0.6,0.3,0.9,-0.073,-0.185,0.003
-TabPFN-TS-3,Chronos-Bolt,0.6,0.3,0.9,-0.015,-0.067,0.028
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.29,0.176,0.398
-FlowState,TimesFM-3,0.6,0.3,0.9,-0.097,-0.247,0.011
-FlowState,TiRex-2,0.4,0.1,0.7,-0.107,-0.244,0.012
-FlowState,TimesFM-2.5,0.4,0.1,0.7,-0.074,-0.201,0.018
-FlowState,t0-beta,0.5,0.2,0.8,-0.099,-0.25,0.025
-FlowState,Chronos-2,0.4,0.1,0.7,-0.056,-0.167,0.053
-FlowState,LightGBM,0.6,0.3,0.9,-0.082,-0.303,0.107
-FlowState,TabPFN-TS-3,0.4,0.1,0.7,-0.014,-0.081,0.048
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TabPFN-TS,0.5,0.2,0.8,-0.101,-0.239,0.014
-FlowState,CatBoost,0.6,0.3,0.9,-0.078,-0.28,0.101
-FlowState,TiRex,0.5,0.2,0.8,-0.067,-0.171,0.025
-FlowState,citras-fm,0.6,0.3,0.9,-0.072,-0.213,0.064
-FlowState,TS-ICL,0.4,0.1,0.7,-0.058,-0.213,0.078
-FlowState,Toto-2.0-313m,0.5,0.2,0.8,0.011,-0.144,0.134
-FlowState,Moirai-2.0,0.5,0.2,0.8,-0.088,-0.212,0.013
-FlowState,Chronos-Bolt,0.7,0.4,0.902,-0.03,-0.119,0.052
-FlowState,Seasonal Naive,0.9,0.7,1.0,0.279,0.18,0.379
-TabPFN-TS,TimesFM-3,0.2,0.0,0.5,0.004,-0.081,0.125
-TabPFN-TS,TiRex-2,0.3,0.0,0.6,-0.006,-0.059,0.049
-TabPFN-TS,TimesFM-2.5,0.3,0.0,0.6,0.025,-0.074,0.151
-TabPFN-TS,t0-beta,0.6,0.3,0.9,0.002,-0.042,0.041
-TabPFN-TS,Chronos-2,0.5,0.2,0.8,0.041,-0.001,0.091
-TabPFN-TS,LightGBM,0.5,0.2,0.8,0.017,-0.098,0.134
-TabPFN-TS,TabPFN-TS-3,0.6,0.3,0.9,0.079,0.005,0.159
-TabPFN-TS,FlowState,0.5,0.2,0.8,0.092,-0.014,0.193
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,CatBoost,0.5,0.2,0.8,0.021,-0.082,0.123
-TabPFN-TS,TiRex,0.5,0.2,0.8,0.031,-0.006,0.079
-TabPFN-TS,citras-fm,0.5,0.2,0.8,0.027,-0.025,0.087
-TabPFN-TS,TS-ICL,0.6,0.3,0.9,0.039,-0.001,0.082
-TabPFN-TS,Toto-2.0-313m,0.5,0.2,0.8,0.102,-0.005,0.22
-TabPFN-TS,Moirai-2.0,0.6,0.3,0.9,0.011,-0.055,0.076
-TabPFN-TS,Chronos-Bolt,0.6,0.3,0.9,0.065,-0.002,0.145
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.346,0.194,0.48
-CatBoost,TimesFM-3,0.3,0.1,0.6,-0.017,-0.157,0.105
-CatBoost,TiRex-2,0.5,0.2,0.8,-0.027,-0.144,0.058
-CatBoost,TimesFM-2.5,0.5,0.2,0.8,0.004,-0.14,0.129
-CatBoost,t0-beta,0.5,0.2,0.8,-0.019,-0.136,0.064
-CatBoost,Chronos-2,0.5,0.2,0.8,0.02,-0.127,0.134
-CatBoost,LightGBM,0.4,0.1,0.7,-0.003,-0.029,0.019
-CatBoost,TabPFN-TS-3,0.5,0.2,0.8,0.059,-0.114,0.189
-CatBoost,FlowState,0.4,0.1,0.7,0.073,-0.112,0.218
-CatBoost,TabPFN-TS,0.5,0.2,0.8,-0.021,-0.14,0.076
-CatBoost,CatBoost,0.5,0.5,0.5,0.0,0.0,0.0
-CatBoost,TiRex,0.5,0.2,0.8,0.01,-0.126,0.107
-CatBoost,citras-fm,0.5,0.2,0.8,0.006,-0.137,0.13
-CatBoost,TS-ICL,0.5,0.2,0.8,0.019,-0.118,0.129
-CatBoost,Toto-2.0-313m,0.7,0.4,0.902,0.083,-0.083,0.213
-CatBoost,Moirai-2.0,0.6,0.3,0.9,-0.009,-0.137,0.079
-CatBoost,Chronos-Bolt,0.6,0.3,0.9,0.045,-0.115,0.157
-CatBoost,Seasonal Naive,0.8,0.5,1.0,0.332,0.125,0.498
-TiRex,TimesFM-3,0.3,0.1,0.6,-0.028,-0.099,0.057
-TiRex,TiRex-2,0.1,0.0,0.3,-0.038,-0.075,-0.002
-TiRex,TimesFM-2.5,0.3,0.1,0.6,-0.006,-0.081,0.081
-TiRex,t0-beta,0.5,0.2,0.8,-0.03,-0.072,0.009
-TiRex,Chronos-2,0.4,0.1,0.7,0.01,-0.024,0.049
-TiRex,LightGBM,0.5,0.2,0.8,-0.014,-0.129,0.119
-TiRex,TabPFN-TS-3,0.6,0.3,0.9,0.049,-0.003,0.118
-TiRex,FlowState,0.5,0.2,0.8,0.063,-0.026,0.146
-TiRex,TabPFN-TS,0.5,0.2,0.8,-0.032,-0.085,0.006
-TiRex,CatBoost,0.5,0.2,0.8,-0.01,-0.12,0.112
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,citras-fm,0.3,0.1,0.6,-0.004,-0.05,0.057
-TiRex,TS-ICL,0.5,0.2,0.8,0.008,-0.052,0.066
-TiRex,Toto-2.0-313m,0.5,0.2,0.8,0.073,-0.012,0.166
-TiRex,Moirai-2.0,0.7,0.4,0.9,-0.02,-0.063,0.015
-TiRex,Chronos-Bolt,0.7,0.4,0.9,0.035,-0.013,0.085
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.325,0.184,0.464
-citras-fm,TimesFM-3,0.2,0.0,0.5,-0.023,-0.126,0.082
-citras-fm,TiRex-2,0.3,0.0,0.6,-0.033,-0.1,0.021
-citras-fm,TimesFM-2.5,0.4,0.1,0.7,-0.002,-0.132,0.116
-citras-fm,t0-beta,0.4,0.1,0.7,-0.026,-0.082,0.023
-citras-fm,Chronos-2,0.4,0.1,0.7,0.014,-0.023,0.051
-citras-fm,LightGBM,0.5,0.2,0.8,-0.009,-0.16,0.12
-citras-fm,TabPFN-TS-3,0.6,0.3,0.9,0.053,-0.03,0.135
-citras-fm,FlowState,0.4,0.1,0.7,0.067,-0.069,0.176
-citras-fm,TabPFN-TS,0.5,0.2,0.8,-0.027,-0.095,0.024
-citras-fm,CatBoost,0.5,0.2,0.8,-0.006,-0.15,0.12
-citras-fm,TiRex,0.7,0.4,0.9,0.004,-0.06,0.048
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,TS-ICL,0.4,0.1,0.7,0.013,-0.029,0.06
-citras-fm,Toto-2.0-313m,0.4,0.1,0.7,0.077,-0.026,0.187
-citras-fm,Moirai-2.0,0.6,0.3,0.9,-0.016,-0.119,0.055
-citras-fm,Chronos-Bolt,0.6,0.3,0.9,0.039,-0.054,0.115
-citras-fm,Seasonal Naive,0.9,0.7,1.0,0.328,0.157,0.481
-TS-ICL,TimesFM-3,0.3,0.0,0.6,-0.036,-0.137,0.09
-TS-ICL,TiRex-2,0.2,0.0,0.5,-0.046,-0.103,0.014
-TS-ICL,TimesFM-2.5,0.4,0.1,0.7,-0.014,-0.14,0.117
-TS-ICL,t0-beta,0.3,0.0,0.6,-0.039,-0.078,-0.0
-TS-ICL,Chronos-2,0.3,0.098,0.6,0.002,-0.042,0.047
-TS-ICL,LightGBM,0.4,0.1,0.7,-0.022,-0.16,0.113
-TS-ICL,TabPFN-TS-3,0.4,0.1,0.7,0.041,-0.047,0.129
-TS-ICL,FlowState,0.6,0.3,0.9,0.055,-0.084,0.176
-TS-ICL,TabPFN-TS,0.4,0.1,0.7,-0.041,-0.089,0.001
-TS-ICL,CatBoost,0.5,0.2,0.8,-0.019,-0.148,0.105
-TS-ICL,TiRex,0.5,0.2,0.8,-0.008,-0.07,0.049
-TS-ICL,citras-fm,0.6,0.3,0.9,-0.013,-0.064,0.028
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,Toto-2.0-313m,0.3,0.0,0.6,0.065,-0.02,0.185
-TS-ICL,Moirai-2.0,0.5,0.2,0.8,-0.029,-0.125,0.049
-TS-ICL,Chronos-Bolt,0.7,0.4,0.9,0.027,-0.061,0.114
-TS-ICL,Seasonal Naive,0.9,0.7,1.0,0.319,0.142,0.473
-Toto-2.0-313m,TimesFM-3,0.3,0.098,0.6,-0.109,-0.173,-0.048
-Toto-2.0-313m,TiRex-2,0.3,0.098,0.6,-0.12,-0.231,-0.032
-Toto-2.0-313m,TimesFM-2.5,0.4,0.1,0.7,-0.086,-0.182,-0.006
-Toto-2.0-313m,t0-beta,0.2,0.0,0.5,-0.111,-0.241,-0.014
-Toto-2.0-313m,Chronos-2,0.4,0.1,0.7,-0.068,-0.19,0.022
-Toto-2.0-313m,LightGBM,0.3,0.098,0.6,-0.094,-0.268,0.085
-Toto-2.0-313m,TabPFN-TS-3,0.3,0.0,0.6,-0.026,-0.138,0.082
-Toto-2.0-313m,FlowState,0.5,0.2,0.8,-0.011,-0.155,0.126
-Toto-2.0-313m,TabPFN-TS,0.5,0.2,0.8,-0.113,-0.282,0.005
-Toto-2.0-313m,CatBoost,0.3,0.098,0.6,-0.09,-0.27,0.077
-Toto-2.0-313m,TiRex,0.5,0.2,0.8,-0.079,-0.199,0.012
-Toto-2.0-313m,citras-fm,0.6,0.3,0.9,-0.084,-0.23,0.025
-Toto-2.0-313m,TS-ICL,0.7,0.4,1.0,-0.07,-0.227,0.019
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Moirai-2.0,0.4,0.1,0.7,-0.101,-0.229,0.01
-Toto-2.0-313m,Chronos-Bolt,0.7,0.4,1.0,-0.042,-0.144,0.049
-Toto-2.0-313m,Seasonal Naive,0.8,0.6,1.0,0.271,0.114,0.434
-Moirai-2.0,TimesFM-3,0.3,0.0,0.6,-0.008,-0.078,0.07
-Moirai-2.0,TiRex-2,0.2,0.0,0.4,-0.017,-0.065,0.033
-Moirai-2.0,TimesFM-2.5,0.4,0.1,0.7,0.014,-0.037,0.086
-Moirai-2.0,t0-beta,0.3,0.098,0.6,-0.01,-0.062,0.045
-Moirai-2.0,Chronos-2,0.3,0.1,0.6,0.029,-0.029,0.102
-Moirai-2.0,LightGBM,0.4,0.1,0.7,0.006,-0.097,0.128
-Moirai-2.0,TabPFN-TS-3,0.4,0.1,0.7,0.068,-0.003,0.156
-Moirai-2.0,FlowState,0.5,0.2,0.8,0.081,-0.013,0.175
-Moirai-2.0,TabPFN-TS,0.4,0.1,0.7,-0.012,-0.082,0.052
-Moirai-2.0,CatBoost,0.4,0.1,0.7,0.009,-0.086,0.121
-Moirai-2.0,TiRex,0.3,0.1,0.6,0.02,-0.015,0.059
-Moirai-2.0,citras-fm,0.4,0.1,0.7,0.015,-0.058,0.106
-Moirai-2.0,TS-ICL,0.5,0.2,0.8,0.028,-0.052,0.111
-Moirai-2.0,Toto-2.0-313m,0.6,0.3,0.9,0.091,-0.01,0.186
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Chronos-Bolt,0.75,0.45,1.0,0.054,0.003,0.111
-Moirai-2.0,Seasonal Naive,1.0,1.0,1.0,0.338,0.203,0.482
-Chronos-Bolt,TimesFM-3,0.2,0.0,0.5,-0.065,-0.137,0.0
-Chronos-Bolt,TiRex-2,0.2,0.0,0.4,-0.075,-0.151,-0.005
-Chronos-Bolt,TimesFM-2.5,0.2,0.0,0.4,-0.042,-0.127,0.025
-Chronos-Bolt,t0-beta,0.3,0.098,0.6,-0.067,-0.145,-0.003
-Chronos-Bolt,Chronos-2,0.2,0.0,0.4,-0.026,-0.087,0.038
-Chronos-Bolt,LightGBM,0.4,0.1,0.7,-0.05,-0.201,0.106
-Chronos-Bolt,TabPFN-TS-3,0.4,0.1,0.7,0.015,-0.029,0.063
-Chronos-Bolt,FlowState,0.3,0.098,0.6,0.029,-0.055,0.107
-Chronos-Bolt,TabPFN-TS,0.4,0.1,0.7,-0.069,-0.169,0.002
-Chronos-Bolt,CatBoost,0.4,0.1,0.7,-0.047,-0.186,0.103
-Chronos-Bolt,TiRex,0.3,0.1,0.6,-0.036,-0.092,0.013
-Chronos-Bolt,citras-fm,0.4,0.1,0.7,-0.04,-0.129,0.051
-Chronos-Bolt,TS-ICL,0.3,0.1,0.6,-0.027,-0.129,0.058
-Chronos-Bolt,Toto-2.0-313m,0.3,0.0,0.6,0.04,-0.052,0.126
-Chronos-Bolt,Moirai-2.0,0.25,0.0,0.55,-0.057,-0.125,-0.003
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.3,0.183,0.423
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.522,-0.913,-0.283
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.536,-0.978,-0.25
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.49,-0.893,-0.257
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.525,-0.959,-0.228
-Seasonal Naive,Chronos-2,0.1,0.0,0.3,-0.466,-0.835,-0.204
-Seasonal Naive,LightGBM,0.2,0.0,0.5,-0.501,-1.017,-0.14
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.408,-0.661,-0.214
-Seasonal Naive,FlowState,0.1,0.0,0.3,-0.388,-0.61,-0.22
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.528,-0.922,-0.241
-Seasonal Naive,CatBoost,0.2,0.0,0.5,-0.496,-0.991,-0.143
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.481,-0.865,-0.226
-Seasonal Naive,citras-fm,0.1,0.0,0.3,-0.487,-0.927,-0.187
-Seasonal Naive,TS-ICL,0.1,0.0,0.3,-0.468,-0.898,-0.165
-Seasonal Naive,Toto-2.0-313m,0.2,0.0,0.4,-0.372,-0.767,-0.129
-Seasonal Naive,Moirai-2.0,0.0,0.0,0.0,-0.51,-0.93,-0.255
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.429,-0.732,-0.224
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_health/pairwise_SQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,TiRex-2,0.6,0.3,0.9,0.004,-0.072,0.054
-TimesFM-3,t0-beta,0.7,0.4,1.0,-0.002,-0.097,0.051
-TimesFM-3,Chronos-2,0.7,0.4,1.0,0.026,-0.068,0.095
-TimesFM-3,TimesFM-2.5,0.6,0.3,0.9,0.027,-0.016,0.069
-TimesFM-3,Toto-2.0-313m,0.7,0.4,0.902,0.089,0.038,0.138
-TimesFM-3,Toto-2.0-2.5B,0.7,0.4,1.0,0.092,0.027,0.16
-TimesFM-3,citras-fm,0.8,0.5,1.0,0.029,-0.079,0.112
-TimesFM-3,TabPFN-TS,0.9,0.7,1.0,0.03,-0.065,0.097
-TimesFM-3,TabPFN-TS-3,0.7,0.4,1.0,0.088,0.007,0.174
-TimesFM-3,TiRex,0.7,0.4,0.9,0.044,-0.03,0.103
-TimesFM-3,TS-ICL,0.7,0.4,1.0,0.047,-0.069,0.121
-TimesFM-3,Moirai-2.0,0.7,0.4,1.0,0.016,-0.064,0.08
-TimesFM-3,Toto-2.0-1B,0.8,0.5,1.0,0.103,0.049,0.154
-TimesFM-3,Toto-2.0-22m,0.7,0.4,1.0,0.09,0.028,0.151
-TimesFM-3,Chronos-Bolt,0.7,0.4,1.0,0.05,-0.013,0.11
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.397,0.274,0.524
-TiRex-2,TimesFM-3,0.4,0.1,0.7,-0.004,-0.057,0.067
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,t0-beta,0.5,0.2,0.8,-0.006,-0.035,0.025
-TiRex-2,Chronos-2,0.7,0.4,1.0,0.022,-0.01,0.059
-TiRex-2,TimesFM-2.5,0.7,0.4,0.902,0.022,-0.04,0.096
-TiRex-2,Toto-2.0-313m,0.6,0.3,0.9,0.085,0.014,0.154
-TiRex-2,Toto-2.0-2.5B,0.7,0.4,1.0,0.088,0.023,0.15
-TiRex-2,citras-fm,0.6,0.3,0.9,0.025,-0.026,0.083
-TiRex-2,TabPFN-TS,0.8,0.5,1.0,0.026,-0.001,0.06
-TiRex-2,TabPFN-TS-3,0.8,0.5,1.0,0.084,0.022,0.151
-TiRex-2,TiRex,0.9,0.7,1.0,0.04,0.008,0.069
-TiRex-2,TS-ICL,0.8,0.5,1.0,0.043,-0.005,0.087
-TiRex-2,Moirai-2.0,0.7,0.4,0.9,0.012,-0.031,0.053
-TiRex-2,Toto-2.0-1B,0.8,0.5,1.0,0.099,0.03,0.163
-TiRex-2,Toto-2.0-22m,0.8,0.5,1.0,0.086,0.02,0.144
-TiRex-2,Chronos-Bolt,0.8,0.6,1.0,0.046,-0.007,0.098
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.394,0.256,0.521
-t0-beta,TimesFM-3,0.3,0.0,0.6,0.002,-0.053,0.088
-t0-beta,TiRex-2,0.5,0.2,0.8,0.006,-0.026,0.034
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Chronos-2,0.5,0.2,0.8,0.028,-0.009,0.072
-t0-beta,TimesFM-2.5,0.5,0.2,0.8,0.029,-0.05,0.116
-t0-beta,Toto-2.0-313m,0.8,0.5,1.0,0.091,0.011,0.174
-t0-beta,Toto-2.0-2.5B,0.7,0.4,0.9,0.094,0.019,0.161
-t0-beta,citras-fm,0.6,0.3,0.9,0.031,-0.014,0.083
-t0-beta,TabPFN-TS,0.7,0.4,1.0,0.032,-0.001,0.073
-t0-beta,TabPFN-TS-3,0.9,0.7,1.0,0.09,0.016,0.171
-t0-beta,TiRex,0.7,0.4,1.0,0.046,0.003,0.089
-t0-beta,TS-ICL,0.7,0.4,1.0,0.049,0.013,0.082
-t0-beta,Moirai-2.0,0.7,0.4,0.902,0.018,-0.028,0.062
-t0-beta,Toto-2.0-1B,0.8,0.5,1.0,0.105,0.023,0.178
-t0-beta,Toto-2.0-22m,0.7,0.4,1.0,0.092,0.018,0.158
-t0-beta,Chronos-Bolt,0.7,0.4,0.902,0.052,0.001,0.106
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.398,0.255,0.529
-Chronos-2,TimesFM-3,0.3,0.0,0.6,-0.026,-0.105,0.064
-Chronos-2,TiRex-2,0.3,0.0,0.6,-0.022,-0.062,0.01
-Chronos-2,t0-beta,0.5,0.2,0.8,-0.029,-0.077,0.008
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,TimesFM-2.5,0.5,0.2,0.8,0.001,-0.091,0.094
-Chronos-2,Toto-2.0-313m,0.7,0.4,0.902,0.065,-0.023,0.154
-Chronos-2,Toto-2.0-2.5B,0.6,0.3,0.9,0.068,-0.001,0.133
-Chronos-2,citras-fm,0.6,0.3,0.9,0.003,-0.037,0.043
-Chronos-2,TabPFN-TS,0.8,0.5,1.0,0.005,-0.032,0.03
-Chronos-2,TabPFN-TS-3,0.7,0.4,0.9,0.064,0.009,0.119
-Chronos-2,TiRex,0.7,0.4,0.9,0.019,-0.022,0.054
-Chronos-2,TS-ICL,0.8,0.5,1.0,0.021,-0.013,0.058
-Chronos-2,Moirai-2.0,0.7,0.4,0.9,-0.01,-0.086,0.045
-Chronos-2,Toto-2.0-1B,0.6,0.3,0.9,0.079,0.002,0.157
-Chronos-2,Toto-2.0-22m,0.8,0.6,1.0,0.066,-0.016,0.142
-Chronos-2,Chronos-Bolt,0.8,0.6,1.0,0.025,-0.035,0.08
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.381,0.242,0.504
-TimesFM-2.5,TimesFM-3,0.4,0.1,0.7,-0.027,-0.074,0.016
-TimesFM-2.5,TiRex-2,0.3,0.098,0.6,-0.023,-0.106,0.039
-TimesFM-2.5,t0-beta,0.5,0.2,0.8,-0.03,-0.132,0.048
-TimesFM-2.5,Chronos-2,0.5,0.2,0.8,-0.001,-0.104,0.084
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Toto-2.0-313m,0.6,0.3,0.9,0.064,-0.006,0.141
-TimesFM-2.5,Toto-2.0-2.5B,0.6,0.3,0.9,0.068,-0.024,0.165
-TimesFM-2.5,citras-fm,0.6,0.3,0.9,0.003,-0.116,0.114
-TimesFM-2.5,TabPFN-TS,0.7,0.4,1.0,0.004,-0.096,0.075
-TimesFM-2.5,TabPFN-TS-3,0.6,0.3,0.9,0.063,-0.014,0.15
-TimesFM-2.5,TiRex,0.7,0.4,0.9,0.018,-0.05,0.072
-TimesFM-2.5,TS-ICL,0.6,0.3,0.9,0.021,-0.102,0.114
-TimesFM-2.5,Moirai-2.0,0.7,0.4,0.9,-0.011,-0.085,0.035
-TimesFM-2.5,Toto-2.0-1B,0.7,0.4,1.0,0.078,0.004,0.156
-TimesFM-2.5,Toto-2.0-22m,0.5,0.2,0.8,0.065,-0.012,0.149
-TimesFM-2.5,Chronos-Bolt,0.7,0.4,1.0,0.024,-0.032,0.08
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.38,0.264,0.511
-Toto-2.0-313m,TimesFM-3,0.3,0.098,0.6,-0.098,-0.16,-0.04
-Toto-2.0-313m,TiRex-2,0.4,0.1,0.7,-0.093,-0.182,-0.014
-Toto-2.0-313m,t0-beta,0.2,0.0,0.5,-0.1,-0.21,-0.011
-Toto-2.0-313m,Chronos-2,0.3,0.098,0.6,-0.07,-0.182,0.022
-Toto-2.0-313m,TimesFM-2.5,0.4,0.1,0.7,-0.069,-0.164,0.006
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-2.5B,0.5,0.2,0.8,0.003,-0.049,0.056
-Toto-2.0-313m,citras-fm,0.7,0.4,1.0,-0.066,-0.195,0.03
-Toto-2.0-313m,TabPFN-TS,0.5,0.2,0.8,-0.065,-0.175,0.032
-Toto-2.0-313m,TabPFN-TS-3,0.4,0.1,0.7,-0.002,-0.106,0.105
-Toto-2.0-313m,TiRex,0.5,0.2,0.8,-0.05,-0.144,0.033
-Toto-2.0-313m,TS-ICL,0.6,0.3,0.9,-0.047,-0.171,0.034
-Toto-2.0-313m,Moirai-2.0,0.6,0.3,0.9,-0.08,-0.195,0.018
-Toto-2.0-313m,Toto-2.0-1B,0.5,0.2,0.8,0.015,-0.006,0.041
-Toto-2.0-313m,Toto-2.0-22m,0.7,0.4,1.0,0.001,-0.037,0.027
-Toto-2.0-313m,Chronos-Bolt,0.6,0.3,0.9,-0.043,-0.147,0.047
-Toto-2.0-313m,Seasonal Naive,0.9,0.7,1.0,0.338,0.182,0.488
-Toto-2.0-2.5B,TimesFM-3,0.3,0.0,0.6,-0.102,-0.191,-0.028
-Toto-2.0-2.5B,TiRex-2,0.3,0.0,0.6,-0.097,-0.177,-0.023
-Toto-2.0-2.5B,t0-beta,0.3,0.1,0.6,-0.104,-0.193,-0.02
-Toto-2.0-2.5B,Chronos-2,0.4,0.1,0.7,-0.073,-0.154,0.001
-Toto-2.0-2.5B,TimesFM-2.5,0.4,0.1,0.7,-0.072,-0.198,0.023
-Toto-2.0-2.5B,Toto-2.0-313m,0.5,0.2,0.8,-0.003,-0.059,0.046
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,citras-fm,0.5,0.2,0.8,-0.07,-0.157,0.004
-Toto-2.0-2.5B,TabPFN-TS,0.5,0.2,0.8,-0.068,-0.169,0.018
-Toto-2.0-2.5B,TabPFN-TS-3,0.5,0.2,0.8,-0.005,-0.107,0.091
-Toto-2.0-2.5B,TiRex,0.6,0.3,0.9,-0.053,-0.145,0.024
-Toto-2.0-2.5B,TS-ICL,0.5,0.2,0.8,-0.05,-0.14,0.019
-Toto-2.0-2.5B,Moirai-2.0,0.5,0.2,0.8,-0.084,-0.205,0.013
-Toto-2.0-2.5B,Toto-2.0-1B,0.7,0.4,0.9,0.011,-0.022,0.045
-Toto-2.0-2.5B,Toto-2.0-22m,0.6,0.3,0.9,-0.002,-0.046,0.032
-Toto-2.0-2.5B,Chronos-Bolt,0.6,0.3,0.9,-0.047,-0.159,0.041
-Toto-2.0-2.5B,Seasonal Naive,0.8,0.6,1.0,0.335,0.163,0.479
-citras-fm,TimesFM-3,0.2,0.0,0.5,-0.03,-0.126,0.073
-citras-fm,TiRex-2,0.4,0.1,0.7,-0.026,-0.091,0.026
-citras-fm,t0-beta,0.4,0.1,0.7,-0.032,-0.091,0.013
-citras-fm,Chronos-2,0.4,0.1,0.7,-0.003,-0.045,0.036
-citras-fm,TimesFM-2.5,0.4,0.1,0.7,-0.003,-0.128,0.104
-citras-fm,Toto-2.0-313m,0.3,0.0,0.6,0.062,-0.03,0.163
-citras-fm,Toto-2.0-2.5B,0.5,0.2,0.8,0.065,-0.004,0.136
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,TabPFN-TS,0.5,0.2,0.8,0.001,-0.074,0.06
-citras-fm,TabPFN-TS-3,0.6,0.3,0.9,0.061,-0.026,0.146
-citras-fm,TiRex,0.6,0.3,0.9,0.015,-0.051,0.069
-citras-fm,TS-ICL,0.4,0.1,0.7,0.018,-0.025,0.061
-citras-fm,Moirai-2.0,0.5,0.2,0.8,-0.013,-0.112,0.054
-citras-fm,Toto-2.0-1B,0.4,0.1,0.7,0.076,-0.007,0.165
-citras-fm,Toto-2.0-22m,0.5,0.2,0.8,0.063,-0.016,0.142
-citras-fm,Chronos-Bolt,0.5,0.2,0.8,0.022,-0.07,0.093
-citras-fm,Seasonal Naive,0.9,0.7,1.0,0.379,0.212,0.52
-TabPFN-TS,TimesFM-3,0.1,0.0,0.3,-0.031,-0.108,0.061
-TabPFN-TS,TiRex-2,0.2,0.0,0.5,-0.027,-0.064,0.001
-TabPFN-TS,t0-beta,0.3,0.0,0.6,-0.034,-0.079,0.001
-TabPFN-TS,Chronos-2,0.2,0.0,0.5,-0.005,-0.031,0.031
-TabPFN-TS,TimesFM-2.5,0.3,0.0,0.6,-0.004,-0.081,0.087
-TabPFN-TS,Toto-2.0-313m,0.5,0.2,0.8,0.061,-0.033,0.149
-TabPFN-TS,Toto-2.0-2.5B,0.5,0.2,0.8,0.064,-0.018,0.144
-TabPFN-TS,citras-fm,0.5,0.2,0.8,-0.001,-0.064,0.069
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,TabPFN-TS-3,0.5,0.2,0.8,0.059,0.004,0.112
-TabPFN-TS,TiRex,0.5,0.2,0.8,0.014,-0.023,0.052
-TabPFN-TS,TS-ICL,0.5,0.2,0.8,0.017,-0.023,0.059
-TabPFN-TS,Moirai-2.0,0.6,0.3,0.9,-0.015,-0.077,0.034
-TabPFN-TS,Toto-2.0-1B,0.5,0.2,0.8,0.075,-0.01,0.157
-TabPFN-TS,Toto-2.0-22m,0.6,0.3,0.9,0.062,-0.032,0.135
-TabPFN-TS,Chronos-Bolt,0.7,0.4,0.9,0.02,-0.025,0.07
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.378,0.247,0.498
-TabPFN-TS-3,TimesFM-3,0.3,0.0,0.6,-0.096,-0.211,-0.007
-TabPFN-TS-3,TiRex-2,0.2,0.0,0.5,-0.092,-0.178,-0.023
-TabPFN-TS-3,t0-beta,0.1,0.0,0.3,-0.099,-0.206,-0.016
-TabPFN-TS-3,Chronos-2,0.3,0.1,0.6,-0.068,-0.135,-0.009
-TabPFN-TS-3,TimesFM-2.5,0.4,0.1,0.7,-0.067,-0.177,0.013
-TabPFN-TS-3,Toto-2.0-313m,0.6,0.3,0.9,0.002,-0.117,0.096
-TabPFN-TS-3,Toto-2.0-2.5B,0.5,0.2,0.8,0.005,-0.1,0.097
-TabPFN-TS-3,citras-fm,0.4,0.1,0.7,-0.065,-0.171,0.025
-TabPFN-TS-3,TabPFN-TS,0.5,0.2,0.8,-0.063,-0.126,-0.004
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TiRex,0.4,0.1,0.7,-0.048,-0.121,-0.001
-TabPFN-TS-3,TS-ICL,0.6,0.3,0.9,-0.045,-0.134,0.031
-TabPFN-TS-3,Moirai-2.0,0.5,0.2,0.8,-0.079,-0.194,-0.004
-TabPFN-TS-3,Toto-2.0-1B,0.5,0.2,0.8,0.016,-0.087,0.104
-TabPFN-TS-3,Toto-2.0-22m,0.6,0.3,0.9,0.002,-0.12,0.097
-TabPFN-TS-3,Chronos-Bolt,0.5,0.2,0.8,-0.041,-0.106,0.011
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.339,0.227,0.44
-TiRex,TimesFM-3,0.3,0.1,0.6,-0.046,-0.114,0.029
-TiRex,TiRex-2,0.1,0.0,0.3,-0.042,-0.074,-0.008
-TiRex,t0-beta,0.3,0.0,0.6,-0.048,-0.098,-0.003
-TiRex,Chronos-2,0.3,0.1,0.6,-0.019,-0.057,0.021
-TiRex,TimesFM-2.5,0.3,0.1,0.6,-0.018,-0.077,0.048
-TiRex,Toto-2.0-313m,0.5,0.2,0.8,0.047,-0.034,0.126
-TiRex,Toto-2.0-2.5B,0.4,0.1,0.7,0.051,-0.025,0.126
-TiRex,citras-fm,0.4,0.1,0.7,-0.016,-0.074,0.049
-TiRex,TabPFN-TS,0.5,0.2,0.8,-0.014,-0.055,0.023
-TiRex,TabPFN-TS-3,0.6,0.3,0.9,0.046,0.001,0.108
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TS-ICL,0.5,0.2,0.8,0.003,-0.056,0.055
-TiRex,Moirai-2.0,0.5,0.2,0.8,-0.029,-0.073,0.009
-TiRex,Toto-2.0-1B,0.5,0.2,0.8,0.061,-0.016,0.136
-TiRex,Toto-2.0-22m,0.5,0.2,0.8,0.048,-0.028,0.12
-TiRex,Chronos-Bolt,0.7,0.4,0.9,0.006,-0.035,0.045
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.369,0.24,0.497
-TS-ICL,TimesFM-3,0.3,0.0,0.6,-0.049,-0.138,0.064
-TS-ICL,TiRex-2,0.2,0.0,0.5,-0.044,-0.096,0.005
-TS-ICL,t0-beta,0.3,0.0,0.6,-0.051,-0.089,-0.013
-TS-ICL,Chronos-2,0.2,0.0,0.5,-0.022,-0.061,0.013
-TS-ICL,TimesFM-2.5,0.4,0.1,0.7,-0.021,-0.129,0.093
-TS-ICL,Toto-2.0-313m,0.4,0.1,0.7,0.045,-0.035,0.146
-TS-ICL,Toto-2.0-2.5B,0.5,0.2,0.8,0.048,-0.019,0.123
-TS-ICL,citras-fm,0.6,0.3,0.9,-0.018,-0.065,0.024
-TS-ICL,TabPFN-TS,0.5,0.2,0.8,-0.017,-0.063,0.023
-TS-ICL,TabPFN-TS-3,0.4,0.1,0.7,0.043,-0.032,0.118
-TS-ICL,TiRex,0.5,0.2,0.8,-0.003,-0.058,0.053
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,Moirai-2.0,0.5,0.2,0.8,-0.032,-0.107,0.033
-TS-ICL,Toto-2.0-1B,0.5,0.2,0.8,0.059,-0.013,0.152
-TS-ICL,Toto-2.0-22m,0.5,0.2,0.8,0.046,-0.031,0.121
-TS-ICL,Chronos-Bolt,0.6,0.3,0.9,0.004,-0.07,0.075
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.367,0.205,0.506
-Moirai-2.0,TimesFM-3,0.3,0.0,0.6,-0.016,-0.087,0.06
-Moirai-2.0,TiRex-2,0.3,0.1,0.6,-0.012,-0.056,0.03
-Moirai-2.0,t0-beta,0.3,0.098,0.6,-0.019,-0.066,0.027
-Moirai-2.0,Chronos-2,0.3,0.1,0.6,0.01,-0.047,0.079
-Moirai-2.0,TimesFM-2.5,0.3,0.1,0.6,0.011,-0.036,0.078
-Moirai-2.0,Toto-2.0-313m,0.4,0.1,0.7,0.074,-0.018,0.163
-Moirai-2.0,Toto-2.0-2.5B,0.5,0.2,0.8,0.077,-0.013,0.17
-Moirai-2.0,citras-fm,0.5,0.2,0.8,0.013,-0.057,0.101
-Moirai-2.0,TabPFN-TS,0.4,0.1,0.7,0.014,-0.035,0.072
-Moirai-2.0,TabPFN-TS-3,0.5,0.2,0.8,0.073,0.004,0.162
-Moirai-2.0,TiRex,0.5,0.2,0.8,0.028,-0.009,0.068
-Moirai-2.0,TS-ICL,0.5,0.2,0.8,0.031,-0.035,0.097
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Toto-2.0-1B,0.5,0.2,0.8,0.088,-0.004,0.174
-Moirai-2.0,Toto-2.0-22m,0.4,0.1,0.7,0.075,-0.01,0.156
-Moirai-2.0,Chronos-Bolt,0.65,0.35,0.9,0.035,-0.011,0.083
-Moirai-2.0,Seasonal Naive,1.0,1.0,1.0,0.387,0.253,0.522
-Toto-2.0-1B,TimesFM-3,0.2,0.0,0.5,-0.114,-0.182,-0.051
-Toto-2.0-1B,TiRex-2,0.2,0.0,0.5,-0.11,-0.195,-0.031
-Toto-2.0-1B,t0-beta,0.2,0.0,0.5,-0.117,-0.216,-0.023
-Toto-2.0-1B,Chronos-2,0.4,0.1,0.7,-0.086,-0.186,-0.002
-Toto-2.0-1B,TimesFM-2.5,0.3,0.0,0.6,-0.085,-0.185,-0.005
-Toto-2.0-1B,Toto-2.0-313m,0.5,0.2,0.8,-0.015,-0.043,0.005
-Toto-2.0-1B,Toto-2.0-2.5B,0.3,0.1,0.6,-0.012,-0.047,0.021
-Toto-2.0-1B,citras-fm,0.6,0.3,0.9,-0.082,-0.198,0.007
-Toto-2.0-1B,TabPFN-TS,0.5,0.2,0.8,-0.081,-0.186,0.01
-Toto-2.0-1B,TabPFN-TS-3,0.5,0.2,0.8,-0.017,-0.116,0.08
-Toto-2.0-1B,TiRex,0.5,0.2,0.8,-0.065,-0.157,0.015
-Toto-2.0-1B,TS-ICL,0.5,0.2,0.8,-0.063,-0.179,0.013
-Toto-2.0-1B,Moirai-2.0,0.5,0.2,0.8,-0.096,-0.211,0.004
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-22m,0.5,0.2,0.8,-0.014,-0.051,0.017
-Toto-2.0-1B,Chronos-Bolt,0.6,0.3,0.9,-0.059,-0.158,0.025
-Toto-2.0-1B,Seasonal Naive,0.8,0.6,1.0,0.328,0.168,0.472
-Toto-2.0-22m,TimesFM-3,0.3,0.0,0.6,-0.099,-0.178,-0.029
-Toto-2.0-22m,TiRex-2,0.2,0.0,0.5,-0.094,-0.168,-0.021
-Toto-2.0-22m,t0-beta,0.3,0.0,0.6,-0.101,-0.187,-0.019
-Toto-2.0-22m,Chronos-2,0.2,0.0,0.4,-0.071,-0.166,0.015
-Toto-2.0-22m,TimesFM-2.5,0.5,0.2,0.8,-0.07,-0.175,0.011
-Toto-2.0-22m,Toto-2.0-313m,0.3,0.0,0.6,-0.001,-0.028,0.036
-Toto-2.0-22m,Toto-2.0-2.5B,0.4,0.1,0.7,0.002,-0.033,0.044
-Toto-2.0-22m,citras-fm,0.5,0.2,0.8,-0.067,-0.165,0.016
-Toto-2.0-22m,TabPFN-TS,0.4,0.1,0.7,-0.066,-0.156,0.031
-Toto-2.0-22m,TabPFN-TS-3,0.4,0.1,0.7,-0.002,-0.107,0.107
-Toto-2.0-22m,TiRex,0.5,0.2,0.8,-0.051,-0.137,0.027
-Toto-2.0-22m,TS-ICL,0.5,0.2,0.8,-0.048,-0.138,0.03
-Toto-2.0-22m,Moirai-2.0,0.6,0.3,0.9,-0.081,-0.185,0.01
-Toto-2.0-22m,Toto-2.0-1B,0.5,0.2,0.8,0.014,-0.017,0.048
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Chronos-Bolt,0.5,0.2,0.8,-0.044,-0.148,0.046
-Toto-2.0-22m,Seasonal Naive,0.8,0.6,1.0,0.337,0.162,0.491
-Chronos-Bolt,TimesFM-3,0.3,0.0,0.6,-0.053,-0.124,0.013
-Chronos-Bolt,TiRex-2,0.2,0.0,0.4,-0.048,-0.108,0.007
-Chronos-Bolt,t0-beta,0.3,0.098,0.6,-0.055,-0.118,-0.001
-Chronos-Bolt,Chronos-2,0.2,0.0,0.4,-0.026,-0.086,0.033
-Chronos-Bolt,TimesFM-2.5,0.3,0.0,0.6,-0.025,-0.087,0.031
-Chronos-Bolt,Toto-2.0-313m,0.4,0.1,0.7,0.041,-0.05,0.128
-Chronos-Bolt,Toto-2.0-2.5B,0.4,0.1,0.7,0.044,-0.043,0.137
-Chronos-Bolt,citras-fm,0.5,0.2,0.8,-0.022,-0.103,0.066
-Chronos-Bolt,TabPFN-TS,0.3,0.1,0.6,-0.021,-0.075,0.024
-Chronos-Bolt,TabPFN-TS-3,0.5,0.2,0.8,0.04,-0.011,0.095
-Chronos-Bolt,TiRex,0.3,0.1,0.6,-0.006,-0.048,0.033
-Chronos-Bolt,TS-ICL,0.4,0.1,0.7,-0.004,-0.081,0.065
-Chronos-Bolt,Moirai-2.0,0.35,0.1,0.65,-0.036,-0.091,0.01
-Chronos-Bolt,Toto-2.0-1B,0.4,0.1,0.7,0.055,-0.026,0.136
-Chronos-Bolt,Toto-2.0-22m,0.5,0.2,0.8,0.042,-0.048,0.129
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.365,0.247,0.481
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.658,-1.1,-0.377
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.651,-1.086,-0.344
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.661,-1.123,-0.342
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.615,-1.015,-0.319
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.614,-1.045,-0.359
-Seasonal Naive,Toto-2.0-313m,0.1,0.0,0.3,-0.51,-0.953,-0.223
-Seasonal Naive,Toto-2.0-2.5B,0.2,0.0,0.4,-0.505,-0.918,-0.195
-Seasonal Naive,citras-fm,0.1,0.0,0.3,-0.61,-1.083,-0.269
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.608,-0.992,-0.328
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.512,-0.787,-0.293
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.585,-0.99,-0.316
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.581,-1.022,-0.258
-Seasonal Naive,Moirai-2.0,0.0,0.0,0.0,-0.631,-1.091,-0.338
-Seasonal Naive,Toto-2.0-1B,0.2,0.0,0.4,-0.488,-0.893,-0.202
-Seasonal Naive,Toto-2.0-22m,0.2,0.0,0.4,-0.509,-0.966,-0.194
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.575,-0.927,-0.328
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_health/pairwise_WAPE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,TimesFM-2.5,0.5,0.2,0.8,0.023,-0.138,0.159
-t0-beta,TabPFN-TS-3,0.4,0.1,0.7,0.065,-0.048,0.166
-t0-beta,TiRex-2,0.7,0.4,0.9,0.071,-0.006,0.184
-t0-beta,TimesFM-3,0.5,0.2,0.8,0.047,-0.085,0.207
-t0-beta,Chronos-2,0.8,0.5,1.0,0.038,-0.01,0.08
-t0-beta,citras-fm,0.7,0.4,1.0,0.032,-0.007,0.078
-t0-beta,Toto-2.0-2.5B,0.7,0.4,0.902,0.105,0.017,0.204
-t0-beta,TiRex,0.6,0.3,0.9,0.029,-0.059,0.116
-t0-beta,FlowState,0.6,0.3,0.9,0.082,-0.12,0.239
-t0-beta,TS-ICL,0.7,0.4,1.0,0.047,0.013,0.083
-t0-beta,Moirai-2.0,0.7,0.4,0.902,0.003,-0.106,0.079
-t0-beta,Toto-2.0-22m,0.7,0.4,1.0,0.106,-0.004,0.228
-t0-beta,Toto-1.0,0.5,0.2,0.8,0.043,-0.008,0.108
-t0-beta,Toto-2.0-313m,0.7,0.4,1.0,0.113,0.002,0.239
-t0-beta,Chronos-Bolt,0.7,0.4,0.902,0.08,-0.047,0.188
-t0-beta,Seasonal Naive,0.9,0.7,1.0,0.318,0.076,0.503
-TimesFM-2.5,t0-beta,0.5,0.2,0.8,-0.023,-0.19,0.121
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,TabPFN-TS-3,0.4,0.1,0.7,0.043,-0.042,0.157
-TimesFM-2.5,TiRex-2,0.6,0.3,0.9,0.05,-0.037,0.153
-TimesFM-2.5,TimesFM-3,0.6,0.3,0.9,0.024,-0.068,0.112
-TimesFM-2.5,Chronos-2,0.5,0.2,0.8,0.016,-0.108,0.137
-TimesFM-2.5,citras-fm,0.6,0.3,0.9,0.01,-0.109,0.129
-TimesFM-2.5,Toto-2.0-2.5B,0.6,0.3,0.9,0.084,-0.022,0.202
-TimesFM-2.5,TiRex,0.6,0.3,0.9,0.007,-0.063,0.073
-TimesFM-2.5,FlowState,0.6,0.3,0.9,0.061,-0.057,0.195
-TimesFM-2.5,TS-ICL,0.6,0.3,0.9,0.025,-0.128,0.159
-TimesFM-2.5,Moirai-2.0,0.6,0.3,0.9,-0.02,-0.124,0.049
-TimesFM-2.5,Toto-2.0-22m,0.6,0.3,0.9,0.085,-0.01,0.182
-TimesFM-2.5,Toto-1.0,0.6,0.3,0.9,0.021,-0.095,0.138
-TimesFM-2.5,Toto-2.0-313m,0.5,0.2,0.8,0.092,-0.021,0.205
-TimesFM-2.5,Chronos-Bolt,0.8,0.6,1.0,0.059,-0.012,0.139
-TimesFM-2.5,Seasonal Naive,0.9,0.7,1.0,0.302,0.151,0.466
-TabPFN-TS-3,t0-beta,0.6,0.3,0.9,-0.07,-0.199,0.046
-TabPFN-TS-3,TimesFM-2.5,0.6,0.3,0.9,-0.045,-0.186,0.041
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TiRex-2,0.6,0.3,0.9,0.006,-0.116,0.104
-TabPFN-TS-3,TimesFM-3,0.4,0.1,0.7,-0.02,-0.107,0.079
-TabPFN-TS-3,Chronos-2,0.5,0.2,0.8,-0.029,-0.128,0.059
-TabPFN-TS-3,citras-fm,0.5,0.2,0.8,-0.035,-0.131,0.053
-TabPFN-TS-3,Toto-2.0-2.5B,0.5,0.2,0.8,0.043,-0.069,0.141
-TabPFN-TS-3,TiRex,0.6,0.3,0.9,-0.038,-0.168,0.031
-TabPFN-TS-3,FlowState,0.7,0.4,1.0,0.018,-0.084,0.109
-TabPFN-TS-3,TS-ICL,0.6,0.3,0.9,-0.019,-0.135,0.079
-TabPFN-TS-3,Moirai-2.0,0.5,0.2,0.8,-0.066,-0.193,0.03
-TabPFN-TS-3,Toto-2.0-22m,0.7,0.4,0.9,0.044,-0.115,0.149
-TabPFN-TS-3,Toto-1.0,0.6,0.3,0.9,-0.024,-0.153,0.076
-TabPFN-TS-3,Toto-2.0-313m,0.6,0.3,0.9,0.051,-0.101,0.171
-TabPFN-TS-3,Chronos-Bolt,0.6,0.3,0.9,0.016,-0.04,0.071
-TabPFN-TS-3,Seasonal Naive,0.9,0.7,1.0,0.271,0.109,0.406
-TiRex-2,t0-beta,0.3,0.1,0.6,-0.077,-0.226,0.006
-TiRex-2,TimesFM-2.5,0.4,0.1,0.7,-0.052,-0.18,0.036
-TiRex-2,TabPFN-TS-3,0.4,0.1,0.7,-0.006,-0.116,0.104
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TimesFM-3,0.6,0.3,0.9,-0.026,-0.111,0.048
-TiRex-2,Chronos-2,0.5,0.2,0.8,-0.036,-0.156,0.044
-TiRex-2,citras-fm,0.6,0.3,0.9,-0.042,-0.137,0.019
-TiRex-2,Toto-2.0-2.5B,0.6,0.3,0.9,0.037,0.003,0.073
-TiRex-2,TiRex,0.6,0.3,0.9,-0.045,-0.141,0.028
-TiRex-2,FlowState,0.5,0.2,0.8,0.012,-0.194,0.191
-TiRex-2,TS-ICL,0.7,0.4,1.0,-0.026,-0.175,0.068
-TiRex-2,Moirai-2.0,0.6,0.3,0.9,-0.073,-0.232,0.042
-TiRex-2,Toto-2.0-22m,0.6,0.3,0.9,0.038,-0.02,0.091
-TiRex-2,Toto-1.0,0.5,0.2,0.8,-0.03,-0.111,0.031
-TiRex-2,Toto-2.0-313m,0.6,0.3,0.9,0.045,-0.002,0.099
-TiRex-2,Chronos-Bolt,0.7,0.4,1.0,0.01,-0.111,0.117
-TiRex-2,Seasonal Naive,0.9,0.7,1.0,0.266,0.03,0.446
-TimesFM-3,t0-beta,0.5,0.2,0.8,-0.049,-0.262,0.078
-TimesFM-3,TimesFM-2.5,0.4,0.1,0.7,-0.025,-0.126,0.064
-TimesFM-3,TabPFN-TS-3,0.6,0.3,0.9,0.019,-0.085,0.097
-TimesFM-3,TiRex-2,0.4,0.1,0.7,0.026,-0.05,0.1
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.5,0.2,0.8,-0.009,-0.17,0.094
-TimesFM-3,citras-fm,0.6,0.3,0.9,-0.015,-0.166,0.085
-TimesFM-3,Toto-2.0-2.5B,0.5,0.2,0.8,0.061,-0.026,0.146
-TimesFM-3,TiRex,0.6,0.3,0.9,-0.018,-0.156,0.077
-TimesFM-3,FlowState,0.4,0.1,0.7,0.037,-0.116,0.179
-TimesFM-3,TS-ICL,0.6,0.3,0.9,0.0,-0.203,0.121
-TimesFM-3,Moirai-2.0,0.6,0.3,0.9,-0.045,-0.226,0.075
-TimesFM-3,Toto-2.0-22m,0.5,0.2,0.8,0.062,-0.048,0.149
-TimesFM-3,Toto-1.0,0.7,0.4,0.9,-0.004,-0.136,0.099
-TimesFM-3,Toto-2.0-313m,0.6,0.3,0.9,0.069,-0.03,0.153
-TimesFM-3,Chronos-Bolt,0.7,0.4,1.0,0.035,-0.058,0.119
-TimesFM-3,Seasonal Naive,0.9,0.7,1.0,0.285,0.12,0.424
-Chronos-2,t0-beta,0.2,0.0,0.5,-0.04,-0.087,0.01
-Chronos-2,TimesFM-2.5,0.5,0.2,0.8,-0.016,-0.159,0.097
-Chronos-2,TabPFN-TS-3,0.5,0.2,0.8,0.028,-0.062,0.114
-Chronos-2,TiRex-2,0.5,0.2,0.8,0.034,-0.047,0.135
-Chronos-2,TimesFM-3,0.5,0.2,0.8,0.009,-0.104,0.145
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,citras-fm,0.5,0.2,0.8,-0.006,-0.054,0.035
-Chronos-2,Toto-2.0-2.5B,0.6,0.3,0.9,0.07,-0.016,0.158
-Chronos-2,TiRex,0.5,0.2,0.8,-0.009,-0.092,0.059
-Chronos-2,FlowState,0.6,0.3,0.9,0.046,-0.141,0.185
-Chronos-2,TS-ICL,0.6,0.3,0.9,0.009,-0.034,0.061
-Chronos-2,Moirai-2.0,0.4,0.1,0.7,-0.036,-0.144,0.052
-Chronos-2,Toto-2.0-22m,0.7,0.4,0.9,0.071,-0.036,0.181
-Chronos-2,Toto-1.0,0.5,0.2,0.8,0.005,-0.065,0.075
-Chronos-2,Toto-2.0-313m,0.7,0.4,0.9,0.078,-0.034,0.196
-Chronos-2,Chronos-Bolt,0.6,0.3,0.9,0.044,-0.071,0.143
-Chronos-2,Seasonal Naive,0.8,0.6,1.0,0.291,0.052,0.471
-citras-fm,t0-beta,0.3,0.0,0.6,-0.033,-0.084,0.007
-citras-fm,TimesFM-2.5,0.4,0.1,0.7,-0.01,-0.148,0.099
-citras-fm,TabPFN-TS-3,0.5,0.2,0.8,0.034,-0.056,0.116
-citras-fm,TiRex-2,0.4,0.1,0.7,0.04,-0.019,0.12
-citras-fm,TimesFM-3,0.4,0.1,0.7,0.015,-0.092,0.142
-citras-fm,Chronos-2,0.5,0.2,0.8,0.006,-0.037,0.051
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,Toto-2.0-2.5B,0.6,0.3,0.9,0.075,0.001,0.148
-citras-fm,TiRex,0.5,0.2,0.8,-0.003,-0.083,0.057
-citras-fm,FlowState,0.4,0.1,0.7,0.052,-0.137,0.196
-citras-fm,TS-ICL,0.4,0.1,0.7,0.015,-0.041,0.07
-citras-fm,Moirai-2.0,0.6,0.3,0.9,-0.03,-0.127,0.037
-citras-fm,Toto-2.0-22m,0.6,0.3,0.9,0.076,-0.024,0.175
-citras-fm,Toto-1.0,0.6,0.3,0.9,0.011,-0.039,0.059
-citras-fm,Toto-2.0-313m,0.6,0.3,0.9,0.083,-0.021,0.19
-citras-fm,Chronos-Bolt,0.7,0.4,0.9,0.049,-0.06,0.134
-citras-fm,Seasonal Naive,0.9,0.7,1.0,0.295,0.073,0.472
-Toto-2.0-2.5B,t0-beta,0.3,0.098,0.6,-0.118,-0.256,-0.017
-Toto-2.0-2.5B,TimesFM-2.5,0.4,0.1,0.7,-0.092,-0.253,0.021
-Toto-2.0-2.5B,TabPFN-TS-3,0.5,0.2,0.8,-0.045,-0.164,0.065
-Toto-2.0-2.5B,TiRex-2,0.4,0.1,0.7,-0.038,-0.079,-0.003
-Toto-2.0-2.5B,TimesFM-3,0.5,0.2,0.8,-0.066,-0.171,0.025
-Toto-2.0-2.5B,Chronos-2,0.4,0.1,0.7,-0.075,-0.188,0.016
-Toto-2.0-2.5B,citras-fm,0.4,0.1,0.7,-0.082,-0.173,-0.001
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TiRex,0.5,0.2,0.8,-0.085,-0.194,0.009
-Toto-2.0-2.5B,FlowState,0.6,0.3,0.9,-0.026,-0.249,0.151
-Toto-2.0-2.5B,TS-ICL,0.6,0.3,0.9,-0.065,-0.214,0.037
-Toto-2.0-2.5B,Moirai-2.0,0.6,0.3,0.9,-0.114,-0.286,0.022
-Toto-2.0-2.5B,Toto-2.0-22m,0.7,0.4,1.0,0.001,-0.076,0.055
-Toto-2.0-2.5B,Toto-1.0,0.4,0.1,0.7,-0.069,-0.145,-0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.6,0.3,0.9,0.008,-0.043,0.054
-Toto-2.0-2.5B,Chronos-Bolt,0.7,0.4,1.0,-0.028,-0.167,0.084
-Toto-2.0-2.5B,Seasonal Naive,0.8,0.6,1.0,0.238,-0.014,0.419
-TiRex,t0-beta,0.4,0.1,0.7,-0.03,-0.131,0.056
-TiRex,TimesFM-2.5,0.4,0.1,0.7,-0.007,-0.078,0.059
-TiRex,TabPFN-TS-3,0.4,0.1,0.7,0.037,-0.032,0.144
-TiRex,TiRex-2,0.4,0.1,0.7,0.043,-0.029,0.123
-TiRex,TimesFM-3,0.4,0.1,0.7,0.018,-0.083,0.135
-TiRex,Chronos-2,0.5,0.2,0.8,0.009,-0.062,0.084
-TiRex,citras-fm,0.5,0.2,0.8,0.003,-0.06,0.077
-TiRex,Toto-2.0-2.5B,0.5,0.2,0.8,0.078,-0.009,0.162
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,FlowState,0.5,0.2,0.8,0.054,-0.089,0.201
-TiRex,TS-ICL,0.6,0.3,0.9,0.018,-0.073,0.098
-TiRex,Moirai-2.0,0.5,0.2,0.8,-0.027,-0.087,0.031
-TiRex,Toto-2.0-22m,0.5,0.2,0.8,0.079,-0.005,0.156
-TiRex,Toto-1.0,0.6,0.3,0.9,0.014,-0.053,0.073
-TiRex,Toto-2.0-313m,0.5,0.2,0.8,0.086,-0.013,0.18
-TiRex,Chronos-Bolt,0.7,0.4,0.9,0.052,-0.028,0.146
-TiRex,Seasonal Naive,0.9,0.7,1.0,0.298,0.098,0.478
-FlowState,t0-beta,0.4,0.1,0.7,-0.09,-0.313,0.107
-FlowState,TimesFM-2.5,0.4,0.1,0.7,-0.065,-0.242,0.054
-FlowState,TabPFN-TS-3,0.3,0.0,0.6,-0.019,-0.122,0.078
-FlowState,TiRex-2,0.5,0.2,0.8,-0.012,-0.236,0.162
-FlowState,TimesFM-3,0.6,0.3,0.9,-0.039,-0.218,0.104
-FlowState,Chronos-2,0.4,0.1,0.7,-0.048,-0.227,0.124
-FlowState,citras-fm,0.6,0.3,0.9,-0.054,-0.245,0.12
-FlowState,Toto-2.0-2.5B,0.4,0.1,0.7,0.025,-0.178,0.199
-FlowState,TiRex,0.5,0.2,0.8,-0.058,-0.251,0.082
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TS-ICL,0.4,0.1,0.7,-0.038,-0.232,0.142
-FlowState,Moirai-2.0,0.5,0.2,0.8,-0.086,-0.257,0.058
-FlowState,Toto-2.0-22m,0.5,0.2,0.8,0.026,-0.204,0.195
-FlowState,Toto-1.0,0.6,0.3,0.9,-0.043,-0.273,0.14
-FlowState,Toto-2.0-313m,0.4,0.1,0.7,0.033,-0.204,0.217
-FlowState,Chronos-Bolt,0.7,0.4,1.0,-0.002,-0.133,0.112
-FlowState,Seasonal Naive,0.9,0.7,1.0,0.257,0.128,0.376
-TS-ICL,t0-beta,0.3,0.0,0.6,-0.049,-0.091,-0.013
-TS-ICL,TimesFM-2.5,0.4,0.1,0.7,-0.026,-0.188,0.114
-TS-ICL,TabPFN-TS-3,0.4,0.1,0.7,0.019,-0.086,0.119
-TS-ICL,TiRex-2,0.3,0.0,0.6,0.025,-0.073,0.149
-TS-ICL,TimesFM-3,0.4,0.1,0.7,-0.0,-0.137,0.169
-TS-ICL,Chronos-2,0.4,0.1,0.7,-0.009,-0.065,0.033
-TS-ICL,citras-fm,0.6,0.3,0.9,-0.016,-0.075,0.039
-TS-ICL,Toto-2.0-2.5B,0.4,0.1,0.7,0.061,-0.038,0.177
-TS-ICL,TiRex,0.4,0.1,0.7,-0.019,-0.109,0.068
-TS-ICL,FlowState,0.6,0.3,0.9,0.037,-0.165,0.189
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,Moirai-2.0,0.6,0.3,0.9,-0.046,-0.15,0.031
-TS-ICL,Toto-2.0-22m,0.4,0.1,0.7,0.062,-0.061,0.196
-TS-ICL,Toto-1.0,0.7,0.4,1.0,-0.004,-0.084,0.071
-TS-ICL,Toto-2.0-313m,0.5,0.2,0.8,0.069,-0.056,0.21
-TS-ICL,Chronos-Bolt,0.7,0.4,0.9,0.035,-0.085,0.14
-TS-ICL,Seasonal Naive,0.9,0.7,1.0,0.285,0.037,0.472
-Moirai-2.0,t0-beta,0.3,0.098,0.6,-0.003,-0.085,0.096
-Moirai-2.0,TimesFM-2.5,0.4,0.1,0.7,0.019,-0.052,0.11
-Moirai-2.0,TabPFN-TS-3,0.5,0.2,0.8,0.062,-0.031,0.162
-Moirai-2.0,TiRex-2,0.4,0.1,0.7,0.068,-0.044,0.188
-Moirai-2.0,TimesFM-3,0.4,0.1,0.7,0.043,-0.081,0.184
-Moirai-2.0,Chronos-2,0.6,0.3,0.9,0.035,-0.055,0.126
-Moirai-2.0,citras-fm,0.4,0.1,0.7,0.029,-0.039,0.113
-Moirai-2.0,Toto-2.0-2.5B,0.4,0.1,0.7,0.102,-0.023,0.223
-Moirai-2.0,TiRex,0.5,0.2,0.8,0.026,-0.032,0.08
-Moirai-2.0,FlowState,0.5,0.2,0.8,0.079,-0.061,0.204
-Moirai-2.0,TS-ICL,0.4,0.1,0.7,0.044,-0.032,0.131
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Toto-2.0-22m,0.4,0.1,0.7,0.103,-0.025,0.22
-Moirai-2.0,Toto-1.0,0.6,0.3,0.9,0.04,-0.045,0.126
-Moirai-2.0,Toto-2.0-313m,0.4,0.1,0.7,0.11,-0.037,0.242
-Moirai-2.0,Chronos-Bolt,0.75,0.45,1.0,0.077,-0.001,0.158
-Moirai-2.0,Seasonal Naive,0.9,0.7,1.0,0.316,0.124,0.487
-Toto-2.0-22m,t0-beta,0.3,0.0,0.6,-0.119,-0.295,0.004
-Toto-2.0-22m,TimesFM-2.5,0.4,0.1,0.7,-0.093,-0.222,0.01
-Toto-2.0-22m,TabPFN-TS-3,0.3,0.1,0.6,-0.046,-0.175,0.103
-Toto-2.0-22m,TiRex-2,0.4,0.1,0.7,-0.039,-0.1,0.019
-Toto-2.0-22m,TimesFM-3,0.5,0.2,0.8,-0.066,-0.176,0.046
-Toto-2.0-22m,Chronos-2,0.3,0.1,0.6,-0.076,-0.22,0.035
-Toto-2.0-22m,citras-fm,0.4,0.1,0.7,-0.082,-0.213,0.024
-Toto-2.0-22m,Toto-2.0-2.5B,0.3,0.0,0.6,-0.001,-0.058,0.071
-Toto-2.0-22m,TiRex,0.5,0.2,0.8,-0.086,-0.185,0.005
-Toto-2.0-22m,FlowState,0.5,0.2,0.8,-0.027,-0.243,0.169
-Toto-2.0-22m,TS-ICL,0.6,0.3,0.9,-0.066,-0.244,0.057
-Toto-2.0-22m,Moirai-2.0,0.6,0.3,0.9,-0.115,-0.282,0.025
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Toto-1.0,0.5,0.2,0.8,-0.07,-0.166,0.013
-Toto-2.0-22m,Toto-2.0-313m,0.6,0.3,0.9,0.008,-0.027,0.038
-Toto-2.0-22m,Chronos-Bolt,0.6,0.3,0.9,-0.029,-0.176,0.113
-Toto-2.0-22m,Seasonal Naive,0.8,0.6,1.0,0.237,-0.01,0.447
-Toto-1.0,t0-beta,0.5,0.2,0.8,-0.045,-0.121,0.007
-Toto-1.0,TimesFM-2.5,0.4,0.1,0.7,-0.021,-0.161,0.087
-Toto-1.0,TabPFN-TS-3,0.4,0.1,0.7,0.023,-0.082,0.133
-Toto-1.0,TiRex-2,0.5,0.2,0.8,0.029,-0.032,0.1
-Toto-1.0,TimesFM-3,0.3,0.1,0.6,0.004,-0.11,0.12
-Toto-1.0,Chronos-2,0.5,0.2,0.8,-0.005,-0.081,0.061
-Toto-1.0,citras-fm,0.4,0.1,0.7,-0.011,-0.063,0.038
-Toto-1.0,Toto-2.0-2.5B,0.6,0.3,0.9,0.065,0.0,0.126
-Toto-1.0,TiRex,0.4,0.1,0.7,-0.014,-0.079,0.051
-Toto-1.0,FlowState,0.4,0.1,0.7,0.041,-0.163,0.214
-Toto-1.0,TS-ICL,0.3,0.0,0.6,0.004,-0.076,0.077
-Toto-1.0,Moirai-2.0,0.4,0.1,0.7,-0.042,-0.144,0.043
-Toto-1.0,Toto-2.0-22m,0.5,0.2,0.8,0.066,-0.014,0.143
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,Toto-2.0-313m,0.6,0.3,0.9,0.073,-0.009,0.157
-Toto-1.0,Chronos-Bolt,0.5,0.2,0.8,0.039,-0.077,0.133
-Toto-1.0,Seasonal Naive,0.9,0.7,1.0,0.288,0.053,0.476
-Toto-2.0-313m,t0-beta,0.3,0.0,0.6,-0.127,-0.314,-0.002
-Toto-2.0-313m,TimesFM-2.5,0.5,0.2,0.8,-0.101,-0.258,0.021
-Toto-2.0-313m,TabPFN-TS-3,0.4,0.1,0.7,-0.054,-0.207,0.092
-Toto-2.0-313m,TiRex-2,0.4,0.1,0.7,-0.047,-0.109,0.002
-Toto-2.0-313m,TimesFM-3,0.4,0.1,0.7,-0.075,-0.181,0.029
-Toto-2.0-313m,Chronos-2,0.3,0.1,0.6,-0.084,-0.243,0.033
-Toto-2.0-313m,citras-fm,0.4,0.1,0.7,-0.091,-0.234,0.02
-Toto-2.0-313m,Toto-2.0-2.5B,0.4,0.1,0.7,-0.008,-0.057,0.041
-Toto-2.0-313m,TiRex,0.5,0.2,0.8,-0.094,-0.22,0.013
-Toto-2.0-313m,FlowState,0.6,0.3,0.9,-0.034,-0.278,0.17
-Toto-2.0-313m,TS-ICL,0.5,0.2,0.8,-0.074,-0.266,0.053
-Toto-2.0-313m,Moirai-2.0,0.6,0.3,0.9,-0.123,-0.32,0.036
-Toto-2.0-313m,Toto-2.0-22m,0.4,0.1,0.7,-0.008,-0.04,0.026
-Toto-2.0-313m,Toto-1.0,0.4,0.1,0.7,-0.079,-0.187,0.009
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Chronos-Bolt,0.6,0.3,0.9,-0.037,-0.193,0.102
-Toto-2.0-313m,Seasonal Naive,0.8,0.6,1.0,0.232,-0.027,0.431
-Chronos-Bolt,t0-beta,0.3,0.098,0.6,-0.087,-0.231,0.045
-Chronos-Bolt,TimesFM-2.5,0.2,0.0,0.4,-0.062,-0.161,0.011
-Chronos-Bolt,TabPFN-TS-3,0.4,0.1,0.7,-0.016,-0.076,0.038
-Chronos-Bolt,TiRex-2,0.3,0.0,0.6,-0.01,-0.133,0.1
-Chronos-Bolt,TimesFM-3,0.3,0.0,0.6,-0.036,-0.136,0.055
-Chronos-Bolt,Chronos-2,0.4,0.1,0.7,-0.046,-0.167,0.066
-Chronos-Bolt,citras-fm,0.3,0.1,0.6,-0.052,-0.155,0.057
-Chronos-Bolt,Toto-2.0-2.5B,0.3,0.0,0.6,0.027,-0.091,0.143
-Chronos-Bolt,TiRex,0.3,0.1,0.6,-0.055,-0.171,0.027
-Chronos-Bolt,FlowState,0.3,0.0,0.6,0.002,-0.126,0.117
-Chronos-Bolt,TS-ICL,0.3,0.1,0.6,-0.036,-0.163,0.078
-Chronos-Bolt,Moirai-2.0,0.25,0.0,0.55,-0.084,-0.188,0.001
-Chronos-Bolt,Toto-2.0-22m,0.4,0.1,0.7,0.028,-0.127,0.149
-Chronos-Bolt,Toto-1.0,0.5,0.2,0.8,-0.04,-0.154,0.072
-Chronos-Bolt,Toto-2.0-313m,0.4,0.1,0.7,0.035,-0.114,0.162
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.9,0.7,1.0,0.259,0.102,0.399
-Seasonal Naive,t0-beta,0.1,0.0,0.3,-0.467,-1.01,-0.082
-Seasonal Naive,TimesFM-2.5,0.1,0.0,0.3,-0.433,-0.874,-0.179
-Seasonal Naive,TabPFN-TS-3,0.1,0.0,0.3,-0.371,-0.684,-0.122
-Seasonal Naive,TiRex-2,0.1,0.0,0.3,-0.362,-0.804,-0.031
-Seasonal Naive,TimesFM-3,0.1,0.0,0.3,-0.398,-0.736,-0.137
-Seasonal Naive,Chronos-2,0.2,0.0,0.4,-0.411,-0.889,-0.054
-Seasonal Naive,citras-fm,0.1,0.0,0.3,-0.419,-0.895,-0.078
-Seasonal Naive,Toto-2.0-2.5B,0.2,0.0,0.4,-0.312,-0.721,0.014
-Seasonal Naive,TiRex,0.1,0.0,0.3,-0.424,-0.915,-0.109
-Seasonal Naive,FlowState,0.1,0.0,0.3,-0.346,-0.602,-0.147
-Seasonal Naive,TS-ICL,0.1,0.0,0.3,-0.398,-0.893,-0.038
-Seasonal Naive,Moirai-2.0,0.1,0.0,0.3,-0.462,-0.951,-0.141
-Seasonal Naive,Toto-2.0-22m,0.2,0.0,0.4,-0.311,-0.809,0.009
-Seasonal Naive,Toto-1.0,0.1,0.0,0.3,-0.404,-0.91,-0.055
-Seasonal Naive,Toto-2.0-313m,0.2,0.0,0.4,-0.301,-0.758,0.027
-Seasonal Naive,Chronos-Bolt,0.1,0.0,0.3,-0.349,-0.664,-0.113
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_health/pairwise_WQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,TimesFM-3,0.5,0.2,0.8,0.04,-0.062,0.173
-t0-beta,TimesFM-2.5,0.5,0.2,0.8,0.024,-0.101,0.135
-t0-beta,Chronos-2,0.7,0.4,0.9,0.027,-0.025,0.071
-t0-beta,TiRex-2,0.7,0.4,0.9,0.075,0.001,0.173
-t0-beta,TabPFN-TS-3,0.6,0.3,0.9,0.072,-0.033,0.169
-t0-beta,citras-fm,0.6,0.3,0.9,0.028,-0.008,0.065
-t0-beta,Moirai-2.0,0.8,0.6,1.0,0.006,-0.081,0.07
-t0-beta,Toto-2.0-2.5B,0.8,0.5,1.0,0.11,0.031,0.187
-t0-beta,Toto-2.0-313m,0.7,0.4,1.0,0.11,0.012,0.212
-t0-beta,TiRex,0.6,0.3,0.9,0.051,-0.024,0.128
-t0-beta,Toto-2.0-22m,0.7,0.4,1.0,0.101,0.006,0.202
-t0-beta,Toto-1.0,0.7,0.4,1.0,0.028,-0.011,0.065
-t0-beta,TS-ICL,0.6,0.3,0.9,0.051,0.01,0.095
-t0-beta,Toto-2.0-1B,0.8,0.5,1.0,0.114,0.03,0.202
-t0-beta,Chronos-Bolt,0.8,0.6,1.0,0.063,-0.047,0.155
-t0-beta,Seasonal Naive,0.9,0.7,1.0,0.42,0.217,0.57
-TimesFM-3,t0-beta,0.5,0.2,0.8,-0.041,-0.209,0.058
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,TimesFM-2.5,0.4,0.1,0.7,-0.016,-0.098,0.062
-TimesFM-3,Chronos-2,0.5,0.2,0.8,-0.014,-0.156,0.073
-TimesFM-3,TiRex-2,0.5,0.2,0.8,0.037,-0.013,0.088
-TimesFM-3,TabPFN-TS-3,0.6,0.3,0.9,0.034,-0.052,0.109
-TimesFM-3,citras-fm,0.7,0.4,0.9,-0.012,-0.134,0.066
-TimesFM-3,Moirai-2.0,0.6,0.3,0.9,-0.035,-0.188,0.068
-TimesFM-3,Toto-2.0-2.5B,0.6,0.3,0.9,0.073,-0.015,0.161
-TimesFM-3,Toto-2.0-313m,0.6,0.3,0.9,0.073,-0.022,0.153
-TimesFM-3,TiRex,0.7,0.4,0.9,0.012,-0.09,0.091
-TimesFM-3,Toto-2.0-22m,0.6,0.3,0.9,0.064,-0.035,0.145
-TimesFM-3,Toto-1.0,0.7,0.4,0.9,-0.012,-0.145,0.086
-TimesFM-3,TS-ICL,0.6,0.3,0.9,0.012,-0.163,0.116
-TimesFM-3,Toto-2.0-1B,0.6,0.3,0.9,0.078,-0.002,0.151
-TimesFM-3,Chronos-Bolt,0.7,0.4,1.0,0.025,-0.069,0.109
-TimesFM-3,Seasonal Naive,0.9,0.7,1.0,0.396,0.243,0.522
-TimesFM-2.5,t0-beta,0.5,0.2,0.8,-0.025,-0.157,0.092
-TimesFM-2.5,TimesFM-3,0.6,0.3,0.9,0.016,-0.066,0.089
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Chronos-2,0.5,0.2,0.8,0.002,-0.105,0.106
-TimesFM-2.5,TiRex-2,0.5,0.2,0.8,0.052,-0.018,0.138
-TimesFM-2.5,TabPFN-TS-3,0.4,0.1,0.7,0.049,-0.018,0.139
-TimesFM-2.5,citras-fm,0.6,0.3,0.9,0.003,-0.088,0.1
-TimesFM-2.5,Moirai-2.0,0.6,0.3,0.9,-0.019,-0.109,0.043
-TimesFM-2.5,Toto-2.0-2.5B,0.6,0.3,0.9,0.087,-0.017,0.208
-TimesFM-2.5,Toto-2.0-313m,0.5,0.2,0.8,0.088,-0.024,0.197
-TimesFM-2.5,TiRex,0.6,0.3,0.9,0.027,-0.023,0.085
-TimesFM-2.5,Toto-2.0-22m,0.6,0.3,0.9,0.079,-0.017,0.17
-TimesFM-2.5,Toto-1.0,0.6,0.3,0.9,0.004,-0.109,0.114
-TimesFM-2.5,TS-ICL,0.6,0.3,0.9,0.028,-0.104,0.136
-TimesFM-2.5,Toto-2.0-1B,0.5,0.2,0.8,0.092,-0.007,0.198
-TimesFM-2.5,Chronos-Bolt,0.8,0.6,1.0,0.04,-0.018,0.102
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.406,0.261,0.536
-Chronos-2,t0-beta,0.3,0.1,0.6,-0.027,-0.076,0.025
-Chronos-2,TimesFM-3,0.5,0.2,0.8,0.013,-0.079,0.135
-Chronos-2,TimesFM-2.5,0.5,0.2,0.8,-0.002,-0.119,0.095
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,TiRex-2,0.5,0.2,0.8,0.05,-0.019,0.145
-Chronos-2,TabPFN-TS-3,0.5,0.2,0.8,0.046,-0.035,0.122
-Chronos-2,citras-fm,0.5,0.2,0.8,0.001,-0.045,0.049
-Chronos-2,Moirai-2.0,0.6,0.3,0.9,-0.021,-0.11,0.055
-Chronos-2,Toto-2.0-2.5B,0.5,0.2,0.8,0.085,0.001,0.166
-Chronos-2,Toto-2.0-313m,0.7,0.4,0.9,0.086,-0.028,0.197
-Chronos-2,TiRex,0.5,0.2,0.8,0.025,-0.055,0.099
-Chronos-2,Toto-2.0-22m,0.7,0.4,0.9,0.077,-0.036,0.182
-Chronos-2,Toto-1.0,0.6,0.3,0.9,0.002,-0.077,0.077
-Chronos-2,TS-ICL,0.7,0.4,0.9,0.025,-0.019,0.081
-Chronos-2,Toto-2.0-1B,0.6,0.3,0.9,0.09,-0.002,0.181
-Chronos-2,Chronos-Bolt,0.7,0.4,0.9,0.038,-0.07,0.13
-Chronos-2,Seasonal Naive,0.9,0.7,1.0,0.404,0.211,0.549
-TiRex-2,t0-beta,0.3,0.1,0.6,-0.081,-0.209,-0.001
-TiRex-2,TimesFM-3,0.5,0.2,0.8,-0.038,-0.096,0.013
-TiRex-2,TimesFM-2.5,0.5,0.2,0.8,-0.054,-0.16,0.018
-TiRex-2,Chronos-2,0.5,0.2,0.8,-0.052,-0.169,0.019
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TabPFN-TS-3,0.6,0.3,0.9,-0.003,-0.092,0.089
-TiRex-2,citras-fm,0.4,0.1,0.7,-0.051,-0.138,0.004
-TiRex-2,Moirai-2.0,0.5,0.2,0.8,-0.074,-0.213,0.029
-TiRex-2,Toto-2.0-2.5B,0.7,0.4,1.0,0.038,-0.014,0.093
-TiRex-2,Toto-2.0-313m,0.6,0.3,0.9,0.038,-0.022,0.097
-TiRex-2,TiRex,0.6,0.3,0.9,-0.026,-0.096,0.031
-TiRex-2,Toto-2.0-22m,0.8,0.5,1.0,0.028,-0.034,0.082
-TiRex-2,Toto-1.0,0.5,0.2,0.8,-0.05,-0.15,0.034
-TiRex-2,TS-ICL,0.6,0.3,0.9,-0.025,-0.174,0.066
-TiRex-2,Toto-2.0-1B,0.7,0.4,0.9,0.043,0.002,0.089
-TiRex-2,Chronos-Bolt,0.6,0.3,0.9,-0.012,-0.128,0.083
-TiRex-2,Seasonal Naive,0.9,0.7,1.0,0.373,0.19,0.521
-TabPFN-TS-3,t0-beta,0.4,0.1,0.7,-0.077,-0.203,0.032
-TabPFN-TS-3,TimesFM-3,0.4,0.1,0.7,-0.035,-0.123,0.049
-TabPFN-TS-3,TimesFM-2.5,0.6,0.3,0.9,-0.051,-0.162,0.018
-TabPFN-TS-3,Chronos-2,0.5,0.2,0.8,-0.049,-0.139,0.034
-TabPFN-TS-3,TiRex-2,0.4,0.1,0.7,0.003,-0.097,0.084
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,citras-fm,0.5,0.2,0.8,-0.048,-0.143,0.035
-TabPFN-TS-3,Moirai-2.0,0.5,0.2,0.8,-0.071,-0.195,0.021
-TabPFN-TS-3,Toto-2.0-2.5B,0.5,0.2,0.8,0.041,-0.071,0.15
-TabPFN-TS-3,Toto-2.0-313m,0.6,0.3,0.9,0.041,-0.111,0.159
-TabPFN-TS-3,TiRex,0.7,0.4,0.9,-0.022,-0.141,0.042
-TabPFN-TS-3,Toto-2.0-22m,0.7,0.4,0.9,0.032,-0.123,0.132
-TabPFN-TS-3,Toto-1.0,0.6,0.3,0.9,-0.047,-0.192,0.064
-TabPFN-TS-3,TS-ICL,0.6,0.3,0.9,-0.022,-0.135,0.072
-TabPFN-TS-3,Toto-2.0-1B,0.6,0.3,0.9,0.046,-0.084,0.147
-TabPFN-TS-3,Chronos-Bolt,0.6,0.3,0.9,-0.009,-0.078,0.056
-TabPFN-TS-3,Seasonal Naive,0.9,0.7,1.0,0.375,0.232,0.495
-citras-fm,t0-beta,0.4,0.1,0.7,-0.028,-0.07,0.008
-citras-fm,TimesFM-3,0.3,0.1,0.6,0.012,-0.07,0.118
-citras-fm,TimesFM-2.5,0.4,0.1,0.7,-0.003,-0.111,0.081
-citras-fm,Chronos-2,0.5,0.2,0.8,-0.001,-0.051,0.043
-citras-fm,TiRex-2,0.6,0.3,0.9,0.049,-0.004,0.121
-citras-fm,TabPFN-TS-3,0.5,0.2,0.8,0.045,-0.036,0.125
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,Moirai-2.0,0.5,0.2,0.8,-0.022,-0.097,0.032
-citras-fm,Toto-2.0-2.5B,0.6,0.3,0.9,0.084,0.014,0.152
-citras-fm,Toto-2.0-313m,0.6,0.3,0.9,0.085,-0.012,0.174
-citras-fm,TiRex,0.6,0.3,0.9,0.024,-0.034,0.075
-citras-fm,Toto-2.0-22m,0.6,0.3,0.9,0.076,-0.014,0.158
-citras-fm,Toto-1.0,0.7,0.4,1.0,0.001,-0.05,0.048
-citras-fm,TS-ICL,0.6,0.3,0.9,0.024,-0.037,0.077
-citras-fm,Toto-2.0-1B,0.5,0.2,0.8,0.089,0.014,0.16
-citras-fm,Chronos-Bolt,0.6,0.3,0.9,0.037,-0.056,0.112
-citras-fm,Seasonal Naive,0.9,0.7,1.0,0.404,0.218,0.551
-Moirai-2.0,t0-beta,0.2,0.0,0.4,-0.006,-0.075,0.075
-Moirai-2.0,TimesFM-3,0.4,0.1,0.7,0.034,-0.073,0.158
-Moirai-2.0,TimesFM-2.5,0.4,0.1,0.7,0.018,-0.045,0.098
-Moirai-2.0,Chronos-2,0.4,0.1,0.7,0.02,-0.058,0.099
-Moirai-2.0,TiRex-2,0.5,0.2,0.8,0.069,-0.03,0.176
-Moirai-2.0,TabPFN-TS-3,0.5,0.2,0.8,0.066,-0.021,0.163
-Moirai-2.0,citras-fm,0.5,0.2,0.8,0.022,-0.033,0.089
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Toto-2.0-2.5B,0.5,0.2,0.8,0.104,-0.014,0.215
-Moirai-2.0,Toto-2.0-313m,0.4,0.1,0.7,0.104,-0.032,0.225
-Moirai-2.0,TiRex,0.5,0.2,0.8,0.045,-0.008,0.103
-Moirai-2.0,Toto-2.0-22m,0.4,0.1,0.7,0.096,-0.019,0.201
-Moirai-2.0,Toto-1.0,0.7,0.4,1.0,0.022,-0.059,0.098
-Moirai-2.0,TS-ICL,0.5,0.2,0.8,0.045,-0.021,0.117
-Moirai-2.0,Toto-2.0-1B,0.5,0.2,0.8,0.109,-0.011,0.22
-Moirai-2.0,Chronos-Bolt,0.75,0.5,0.951,0.057,-0.013,0.128
-Moirai-2.0,Seasonal Naive,1.0,1.0,1.0,0.416,0.242,0.564
-Toto-2.0-2.5B,t0-beta,0.2,0.0,0.5,-0.123,-0.23,-0.032
-Toto-2.0-2.5B,TimesFM-3,0.4,0.1,0.7,-0.079,-0.192,0.015
-Toto-2.0-2.5B,TimesFM-2.5,0.4,0.1,0.7,-0.096,-0.262,0.017
-Toto-2.0-2.5B,Chronos-2,0.5,0.2,0.8,-0.093,-0.199,-0.001
-Toto-2.0-2.5B,TiRex-2,0.3,0.0,0.6,-0.039,-0.102,0.014
-Toto-2.0-2.5B,TabPFN-TS-3,0.5,0.2,0.8,-0.042,-0.176,0.067
-Toto-2.0-2.5B,citras-fm,0.4,0.1,0.7,-0.092,-0.179,-0.014
-Toto-2.0-2.5B,Moirai-2.0,0.5,0.2,0.8,-0.116,-0.274,0.014
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.5,0.2,0.8,0.0,-0.07,0.057
-Toto-2.0-2.5B,TiRex,0.6,0.3,0.9,-0.066,-0.178,0.021
-Toto-2.0-2.5B,Toto-2.0-22m,0.6,0.3,0.9,-0.009,-0.097,0.053
-Toto-2.0-2.5B,Toto-1.0,0.4,0.1,0.7,-0.091,-0.179,-0.009
-Toto-2.0-2.5B,TS-ICL,0.6,0.3,0.9,-0.065,-0.197,0.036
-Toto-2.0-2.5B,Toto-2.0-1B,0.6,0.3,0.9,0.005,-0.032,0.038
-Toto-2.0-2.5B,Chronos-Bolt,0.6,0.3,0.9,-0.052,-0.219,0.063
-Toto-2.0-2.5B,Seasonal Naive,0.8,0.6,1.0,0.349,0.118,0.513
-Toto-2.0-313m,t0-beta,0.3,0.0,0.6,-0.123,-0.269,-0.012
-Toto-2.0-313m,TimesFM-3,0.4,0.1,0.7,-0.079,-0.181,0.021
-Toto-2.0-313m,TimesFM-2.5,0.5,0.2,0.8,-0.096,-0.245,0.023
-Toto-2.0-313m,Chronos-2,0.3,0.1,0.6,-0.094,-0.246,0.028
-Toto-2.0-313m,TiRex-2,0.4,0.1,0.7,-0.039,-0.107,0.021
-Toto-2.0-313m,TabPFN-TS-3,0.4,0.1,0.7,-0.043,-0.188,0.1
-Toto-2.0-313m,citras-fm,0.4,0.1,0.7,-0.092,-0.211,0.012
-Toto-2.0-313m,Moirai-2.0,0.6,0.3,0.9,-0.116,-0.291,0.031
-Toto-2.0-313m,Toto-2.0-2.5B,0.5,0.2,0.8,-0.0,-0.06,0.065
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TiRex,0.6,0.3,0.9,-0.066,-0.175,0.026
-Toto-2.0-313m,Toto-2.0-22m,0.4,0.1,0.7,-0.01,-0.041,0.022
-Toto-2.0-313m,Toto-1.0,0.4,0.1,0.7,-0.092,-0.205,0.003
-Toto-2.0-313m,TS-ICL,0.6,0.3,0.9,-0.066,-0.24,0.061
-Toto-2.0-313m,Toto-2.0-1B,0.6,0.3,0.9,0.005,-0.023,0.037
-Toto-2.0-313m,Chronos-Bolt,0.6,0.3,0.9,-0.052,-0.209,0.086
-Toto-2.0-313m,Seasonal Naive,0.8,0.6,1.0,0.348,0.132,0.525
-TiRex,t0-beta,0.4,0.1,0.7,-0.054,-0.147,0.024
-TiRex,TimesFM-3,0.3,0.1,0.6,-0.012,-0.1,0.083
-TiRex,TimesFM-2.5,0.4,0.1,0.7,-0.028,-0.093,0.023
-TiRex,Chronos-2,0.5,0.2,0.8,-0.026,-0.11,0.052
-TiRex,TiRex-2,0.4,0.1,0.7,0.025,-0.032,0.088
-TiRex,TabPFN-TS-3,0.3,0.1,0.6,0.022,-0.044,0.123
-TiRex,citras-fm,0.4,0.1,0.7,-0.025,-0.081,0.033
-TiRex,Moirai-2.0,0.5,0.2,0.8,-0.047,-0.114,0.007
-TiRex,Toto-2.0-2.5B,0.4,0.1,0.7,0.062,-0.022,0.151
-TiRex,Toto-2.0-313m,0.4,0.1,0.7,0.062,-0.026,0.149
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,Toto-2.0-22m,0.4,0.1,0.7,0.053,-0.016,0.118
-TiRex,Toto-1.0,0.6,0.3,0.9,-0.024,-0.099,0.043
-TiRex,TS-ICL,0.6,0.3,0.9,0.0,-0.099,0.079
-TiRex,Toto-2.0-1B,0.6,0.3,0.9,0.067,-0.01,0.141
-TiRex,Chronos-Bolt,0.7,0.4,0.9,0.013,-0.067,0.096
-TiRex,Seasonal Naive,0.9,0.7,1.0,0.389,0.216,0.543
-Toto-2.0-22m,t0-beta,0.3,0.0,0.6,-0.113,-0.253,-0.006
-Toto-2.0-22m,TimesFM-3,0.4,0.1,0.7,-0.069,-0.169,0.034
-Toto-2.0-22m,TimesFM-2.5,0.4,0.1,0.7,-0.085,-0.205,0.017
-Toto-2.0-22m,Chronos-2,0.3,0.1,0.6,-0.083,-0.222,0.035
-Toto-2.0-22m,TiRex-2,0.2,0.0,0.5,-0.029,-0.089,0.033
-Toto-2.0-22m,TabPFN-TS-3,0.3,0.1,0.6,-0.033,-0.152,0.11
-Toto-2.0-22m,citras-fm,0.4,0.1,0.7,-0.082,-0.188,0.014
-Toto-2.0-22m,Moirai-2.0,0.6,0.3,0.9,-0.106,-0.251,0.019
-Toto-2.0-22m,Toto-2.0-2.5B,0.4,0.1,0.7,0.009,-0.056,0.088
-Toto-2.0-22m,Toto-2.0-313m,0.6,0.3,0.9,0.01,-0.023,0.039
-Toto-2.0-22m,TiRex,0.6,0.3,0.9,-0.056,-0.134,0.016
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,Toto-1.0,0.4,0.1,0.7,-0.081,-0.186,0.005
-Toto-2.0-22m,TS-ICL,0.6,0.3,0.9,-0.055,-0.218,0.068
-Toto-2.0-22m,Toto-2.0-1B,0.7,0.4,1.0,0.014,-0.027,0.061
-Toto-2.0-22m,Chronos-Bolt,0.6,0.3,0.9,-0.042,-0.184,0.09
-Toto-2.0-22m,Seasonal Naive,0.8,0.6,1.0,0.355,0.161,0.532
-Toto-1.0,t0-beta,0.3,0.0,0.6,-0.029,-0.07,0.011
-Toto-1.0,TimesFM-3,0.3,0.1,0.6,0.012,-0.095,0.126
-Toto-1.0,TimesFM-2.5,0.4,0.1,0.7,-0.004,-0.128,0.098
-Toto-1.0,Chronos-2,0.4,0.1,0.7,-0.002,-0.084,0.072
-Toto-1.0,TiRex-2,0.5,0.2,0.8,0.048,-0.035,0.131
-Toto-1.0,TabPFN-TS-3,0.4,0.1,0.7,0.045,-0.068,0.161
-Toto-1.0,citras-fm,0.3,0.0,0.6,-0.001,-0.05,0.048
-Toto-1.0,Moirai-2.0,0.3,0.0,0.6,-0.023,-0.109,0.056
-Toto-1.0,Toto-2.0-2.5B,0.6,0.3,0.9,0.084,0.009,0.152
-Toto-1.0,Toto-2.0-313m,0.6,0.3,0.9,0.084,-0.003,0.17
-Toto-1.0,TiRex,0.4,0.1,0.7,0.023,-0.045,0.09
-Toto-1.0,Toto-2.0-22m,0.6,0.3,0.9,0.075,-0.005,0.157
-Toto-1.0,Toto-1.0,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-1.0,TS-ICL,0.4,0.1,0.7,0.024,-0.052,0.095
-Toto-1.0,Toto-2.0-1B,0.6,0.3,0.9,0.088,0.013,0.159
-Toto-1.0,Chronos-Bolt,0.5,0.2,0.8,0.036,-0.076,0.13
-Toto-1.0,Seasonal Naive,0.9,0.7,1.0,0.403,0.197,0.565
-TS-ICL,t0-beta,0.4,0.1,0.7,-0.054,-0.105,-0.01
-TS-ICL,TimesFM-3,0.4,0.1,0.7,-0.012,-0.131,0.14
-TS-ICL,TimesFM-2.5,0.4,0.1,0.7,-0.028,-0.158,0.095
-TS-ICL,Chronos-2,0.3,0.1,0.6,-0.026,-0.088,0.019
-TS-ICL,TiRex-2,0.4,0.1,0.7,0.025,-0.071,0.148
-TS-ICL,TabPFN-TS-3,0.4,0.1,0.7,0.022,-0.078,0.119
-TS-ICL,citras-fm,0.4,0.1,0.7,-0.025,-0.084,0.036
-TS-ICL,Moirai-2.0,0.5,0.2,0.8,-0.048,-0.132,0.02
-TS-ICL,Toto-2.0-2.5B,0.4,0.1,0.7,0.061,-0.038,0.165
-TS-ICL,Toto-2.0-313m,0.4,0.1,0.7,0.062,-0.064,0.194
-TS-ICL,TiRex,0.4,0.1,0.7,-0.0,-0.086,0.09
-TS-ICL,Toto-2.0-22m,0.4,0.1,0.7,0.053,-0.073,0.179
-TS-ICL,Toto-1.0,0.6,0.3,0.9,-0.024,-0.105,0.05
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,Toto-2.0-1B,0.4,0.1,0.7,0.066,-0.037,0.185
-TS-ICL,Chronos-Bolt,0.7,0.4,0.9,0.013,-0.093,0.11
-TS-ICL,Seasonal Naive,0.9,0.7,1.0,0.389,0.192,0.54
-Toto-2.0-1B,t0-beta,0.2,0.0,0.5,-0.129,-0.253,-0.031
-Toto-2.0-1B,TimesFM-3,0.4,0.1,0.7,-0.084,-0.177,0.002
-Toto-2.0-1B,TimesFM-2.5,0.5,0.2,0.8,-0.101,-0.247,0.007
-Toto-2.0-1B,Chronos-2,0.4,0.1,0.7,-0.099,-0.221,0.002
-Toto-2.0-1B,TiRex-2,0.3,0.1,0.6,-0.044,-0.097,-0.002
-Toto-2.0-1B,TabPFN-TS-3,0.4,0.1,0.7,-0.048,-0.173,0.078
-Toto-2.0-1B,citras-fm,0.5,0.2,0.8,-0.098,-0.191,-0.015
-Toto-2.0-1B,Moirai-2.0,0.5,0.2,0.8,-0.122,-0.282,0.011
-Toto-2.0-1B,Toto-2.0-2.5B,0.4,0.1,0.7,-0.005,-0.04,0.031
-Toto-2.0-1B,Toto-2.0-313m,0.4,0.1,0.7,-0.005,-0.039,0.023
-Toto-2.0-1B,TiRex,0.4,0.1,0.7,-0.071,-0.164,0.009
-Toto-2.0-1B,Toto-2.0-22m,0.3,0.0,0.6,-0.015,-0.065,0.026
-Toto-2.0-1B,Toto-1.0,0.4,0.1,0.7,-0.097,-0.189,-0.013
-Toto-2.0-1B,TS-ICL,0.6,0.3,0.9,-0.071,-0.228,0.036
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Chronos-Bolt,0.6,0.3,0.9,-0.057,-0.209,0.061
-Toto-2.0-1B,Seasonal Naive,0.8,0.6,1.0,0.345,0.128,0.509
-Chronos-Bolt,t0-beta,0.2,0.0,0.4,-0.068,-0.183,0.045
-Chronos-Bolt,TimesFM-3,0.3,0.0,0.6,-0.025,-0.122,0.064
-Chronos-Bolt,TimesFM-2.5,0.2,0.0,0.4,-0.042,-0.113,0.018
-Chronos-Bolt,Chronos-2,0.3,0.1,0.6,-0.039,-0.149,0.066
-Chronos-Bolt,TiRex-2,0.4,0.1,0.7,0.012,-0.091,0.113
-Chronos-Bolt,TabPFN-TS-3,0.4,0.1,0.7,0.009,-0.059,0.073
-Chronos-Bolt,citras-fm,0.4,0.1,0.7,-0.038,-0.126,0.053
-Chronos-Bolt,Moirai-2.0,0.25,0.049,0.5,-0.061,-0.147,0.013
-Chronos-Bolt,Toto-2.0-2.5B,0.4,0.1,0.7,0.049,-0.067,0.18
-Chronos-Bolt,Toto-2.0-313m,0.4,0.1,0.7,0.05,-0.094,0.173
-Chronos-Bolt,TiRex,0.3,0.1,0.6,-0.013,-0.106,0.062
-Chronos-Bolt,Toto-2.0-22m,0.4,0.1,0.7,0.04,-0.099,0.156
-Chronos-Bolt,Toto-1.0,0.5,0.2,0.8,-0.037,-0.15,0.071
-Chronos-Bolt,TS-ICL,0.3,0.1,0.6,-0.013,-0.123,0.085
-Chronos-Bolt,Toto-2.0-1B,0.4,0.1,0.7,0.054,-0.065,0.173
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.381,0.242,0.501
-Seasonal Naive,t0-beta,0.1,0.0,0.3,-0.724,-1.326,-0.277
-Seasonal Naive,TimesFM-3,0.1,0.0,0.3,-0.656,-1.092,-0.32
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.682,-1.155,-0.354
-Seasonal Naive,Chronos-2,0.1,0.0,0.3,-0.678,-1.217,-0.268
-Seasonal Naive,TiRex-2,0.1,0.0,0.3,-0.595,-1.088,-0.234
-Seasonal Naive,TabPFN-TS-3,0.1,0.0,0.3,-0.6,-0.979,-0.302
-Seasonal Naive,citras-fm,0.1,0.0,0.3,-0.677,-1.229,-0.279
-Seasonal Naive,Moirai-2.0,0.0,0.0,0.0,-0.714,-1.293,-0.32
-Seasonal Naive,Toto-2.0-2.5B,0.2,0.0,0.4,-0.535,-1.053,-0.133
-Seasonal Naive,Toto-2.0-313m,0.2,0.0,0.4,-0.535,-1.104,-0.153
-Seasonal Naive,TiRex,0.1,0.0,0.3,-0.636,-1.186,-0.275
-Seasonal Naive,Toto-2.0-22m,0.2,0.0,0.4,-0.55,-1.137,-0.191
-Seasonal Naive,Toto-1.0,0.1,0.0,0.3,-0.676,-1.297,-0.246
-Seasonal Naive,TS-ICL,0.1,0.0,0.3,-0.636,-1.172,-0.237
-Seasonal Naive,Toto-2.0-1B,0.2,0.0,0.4,-0.527,-1.038,-0.147
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.615,-1.006,-0.319
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_mobility/leaderboard_MASE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,94.00921658986175,33.79613754614167,0.0,2.0595019868573545,0.0,0.0
-Chronos-2,86.63594470046083,31.297845826674763,0.0,0.3612539066666667,0.0,0.0
-Toto-2.0-1B,83.41013824884793,29.93744282184213,0.0,2.398295585576923,0.0,0.0
-t0-beta,82.02764976958527,30.434889156277954,0.0,1.3111994363451884,0.0,0.0
-TimesFM-2.5,78.80184331797236,30.08997810079499,0.0,1.0402703727564104,0.0,0.0
-Toto-2.0-313m,78.80184331797234,29.655413564276433,0.0,1.0909461926282051,0.0,0.0
-Toto-2.0-2.5B,76.95852534562212,29.34036054759431,0.0,5.510428407333333,0.0,0.0
-TiRex,72.35023041474655,28.869849458291053,0.0,0.34079166541795664,0.0,0.0
-FlowState,71.88940092165899,28.358976057331542,0.0,1.8156494689102565,0.0,0.0
-TiRex-2,68.66359447004609,28.6618144795166,0.0,0.11997201882198961,0.0,0.0
-TS-ICL,65.43778801843318,27.616306234152965,0.0,1.2980779820384505,0.0,0.0
-Toto-2.0-22m,64.51612903225806,27.624459375998768,0.0,0.22678239423076924,0.0,0.0
-TabPFN-TS-3,61.75115207373272,26.238904121348316,0.0,258.6113400144229,0.0,0.0
-TFT,51.15207373271888,21.59101828180743,235.31247926551285,0.31370569066666665,0.0,0.0
-Moirai-2.0,48.156682027649765,25.335908970299936,0.0,2.231891133374613,1.0,0.0
-Chronos-Bolt,48.156682027649765,25.335908970299936,0.0,0.2157764139102564,0.0,0.0
-Toto-1.0,47.92626728110599,25.573203950705693,0.0,32.678425597307694,0.0,0.0
-citras-fm,46.08294930875576,24.96481070359039,0.0,0.550207410667402,0.0,0.0
-TabPFN-TS,45.16129032258064,24.532719864713304,0.0,157.00341927416665,0.0,0.0
-Toto-2.0-4m,45.16129032258064,23.095596464945533,0.0,0.17352653333333334,0.0,0.0
-Sundial-Base,44.23963133640553,23.393412693458927,0.0,7.825935737058823,0.0,0.0
-DeepAR,36.866359447004605,20.158757124750093,467.93394356724366,1.364175630448718,0.0,0.0
-LightGBM,36.866359447004605,19.233879992772206,2.110697158974359,0.21163459766666667,0.0,0.0
-CatBoost,36.866359447004605,18.807513597537383,21.985520585705128,0.26383776833333333,0.0,0.0
-PatchTST,32.718894009216584,16.989509965321957,225.99726746077397,0.38466677993589743,0.0,0.0
-Stat. Ensemble,23.50230414746544,7.694422260326506,0.0,226.8116654464487,0.0,14.285714285714285
-AutoARIMA,18.89400921658986,3.300627782307375,0.0,166.32244655789742,0.0,14.285714285714285
-AutoTheta,17.05069124423963,2.2840445944943277,0.0,2.6991318023333335,0.0,0.0
-Seasonal Naive,16.58986175115207,0.0,0.0,0.17224587897435897,0.0,0.0
-AutoETS,13.364055299539167,-16.79021320144407,0.0,7.4220258999999995,0.0,0.0
-Naive,5.0691244239631335,-40.74006367145597,0.0,0.193622721474359,0.0,0.0
-Drift,0.9216589861751152,-55.85219582340872,0.0,0.1885455092948718,0.0,0.0

tables/domain_mobility/leaderboard_SQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,92.62672811059907,45.97167153010899,0.0,2.0595019868573545,0.0,0.0
-Chronos-2,88.94009216589862,44.0257301550027,0.0,0.3612539066666667,0.0,0.0
-t0-beta,82.94930875576037,43.282809363869376,0.0,1.3111994363451884,0.0,0.0
-Toto-2.0-1B,82.02764976958527,42.89784402878507,0.0,2.398295585576923,0.0,0.0
-TimesFM-2.5,81.10599078341014,42.67646308976785,0.0,1.0402703727564104,0.0,0.0
-Toto-2.0-313m,78.34101382488478,42.58037472652917,0.0,1.0909461926282051,0.0,0.0
-Toto-2.0-2.5B,75.57603686635946,42.389618394267615,0.0,5.510428407333333,0.0,0.0
-TiRex,75.57603686635946,42.05186473784456,0.0,0.34079166541795664,0.0,0.0
-TiRex-2,72.35023041474655,41.88624154012951,0.0,0.11997201882198961,0.0,0.0
-FlowState,69.5852534562212,41.10947919178341,0.0,1.8156494689102565,0.0,0.0
-TabPFN-TS-3,67.74193548387096,39.7795308730858,0.0,258.6113400144229,0.0,0.0
-Toto-2.0-22m,66.82027649769586,41.25081408595533,0.0,0.22678239423076924,0.0,0.0
-TS-ICL,66.82027649769586,41.129041277782655,0.0,1.2980779820384505,0.0,0.0
-TFT,54.83870967741935,35.28274979848835,235.31247926551285,0.31370569066666665,0.0,0.0
-Toto-2.0-4m,50.69124423963134,37.62294495333535,0.0,0.17352653333333334,0.0,0.0
-citras-fm,49.76958525345622,37.27325369456074,0.0,0.550207410667402,0.0,0.0
-Toto-1.0,49.30875576036866,39.04058286932375,0.0,32.678425597307694,0.0,0.0
-TabPFN-TS,47.465437788018434,36.53371858952617,0.0,157.00341927416665,0.0,0.0
-Chronos-Bolt,46.774193548387096,37.28267455060899,0.0,0.2157764139102564,0.0,0.0
-Moirai-2.0,46.774193548387096,37.28267455060899,0.0,2.231891133374613,1.0,0.0
-DeepAR,45.6221198156682,34.81362887689631,467.93394356724366,1.364175630448718,0.0,0.0
-PatchTST,39.63133640552995,28.352379402273474,225.99726746077397,0.38466677993589743,0.0,0.0
-Sundial-Base,35.02304147465438,33.55369921291073,0.0,7.825935737058823,0.0,0.0
-AutoARIMA,23.963133640552996,12.567557563101495,0.0,166.32244655789742,0.0,14.285714285714285
-CatBoost,22.119815668202765,18.14162293295429,21.985520585705128,0.26383776833333333,0.0,0.0
-Stat. Ensemble,21.19815668202765,5.668302598674924,0.0,226.8116654464487,0.0,14.285714285714285
-LightGBM,21.19815668202765,18.571486122225835,2.110697158974359,0.21163459766666667,0.0,0.0
-Seasonal Naive,15.668202764976957,0.0,0.0,0.17224587897435897,0.0,0.0
-AutoTheta,13.824884792626726,-26.740946175062753,0.0,2.6991318023333335,0.0,0.0
-AutoETS,9.67741935483871,-344.79628797747506,0.0,7.4220258999999995,0.0,0.0
-Naive,4.6082949308755765,-146.7179766143382,0.0,0.193622721474359,0.0,0.0
-Drift,1.3824884792626728,-161.010293113985,0.0,0.1885455092948718,0.0,0.0

tables/domain_mobility/leaderboard_WAPE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,94.93087557603687,33.77830832848403,0.0,2.0595019868573545,0.0,0.0
-Chronos-2,84.7926267281106,31.4266145251638,0.0,0.3612539066666667,0.0,0.0
-Toto-2.0-1B,81.5668202764977,30.040761293064854,0.0,2.398295585576923,0.0,0.0
-t0-beta,80.64516129032258,29.92225442955647,0.0,1.3111994363451884,0.0,0.0
-Toto-2.0-313m,79.72350230414746,29.64325026676846,0.0,1.0909461926282051,0.0,0.0
-Toto-2.0-2.5B,78.34101382488478,29.487453453885294,0.0,5.510428407333333,0.0,0.0
-TimesFM-2.5,77.88018433179724,30.138028587482914,0.0,1.0402703727564104,0.0,0.0
-FlowState,70.96774193548387,28.54102491089481,0.0,1.8156494689102565,0.0,0.0
-TiRex-2,66.82027649769586,28.23741951420192,0.0,0.11997201882198961,0.0,0.0
-TS-ICL,66.3594470046083,27.870758295207644,0.0,1.2980779820384505,0.0,0.0
-TiRex,65.89861751152074,28.6697990451958,0.0,0.34079166541795664,0.0,0.0
-TabPFN-TS-3,65.43778801843317,27.003058480070795,0.0,258.6113400144229,0.0,0.0
-Toto-2.0-22m,64.0552995391705,27.95924087455105,0.0,0.22678239423076924,0.0,0.0
-TFT,53.91705069124424,22.688998509483994,235.31247926551285,0.31370569066666665,0.0,0.0
-TabPFN-TS,48.38709677419355,25.32355760868511,0.0,157.00341927416665,0.0,0.0
-Toto-1.0,47.92626728110599,25.92723519256259,0.0,32.678425597307694,0.0,0.0
-Chronos-Bolt,47.235023041474655,25.18849985695557,0.0,0.2157764139102564,0.0,0.0
-Moirai-2.0,47.235023041474655,25.18849985695557,0.0,2.231891133374613,1.0,0.0
-citras-fm,47.004608294930875,25.104163556462588,0.0,0.550207410667402,0.0,0.0
-Toto-2.0-4m,46.08294930875576,22.970522942844074,0.0,0.17352653333333334,0.0,0.0
-Sundial-Base,42.857142857142854,23.330206407241285,0.0,7.825935737058823,0.0,0.0
-DeepAR,41.013824884792626,21.081187839834037,467.93394356724366,1.364175630448718,0.0,0.0
-CatBoost,37.788018433179715,19.108828334469262,21.985520585705128,0.26383776833333333,0.0,0.0
-LightGBM,35.023041474654384,19.415152538379978,2.110697158974359,0.21163459766666667,0.0,0.0
-PatchTST,33.6405529953917,16.97148442691696,225.99726746077397,0.38466677993589743,0.0,0.0
-Stat. Ensemble,23.963133640552996,6.5098083173125705,0.0,226.8116654464487,0.0,14.285714285714285
-AutoARIMA,20.737327188940093,2.9139047191151235,0.0,166.32244655789742,0.0,14.285714285714285
-Seasonal Naive,16.58986175115207,0.0,0.0,0.17224587897435897,0.0,0.0
-AutoTheta,14.746543778801843,0.04374386375031181,0.0,2.6991318023333335,0.0,0.0
-AutoETS,12.442396313364053,-23.08073712658869,0.0,7.4220258999999995,0.0,0.0
-Naive,5.0691244239631335,-43.56382539762269,0.0,0.193622721474359,0.0,0.0
-Drift,0.9216589861751152,-58.78908533558298,0.0,0.1885455092948718,0.0,0.0

tables/domain_mobility/leaderboard_WQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,94.47004608294931,46.45822451097924,0.0,2.0595019868573545,0.0,0.0
-Chronos-2,86.63594470046083,44.54705190137261,0.0,0.3612539066666667,0.0,0.0
-Toto-2.0-1B,82.48847926267281,43.57639471435733,0.0,2.398295585576923,0.0,0.0
-t0-beta,80.64516129032258,43.41507620932563,0.0,1.3111994363451884,0.0,0.0
-TimesFM-2.5,80.64516129032258,43.23343389055629,0.0,1.0402703727564104,0.0,0.0
-Toto-2.0-2.5B,78.80184331797234,43.15731600629924,0.0,5.510428407333333,0.0,0.0
-Toto-2.0-313m,78.34101382488478,43.095077993747296,0.0,1.0909461926282051,0.0,0.0
-TabPFN-TS-3,70.50691244239631,40.91138061014927,0.0,258.6113400144229,0.0,0.0
-TiRex,69.58525345622121,42.41994460150037,0.0,0.34079166541795664,0.0,0.0
-TS-ICL,69.5852534562212,41.94648840704044,0.0,1.2980779820384505,0.0,0.0
-TiRex-2,68.66359447004608,41.95261502258993,0.0,0.11997201882198961,0.0,0.0
-FlowState,67.74193548387096,41.75327825678771,0.0,1.8156494689102565,0.0,0.0
-Toto-2.0-22m,66.82027649769586,41.89301824181608,0.0,0.22678239423076924,0.0,0.0
-TFT,58.06451612903226,36.840744132528904,235.31247926551285,0.31370569066666665,0.0,0.0
-citras-fm,50.23041474654379,37.89846253371203,0.0,0.550207410667402,0.0,0.0
-Toto-1.0,49.76958525345622,39.810526410008265,0.0,32.678425597307694,0.0,0.0
-TabPFN-TS,49.76958525345621,37.74075942414697,0.0,157.00341927416665,0.0,0.0
-Toto-2.0-4m,49.76958525345621,38.05335876302368,0.0,0.17352653333333334,0.0,0.0
-DeepAR,48.38709677419355,36.14199113093005,467.93394356724366,1.364175630448718,0.0,0.0
-Chronos-Bolt,46.774193548387096,37.73183131937476,0.0,0.2157764139102564,0.0,0.0
-Moirai-2.0,46.774193548387096,37.73183131937476,0.0,2.231891133374613,1.0,0.0
-PatchTST,36.405529953917046,28.980793211199895,225.99726746077397,0.38466677993589743,0.0,0.0
-Sundial-Base,35.483870967741936,34.17893470020018,0.0,7.825935737058823,0.0,0.0
-AutoARIMA,24.42396313364055,12.839232215840235,0.0,166.32244655789742,0.0,14.285714285714285
-CatBoost,22.58064516129032,19.204492596603718,21.985520585705128,0.26383776833333333,0.0,0.0
-LightGBM,21.658986175115206,19.51045461394707,2.110697158974359,0.21163459766666667,0.0,0.0
-Stat. Ensemble,19.815668202764975,3.9294085240204057,0.0,226.8116654464487,0.0,14.285714285714285
-Seasonal Naive,16.129032258064516,0.0,0.0,0.17224587897435897,0.0,0.0
-AutoTheta,13.364055299539167,-35.07795159983096,0.0,2.6991318023333335,0.0,0.0
-AutoETS,9.67741935483871,-351.4556695151647,0.0,7.4220258999999995,0.0,0.0
-Naive,4.6082949308755765,-144.85036530396843,0.0,0.193622721474359,0.0,0.0
-Drift,1.3824884792626728,-159.03481525283004,0.0,0.1885455092948718,0.0,0.0

tables/domain_mobility/pairwise_MASE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.571,0.143,0.857,0.036,-0.007,0.078
-TimesFM-3,Toto-2.0-1B,0.714,0.286,1.0,0.055,0.011,0.101
-TimesFM-3,t0-beta,0.857,0.571,1.0,0.048,0.011,0.092
-TimesFM-3,Toto-2.0-313m,0.857,0.571,1.0,0.059,0.014,0.108
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.053,0.033,0.071
-TimesFM-3,Toto-2.0-2.5B,0.857,0.571,1.0,0.063,0.021,0.11
-TimesFM-3,TiRex,0.857,0.571,1.0,0.069,0.026,0.117
-TimesFM-3,FlowState,1.0,1.0,1.0,0.076,0.045,0.106
-TimesFM-3,TiRex-2,0.857,0.571,1.0,0.072,0.024,0.129
-TimesFM-3,TS-ICL,1.0,1.0,1.0,0.085,0.045,0.129
-TimesFM-3,Toto-2.0-22m,0.714,0.286,1.0,0.085,0.022,0.154
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.102,0.047,0.158
-TimesFM-3,TFT,1.0,1.0,1.0,0.156,0.061,0.28
-TimesFM-3,Moirai-2.0,1.0,1.0,1.0,0.113,0.061,0.173
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.113,0.061,0.173
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.338,0.241,0.428
-Chronos-2,TimesFM-3,0.429,0.143,0.857,-0.038,-0.085,0.007
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-2.0-1B,0.571,0.286,0.857,0.019,-0.004,0.059
-Chronos-2,t0-beta,0.571,0.286,0.861,0.012,-0.017,0.043
-Chronos-2,Toto-2.0-313m,0.714,0.429,1.0,0.023,-0.005,0.069
-Chronos-2,TimesFM-2.5,0.571,0.286,0.857,0.017,-0.024,0.061
-Chronos-2,Toto-2.0-2.5B,0.571,0.286,0.857,0.028,-0.004,0.074
-Chronos-2,TiRex,0.857,0.571,1.0,0.034,0.009,0.076
-Chronos-2,FlowState,0.714,0.429,1.0,0.041,0.003,0.083
-Chronos-2,TiRex-2,0.714,0.429,1.0,0.037,0.005,0.089
-Chronos-2,TS-ICL,0.714,0.429,1.0,0.051,-0.001,0.11
-Chronos-2,Toto-2.0-22m,0.857,0.571,1.0,0.051,0.009,0.117
-Chronos-2,TabPFN-TS-3,0.714,0.429,1.0,0.069,0.01,0.138
-Chronos-2,TFT,1.0,1.0,1.0,0.124,0.027,0.265
-Chronos-2,Moirai-2.0,1.0,1.0,1.0,0.08,0.037,0.13
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.08,0.037,0.13
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.313,0.233,0.391
-Toto-2.0-1B,TimesFM-3,0.286,0.0,0.714,-0.058,-0.113,-0.011
-Toto-2.0-1B,Chronos-2,0.429,0.143,0.714,-0.02,-0.063,0.004
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,t0-beta,0.429,0.143,0.857,-0.007,-0.041,0.026
-Toto-2.0-1B,Toto-2.0-313m,0.714,0.429,1.0,0.004,-0.002,0.01
-Toto-2.0-1B,TimesFM-2.5,0.429,0.143,0.857,-0.002,-0.038,0.036
-Toto-2.0-1B,Toto-2.0-2.5B,0.714,0.429,1.0,0.008,-0.002,0.02
-Toto-2.0-1B,TiRex,0.857,0.571,1.0,0.015,0.005,0.027
-Toto-2.0-1B,FlowState,0.571,0.143,0.861,0.022,-0.007,0.059
-Toto-2.0-1B,TiRex-2,0.857,0.571,1.0,0.018,0.006,0.034
-Toto-2.0-1B,TS-ICL,0.857,0.571,1.0,0.032,-0.003,0.073
-Toto-2.0-1B,Toto-2.0-22m,0.857,0.571,1.0,0.032,0.008,0.063
-Toto-2.0-1B,TabPFN-TS-3,0.714,0.429,1.0,0.05,0.004,0.118
-Toto-2.0-1B,TFT,0.714,0.429,1.0,0.106,0.001,0.254
-Toto-2.0-1B,Moirai-2.0,0.857,0.571,1.0,0.062,0.022,0.111
-Toto-2.0-1B,Chronos-Bolt,0.857,0.571,1.0,0.062,0.022,0.111
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.299,0.225,0.368
-t0-beta,TimesFM-3,0.143,0.0,0.429,-0.051,-0.101,-0.011
-t0-beta,Chronos-2,0.429,0.139,0.714,-0.013,-0.045,0.017
-t0-beta,Toto-2.0-1B,0.571,0.143,0.857,0.007,-0.026,0.039
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-2.0-313m,0.571,0.143,0.857,0.011,-0.025,0.046
-t0-beta,TimesFM-2.5,0.714,0.429,1.0,0.005,-0.027,0.028
-t0-beta,Toto-2.0-2.5B,0.571,0.143,0.857,0.015,-0.014,0.048
-t0-beta,TiRex,0.714,0.286,1.0,0.022,-0.009,0.05
-t0-beta,FlowState,0.857,0.571,1.0,0.029,0.007,0.047
-t0-beta,TiRex-2,0.571,0.143,0.857,0.025,-0.012,0.063
-t0-beta,TS-ICL,0.714,0.429,1.0,0.039,0.001,0.08
-t0-beta,Toto-2.0-22m,0.714,0.286,1.0,0.039,-0.014,0.093
-t0-beta,TabPFN-TS-3,0.857,0.571,1.0,0.057,0.019,0.107
-t0-beta,TFT,0.714,0.286,1.0,0.113,0.007,0.248
-t0-beta,Moirai-2.0,1.0,1.0,1.0,0.068,0.038,0.097
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.068,0.038,0.097
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.304,0.223,0.377
-Toto-2.0-313m,TimesFM-3,0.143,0.0,0.429,-0.063,-0.121,-0.015
-Toto-2.0-313m,Chronos-2,0.286,0.0,0.571,-0.024,-0.074,0.005
-Toto-2.0-313m,Toto-2.0-1B,0.286,0.0,0.571,-0.004,-0.011,0.002
-Toto-2.0-313m,t0-beta,0.429,0.143,0.857,-0.011,-0.048,0.024
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TimesFM-2.5,0.429,0.143,0.857,-0.006,-0.044,0.033
-Toto-2.0-313m,Toto-2.0-2.5B,0.714,0.429,1.0,0.004,-0.004,0.013
-Toto-2.0-313m,TiRex,0.714,0.429,1.0,0.011,-0.002,0.025
-Toto-2.0-313m,FlowState,0.571,0.143,0.861,0.018,-0.014,0.057
-Toto-2.0-313m,TiRex-2,0.857,0.571,1.0,0.014,0.003,0.027
-Toto-2.0-313m,TS-ICL,0.857,0.571,1.0,0.028,-0.003,0.067
-Toto-2.0-313m,Toto-2.0-22m,0.857,0.571,1.0,0.028,0.006,0.055
-Toto-2.0-313m,TabPFN-TS-3,0.714,0.429,1.0,0.046,0.0,0.113
-Toto-2.0-313m,TFT,0.714,0.429,1.0,0.103,-0.008,0.254
-Toto-2.0-313m,Moirai-2.0,0.857,0.571,1.0,0.058,0.019,0.105
-Toto-2.0-313m,Chronos-Bolt,0.857,0.571,1.0,0.058,0.019,0.105
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.297,0.224,0.365
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.056,-0.077,-0.034
-TimesFM-2.5,Chronos-2,0.429,0.143,0.714,-0.018,-0.065,0.024
-TimesFM-2.5,Toto-2.0-1B,0.571,0.143,0.857,0.002,-0.038,0.037
-TimesFM-2.5,t0-beta,0.286,0.0,0.571,-0.005,-0.029,0.026
-TimesFM-2.5,Toto-2.0-313m,0.571,0.143,0.857,0.006,-0.035,0.042
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Toto-2.0-2.5B,0.571,0.143,0.857,0.011,-0.025,0.043
-TimesFM-2.5,TiRex,0.571,0.143,0.857,0.017,-0.021,0.051
-TimesFM-2.5,FlowState,0.857,0.571,1.0,0.024,0.01,0.038
-TimesFM-2.5,TiRex-2,0.571,0.143,0.857,0.02,-0.024,0.062
-TimesFM-2.5,TS-ICL,0.857,0.571,1.0,0.034,0.005,0.066
-TimesFM-2.5,Toto-2.0-22m,0.714,0.286,1.0,0.034,-0.024,0.09
-TimesFM-2.5,TabPFN-TS-3,0.714,0.429,1.0,0.052,0.008,0.103
-TimesFM-2.5,TFT,0.714,0.429,1.0,0.108,0.007,0.239
-TimesFM-2.5,Moirai-2.0,0.857,0.571,1.0,0.064,0.022,0.113
-TimesFM-2.5,Chronos-Bolt,0.857,0.571,1.0,0.064,0.022,0.113
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.301,0.204,0.39
-Toto-2.0-2.5B,TimesFM-3,0.143,0.0,0.429,-0.067,-0.124,-0.022
-Toto-2.0-2.5B,Chronos-2,0.429,0.143,0.714,-0.028,-0.079,0.004
-Toto-2.0-2.5B,Toto-2.0-1B,0.286,0.0,0.571,-0.009,-0.021,0.002
-Toto-2.0-2.5B,t0-beta,0.429,0.143,0.857,-0.016,-0.05,0.014
-Toto-2.0-2.5B,Toto-2.0-313m,0.286,0.0,0.571,-0.004,-0.014,0.004
-Toto-2.0-2.5B,TimesFM-2.5,0.429,0.143,0.857,-0.011,-0.045,0.024
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TiRex,0.714,0.429,1.0,0.007,-0.009,0.02
-Toto-2.0-2.5B,FlowState,0.571,0.143,0.861,0.014,-0.014,0.047
-Toto-2.0-2.5B,TiRex-2,0.714,0.429,1.0,0.01,-0.004,0.022
-Toto-2.0-2.5B,TS-ICL,0.714,0.429,1.0,0.024,-0.002,0.054
-Toto-2.0-2.5B,Toto-2.0-22m,0.857,0.571,1.0,0.024,-0.007,0.052
-Toto-2.0-2.5B,TabPFN-TS-3,0.714,0.429,1.0,0.042,0.004,0.101
-Toto-2.0-2.5B,TFT,0.714,0.429,1.0,0.099,-0.014,0.25
-Toto-2.0-2.5B,Moirai-2.0,1.0,1.0,1.0,0.054,0.022,0.092
-Toto-2.0-2.5B,Chronos-Bolt,1.0,1.0,1.0,0.054,0.022,0.092
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.293,0.215,0.364
-TiRex,TimesFM-3,0.143,0.0,0.429,-0.074,-0.132,-0.026
-TiRex,Chronos-2,0.143,0.0,0.429,-0.035,-0.082,-0.009
-TiRex,Toto-2.0-1B,0.143,0.0,0.429,-0.015,-0.028,-0.005
-TiRex,t0-beta,0.286,0.0,0.714,-0.022,-0.053,0.009
-TiRex,Toto-2.0-313m,0.286,0.0,0.571,-0.011,-0.026,0.002
-TiRex,TimesFM-2.5,0.429,0.143,0.857,-0.017,-0.054,0.02
-TiRex,Toto-2.0-2.5B,0.286,0.0,0.571,-0.007,-0.02,0.009
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,FlowState,0.429,0.143,0.857,0.007,-0.022,0.044
-TiRex,TiRex-2,0.571,0.286,0.857,0.003,-0.01,0.018
-TiRex,TS-ICL,0.571,0.286,0.857,0.017,-0.018,0.06
-TiRex,Toto-2.0-22m,0.714,0.286,1.0,0.017,-0.007,0.048
-TiRex,TabPFN-TS-3,0.714,0.429,1.0,0.036,-0.006,0.104
-TiRex,TFT,0.714,0.286,1.0,0.093,-0.014,0.239
-TiRex,Moirai-2.0,1.0,1.0,1.0,0.047,0.014,0.095
-TiRex,Chronos-Bolt,1.0,1.0,1.0,0.047,0.014,0.095
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.289,0.214,0.356
-FlowState,TimesFM-3,0.0,0.0,0.0,-0.082,-0.118,-0.047
-FlowState,Chronos-2,0.286,0.0,0.571,-0.043,-0.09,-0.003
-FlowState,Toto-2.0-1B,0.429,0.139,0.857,-0.023,-0.062,0.007
-FlowState,t0-beta,0.143,0.0,0.429,-0.03,-0.049,-0.007
-FlowState,Toto-2.0-313m,0.429,0.139,0.857,-0.018,-0.06,0.014
-FlowState,TimesFM-2.5,0.143,0.0,0.429,-0.025,-0.039,-0.01
-FlowState,Toto-2.0-2.5B,0.429,0.139,0.857,-0.014,-0.049,0.014
-FlowState,TiRex,0.571,0.143,0.857,-0.007,-0.046,0.022
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TiRex-2,0.571,0.143,0.857,-0.004,-0.049,0.032
-FlowState,TS-ICL,0.429,0.143,0.857,0.01,-0.02,0.042
-FlowState,Toto-2.0-22m,0.571,0.143,0.857,0.01,-0.052,0.063
-FlowState,TabPFN-TS-3,0.857,0.571,1.0,0.029,-0.01,0.081
-FlowState,TFT,0.714,0.429,1.0,0.086,-0.018,0.218
-FlowState,Moirai-2.0,0.857,0.571,1.0,0.04,0.002,0.079
-FlowState,Chronos-Bolt,0.857,0.571,1.0,0.04,0.002,0.079
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.284,0.193,0.366
-TiRex-2,TimesFM-3,0.143,0.0,0.429,-0.078,-0.148,-0.024
-TiRex-2,Chronos-2,0.286,0.0,0.571,-0.038,-0.098,-0.005
-TiRex-2,Toto-2.0-1B,0.143,0.0,0.429,-0.018,-0.035,-0.006
-TiRex-2,t0-beta,0.429,0.143,0.857,-0.025,-0.067,0.012
-TiRex-2,Toto-2.0-313m,0.143,0.0,0.429,-0.014,-0.027,-0.003
-TiRex-2,TimesFM-2.5,0.429,0.143,0.857,-0.02,-0.066,0.024
-TiRex-2,Toto-2.0-2.5B,0.286,0.0,0.571,-0.01,-0.022,0.004
-TiRex-2,TiRex,0.429,0.143,0.714,-0.003,-0.018,0.01
-TiRex-2,FlowState,0.429,0.143,0.857,0.004,-0.033,0.047
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TS-ICL,0.714,0.429,1.0,0.014,-0.019,0.058
-TiRex-2,Toto-2.0-22m,0.714,0.286,1.0,0.014,-0.004,0.032
-TiRex-2,TabPFN-TS-3,0.571,0.143,0.861,0.033,-0.011,0.103
-TiRex-2,TFT,0.714,0.429,1.0,0.09,-0.031,0.244
-TiRex-2,Moirai-2.0,0.714,0.429,1.0,0.045,0.005,0.092
-TiRex-2,Chronos-Bolt,0.714,0.429,1.0,0.045,0.005,0.092
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.287,0.218,0.352
-TS-ICL,TimesFM-3,0.0,0.0,0.0,-0.093,-0.148,-0.047
-TS-ICL,Chronos-2,0.286,0.0,0.571,-0.054,-0.124,0.001
-TS-ICL,Toto-2.0-1B,0.143,0.0,0.429,-0.033,-0.079,0.003
-TS-ICL,t0-beta,0.286,0.0,0.571,-0.041,-0.087,-0.001
-TS-ICL,Toto-2.0-313m,0.143,0.0,0.429,-0.029,-0.072,0.003
-TS-ICL,TimesFM-2.5,0.143,0.0,0.429,-0.035,-0.07,-0.005
-TS-ICL,Toto-2.0-2.5B,0.286,0.0,0.571,-0.024,-0.057,0.002
-TS-ICL,TiRex,0.429,0.143,0.714,-0.018,-0.064,0.017
-TS-ICL,FlowState,0.571,0.143,0.857,-0.01,-0.044,0.019
-TS-ICL,TiRex-2,0.286,0.0,0.571,-0.015,-0.061,0.019
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,Toto-2.0-22m,0.429,0.143,0.857,-0.0,-0.061,0.042
-TS-ICL,TabPFN-TS-3,0.714,0.286,1.0,0.019,-0.016,0.06
-TS-ICL,TFT,0.714,0.429,1.0,0.077,-0.055,0.224
-TS-ICL,Moirai-2.0,0.857,0.571,1.0,0.031,-0.003,0.072
-TS-ICL,Chronos-Bolt,0.857,0.571,1.0,0.031,-0.003,0.072
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.276,0.175,0.361
-Toto-2.0-22m,TimesFM-3,0.286,0.0,0.714,-0.093,-0.182,-0.022
-Toto-2.0-22m,Chronos-2,0.143,0.0,0.429,-0.053,-0.133,-0.009
-Toto-2.0-22m,Toto-2.0-1B,0.143,0.0,0.429,-0.033,-0.067,-0.008
-Toto-2.0-22m,t0-beta,0.286,0.0,0.714,-0.04,-0.103,0.014
-Toto-2.0-22m,Toto-2.0-313m,0.143,0.0,0.429,-0.029,-0.058,-0.006
-Toto-2.0-22m,TimesFM-2.5,0.286,0.0,0.714,-0.035,-0.099,0.024
-Toto-2.0-22m,Toto-2.0-2.5B,0.143,0.0,0.429,-0.024,-0.055,0.007
-Toto-2.0-22m,TiRex,0.286,0.0,0.714,-0.018,-0.05,0.007
-Toto-2.0-22m,FlowState,0.429,0.143,0.857,-0.01,-0.067,0.049
-Toto-2.0-22m,TiRex-2,0.286,0.0,0.714,-0.015,-0.033,0.004
-Toto-2.0-22m,TS-ICL,0.571,0.143,0.857,0.0,-0.043,0.057
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TabPFN-TS-3,0.571,0.143,0.861,0.019,-0.042,0.106
-Toto-2.0-22m,TFT,0.571,0.143,0.857,0.077,-0.063,0.239
-Toto-2.0-22m,Moirai-2.0,0.714,0.429,1.0,0.031,-0.021,0.093
-Toto-2.0-22m,Chronos-Bolt,0.714,0.429,1.0,0.031,-0.021,0.093
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.276,0.213,0.338
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.114,-0.188,-0.05
-TabPFN-TS-3,Chronos-2,0.286,0.0,0.571,-0.074,-0.16,-0.01
-TabPFN-TS-3,Toto-2.0-1B,0.286,0.0,0.571,-0.053,-0.134,-0.004
-TabPFN-TS-3,t0-beta,0.143,0.0,0.429,-0.06,-0.12,-0.019
-TabPFN-TS-3,Toto-2.0-313m,0.286,0.0,0.571,-0.049,-0.128,-0.0
-TabPFN-TS-3,TimesFM-2.5,0.286,0.0,0.571,-0.055,-0.115,-0.009
-TabPFN-TS-3,Toto-2.0-2.5B,0.286,0.0,0.571,-0.044,-0.112,-0.004
-TabPFN-TS-3,TiRex,0.286,0.0,0.571,-0.037,-0.116,0.006
-TabPFN-TS-3,FlowState,0.143,0.0,0.429,-0.03,-0.088,0.01
-TabPFN-TS-3,TiRex-2,0.429,0.139,0.857,-0.034,-0.114,0.011
-TabPFN-TS-3,TS-ICL,0.286,0.0,0.714,-0.019,-0.064,0.016
-TabPFN-TS-3,Toto-2.0-22m,0.429,0.139,0.857,-0.019,-0.118,0.04
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TFT,0.571,0.143,0.857,0.059,-0.093,0.223
-TabPFN-TS-3,Moirai-2.0,0.857,0.571,1.0,0.012,-0.03,0.051
-TabPFN-TS-3,Chronos-Bolt,0.857,0.571,1.0,0.012,-0.03,0.051
-TabPFN-TS-3,Seasonal Naive,0.857,0.571,1.0,0.262,0.138,0.349
-TFT,TimesFM-3,0.0,0.0,0.0,-0.184,-0.389,-0.065
-TFT,Chronos-2,0.0,0.0,0.0,-0.141,-0.36,-0.027
-TFT,Toto-2.0-1B,0.286,0.0,0.571,-0.119,-0.341,-0.001
-TFT,t0-beta,0.286,0.0,0.714,-0.127,-0.329,-0.007
-TFT,Toto-2.0-313m,0.286,0.0,0.571,-0.115,-0.341,0.008
-TFT,TimesFM-2.5,0.286,0.0,0.571,-0.122,-0.315,-0.008
-TFT,Toto-2.0-2.5B,0.286,0.0,0.571,-0.11,-0.334,0.014
-TFT,TiRex,0.286,0.0,0.714,-0.102,-0.314,0.014
-TFT,FlowState,0.286,0.0,0.571,-0.094,-0.279,0.017
-TFT,TiRex-2,0.286,0.0,0.571,-0.099,-0.323,0.03
-TFT,TS-ICL,0.286,0.0,0.571,-0.083,-0.289,0.052
-TFT,Toto-2.0-22m,0.429,0.143,0.857,-0.083,-0.314,0.06
-TFT,TabPFN-TS-3,0.429,0.143,0.857,-0.063,-0.288,0.085
-TFT,TFT,0.5,0.5,0.5,0.0,0.0,0.0
-TFT,Moirai-2.0,0.571,0.282,0.857,-0.05,-0.267,0.086
-TFT,Chronos-Bolt,0.571,0.282,0.857,-0.05,-0.267,0.086
-TFT,Seasonal Naive,0.857,0.571,1.0,0.216,0.01,0.356
-Moirai-2.0,TimesFM-3,0.0,0.0,0.0,-0.128,-0.209,-0.065
-Moirai-2.0,Chronos-2,0.0,0.0,0.0,-0.087,-0.149,-0.038
-Moirai-2.0,Toto-2.0-1B,0.143,0.0,0.429,-0.066,-0.125,-0.023
-Moirai-2.0,t0-beta,0.0,0.0,0.0,-0.073,-0.108,-0.04
-Moirai-2.0,Toto-2.0-313m,0.143,0.0,0.429,-0.061,-0.117,-0.019
-Moirai-2.0,TimesFM-2.5,0.143,0.0,0.429,-0.068,-0.127,-0.022
-Moirai-2.0,Toto-2.0-2.5B,0.0,0.0,0.0,-0.057,-0.102,-0.022
-Moirai-2.0,TiRex,0.0,0.0,0.0,-0.05,-0.105,-0.014
-Moirai-2.0,FlowState,0.143,0.0,0.429,-0.042,-0.086,-0.002
-Moirai-2.0,TiRex-2,0.286,0.0,0.571,-0.047,-0.101,-0.005
-Moirai-2.0,TS-ICL,0.143,0.0,0.429,-0.032,-0.078,0.003
-Moirai-2.0,Toto-2.0-22m,0.286,0.0,0.571,-0.032,-0.103,0.021
-Moirai-2.0,TabPFN-TS-3,0.143,0.0,0.429,-0.012,-0.053,0.029
-Moirai-2.0,TFT,0.429,0.143,0.718,0.048,-0.094,0.21
-Moirai-2.0,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Moirai-2.0,Seasonal Naive,1.0,1.0,1.0,0.253,0.16,0.33
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.128,-0.209,-0.065
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.087,-0.149,-0.038
-Chronos-Bolt,Toto-2.0-1B,0.143,0.0,0.429,-0.066,-0.125,-0.023
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.073,-0.108,-0.04
-Chronos-Bolt,Toto-2.0-313m,0.143,0.0,0.429,-0.061,-0.117,-0.019
-Chronos-Bolt,TimesFM-2.5,0.143,0.0,0.429,-0.068,-0.127,-0.022
-Chronos-Bolt,Toto-2.0-2.5B,0.0,0.0,0.0,-0.057,-0.102,-0.022
-Chronos-Bolt,TiRex,0.0,0.0,0.0,-0.05,-0.105,-0.014
-Chronos-Bolt,FlowState,0.143,0.0,0.429,-0.042,-0.086,-0.002
-Chronos-Bolt,TiRex-2,0.286,0.0,0.571,-0.047,-0.101,-0.005
-Chronos-Bolt,TS-ICL,0.143,0.0,0.429,-0.032,-0.078,0.003
-Chronos-Bolt,Toto-2.0-22m,0.286,0.0,0.571,-0.032,-0.103,0.021
-Chronos-Bolt,TabPFN-TS-3,0.143,0.0,0.429,-0.012,-0.053,0.029
-Chronos-Bolt,TFT,0.429,0.143,0.718,0.048,-0.094,0.21
-Chronos-Bolt,Moirai-2.0,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.253,0.16,0.33
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.51,-0.747,-0.318
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.456,-0.641,-0.304
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.427,-0.582,-0.291
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.438,-0.606,-0.288
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.422,-0.575,-0.289
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.43,-0.639,-0.257
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.415,-0.573,-0.274
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.406,-0.554,-0.272
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.396,-0.577,-0.238
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.402,-0.542,-0.279
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.382,-0.564,-0.212
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.382,-0.512,-0.27
-Seasonal Naive,TabPFN-TS-3,0.143,0.0,0.429,-0.356,-0.536,-0.16
-Seasonal Naive,TFT,0.143,0.0,0.429,-0.275,-0.552,-0.01
-Seasonal Naive,Moirai-2.0,0.0,0.0,0.0,-0.339,-0.492,-0.191
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.339,-0.492,-0.191
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_mobility/pairwise_SQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.571,0.143,0.857,0.035,-0.01,0.079
-TimesFM-3,Toto-2.0-1B,0.714,0.286,1.0,0.054,0.002,0.105
-TimesFM-3,t0-beta,0.857,0.571,1.0,0.047,0.011,0.088
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.057,0.034,0.079
-TimesFM-3,Toto-2.0-313m,0.714,0.286,1.0,0.059,0.005,0.114
-TimesFM-3,Toto-2.0-2.5B,0.857,0.571,1.0,0.062,0.013,0.113
-TimesFM-3,TiRex,0.857,0.571,1.0,0.068,0.024,0.115
-TimesFM-3,TiRex-2,0.714,0.286,1.0,0.07,0.021,0.129
-TimesFM-3,FlowState,1.0,1.0,1.0,0.083,0.051,0.113
-TimesFM-3,Toto-2.0-22m,0.714,0.286,1.0,0.08,0.014,0.149
-TimesFM-3,TS-ICL,1.0,1.0,1.0,0.082,0.046,0.122
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.103,0.049,0.161
-TimesFM-3,TFT,1.0,1.0,1.0,0.165,0.07,0.291
-TimesFM-3,Toto-2.0-4m,0.857,0.571,1.0,0.134,0.046,0.222
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.139,0.081,0.203
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.46,0.347,0.555
-Chronos-2,TimesFM-3,0.429,0.143,0.857,-0.036,-0.085,0.01
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-2.0-1B,0.714,0.429,1.0,0.02,-0.007,0.057
-Chronos-2,t0-beta,0.714,0.429,1.0,0.013,-0.012,0.039
-Chronos-2,TimesFM-2.5,0.571,0.286,0.857,0.024,-0.013,0.065
-Chronos-2,Toto-2.0-313m,0.714,0.429,1.0,0.025,-0.008,0.07
-Chronos-2,Toto-2.0-2.5B,0.714,0.429,1.0,0.028,-0.004,0.074
-Chronos-2,TiRex,1.0,1.0,1.0,0.034,0.012,0.07
-Chronos-2,TiRex-2,0.714,0.429,1.0,0.037,0.006,0.085
-Chronos-2,FlowState,0.714,0.429,1.0,0.05,0.013,0.09
-Chronos-2,Toto-2.0-22m,0.857,0.571,1.0,0.047,0.006,0.111
-Chronos-2,TS-ICL,0.714,0.429,1.0,0.049,-0.001,0.106
-Chronos-2,TabPFN-TS-3,0.714,0.429,1.0,0.071,0.011,0.146
-Chronos-2,TFT,1.0,1.0,1.0,0.135,0.036,0.278
-Chronos-2,Toto-2.0-4m,1.0,1.0,1.0,0.103,0.044,0.169
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.108,0.053,0.172
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.44,0.347,0.521
-Toto-2.0-1B,TimesFM-3,0.286,0.0,0.714,-0.057,-0.117,-0.002
-Toto-2.0-1B,Chronos-2,0.286,0.0,0.571,-0.02,-0.06,0.007
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,t0-beta,0.429,0.143,0.857,-0.007,-0.045,0.03
-Toto-2.0-1B,TimesFM-2.5,0.429,0.143,0.857,0.004,-0.035,0.048
-Toto-2.0-1B,Toto-2.0-313m,0.714,0.429,1.0,0.006,-0.001,0.014
-Toto-2.0-1B,Toto-2.0-2.5B,0.429,0.143,0.857,0.009,-0.003,0.021
-Toto-2.0-1B,TiRex,0.857,0.571,1.0,0.015,-0.002,0.031
-Toto-2.0-1B,TiRex-2,0.714,0.429,1.0,0.017,0.002,0.036
-Toto-2.0-1B,FlowState,0.714,0.429,1.0,0.03,-0.001,0.07
-Toto-2.0-1B,Toto-2.0-22m,0.857,0.571,1.0,0.028,0.005,0.058
-Toto-2.0-1B,TS-ICL,0.857,0.571,1.0,0.03,-0.01,0.073
-Toto-2.0-1B,TabPFN-TS-3,0.714,0.429,1.0,0.052,-0.001,0.124
-Toto-2.0-1B,TFT,0.857,0.571,1.0,0.118,0.011,0.273
-Toto-2.0-1B,Toto-2.0-4m,1.0,1.0,1.0,0.085,0.042,0.131
-Toto-2.0-1B,Chronos-Bolt,0.857,0.571,1.0,0.09,0.028,0.164
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.429,0.332,0.513
-t0-beta,TimesFM-3,0.143,0.0,0.429,-0.05,-0.097,-0.011
-t0-beta,Chronos-2,0.286,0.0,0.571,-0.013,-0.041,0.012
-t0-beta,Toto-2.0-1B,0.571,0.143,0.857,0.007,-0.031,0.043
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,TimesFM-2.5,0.714,0.429,1.0,0.011,-0.015,0.033
-t0-beta,Toto-2.0-313m,0.429,0.139,0.857,0.012,-0.029,0.051
-t0-beta,Toto-2.0-2.5B,0.714,0.429,1.0,0.016,-0.021,0.051
-t0-beta,TiRex,0.714,0.286,1.0,0.021,-0.006,0.048
-t0-beta,TiRex-2,0.714,0.286,1.0,0.024,-0.009,0.059
-t0-beta,FlowState,0.857,0.571,1.0,0.037,0.017,0.056
-t0-beta,Toto-2.0-22m,0.714,0.286,1.0,0.035,-0.015,0.088
-t0-beta,TS-ICL,0.714,0.429,1.0,0.037,-0.0,0.077
-t0-beta,TabPFN-TS-3,0.857,0.571,1.0,0.058,0.016,0.115
-t0-beta,TFT,0.857,0.571,1.0,0.124,0.021,0.258
-t0-beta,Toto-2.0-4m,0.714,0.286,1.0,0.091,0.023,0.154
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.096,0.056,0.146
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.433,0.337,0.518
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.061,-0.086,-0.035
-TimesFM-2.5,Chronos-2,0.429,0.143,0.714,-0.024,-0.069,0.013
-TimesFM-2.5,Toto-2.0-1B,0.571,0.143,0.857,-0.004,-0.05,0.034
-TimesFM-2.5,t0-beta,0.286,0.0,0.571,-0.011,-0.034,0.014
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Toto-2.0-313m,0.571,0.143,0.857,0.002,-0.046,0.042
-TimesFM-2.5,Toto-2.0-2.5B,0.571,0.143,0.857,0.005,-0.036,0.042
-TimesFM-2.5,TiRex,0.571,0.143,0.857,0.011,-0.028,0.042
-TimesFM-2.5,TiRex-2,0.571,0.143,0.857,0.014,-0.031,0.055
-TimesFM-2.5,FlowState,1.0,1.0,1.0,0.027,0.016,0.038
-TimesFM-2.5,Toto-2.0-22m,0.714,0.286,1.0,0.024,-0.038,0.08
-TimesFM-2.5,TS-ICL,0.857,0.571,1.0,0.026,0.007,0.053
-TimesFM-2.5,TabPFN-TS-3,0.714,0.429,1.0,0.048,0.009,0.096
-TimesFM-2.5,TFT,0.857,0.571,1.0,0.114,0.011,0.253
-TimesFM-2.5,Toto-2.0-4m,0.714,0.286,1.0,0.081,0.002,0.157
-TimesFM-2.5,Chronos-Bolt,1.0,1.0,1.0,0.086,0.044,0.139
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.427,0.314,0.522
-Toto-2.0-313m,TimesFM-3,0.286,0.0,0.714,-0.063,-0.128,-0.005
-Toto-2.0-313m,Chronos-2,0.286,0.0,0.571,-0.026,-0.075,0.008
-Toto-2.0-313m,Toto-2.0-1B,0.286,0.0,0.571,-0.006,-0.014,0.001
-Toto-2.0-313m,t0-beta,0.571,0.143,0.861,-0.012,-0.054,0.028
-Toto-2.0-313m,TimesFM-2.5,0.429,0.143,0.857,-0.002,-0.044,0.044
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,Toto-2.0-2.5B,0.714,0.429,1.0,0.003,-0.004,0.012
-Toto-2.0-313m,TiRex,0.571,0.286,0.857,0.009,-0.01,0.029
-Toto-2.0-313m,TiRex-2,0.714,0.429,1.0,0.012,-0.002,0.028
-Toto-2.0-313m,FlowState,0.571,0.143,0.861,0.025,-0.008,0.065
-Toto-2.0-313m,Toto-2.0-22m,0.857,0.571,1.0,0.023,0.002,0.049
-Toto-2.0-313m,TS-ICL,0.714,0.429,1.0,0.025,-0.015,0.067
-Toto-2.0-313m,TabPFN-TS-3,0.714,0.429,1.0,0.047,-0.005,0.12
-Toto-2.0-313m,TFT,0.714,0.429,1.0,0.113,-0.0,0.271
-Toto-2.0-313m,Toto-2.0-4m,0.857,0.571,1.0,0.079,0.038,0.121
-Toto-2.0-313m,Chronos-Bolt,0.857,0.571,1.0,0.084,0.023,0.155
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.426,0.327,0.51
-Toto-2.0-2.5B,TimesFM-3,0.143,0.0,0.429,-0.066,-0.128,-0.013
-Toto-2.0-2.5B,Chronos-2,0.286,0.0,0.571,-0.029,-0.08,0.004
-Toto-2.0-2.5B,Toto-2.0-1B,0.571,0.143,0.857,-0.009,-0.022,0.003
-Toto-2.0-2.5B,t0-beta,0.286,0.0,0.571,-0.016,-0.054,0.02
-Toto-2.0-2.5B,TimesFM-2.5,0.429,0.143,0.857,-0.005,-0.044,0.035
-Toto-2.0-2.5B,Toto-2.0-313m,0.286,0.0,0.571,-0.003,-0.012,0.004
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TiRex,0.571,0.286,0.857,0.006,-0.011,0.024
-Toto-2.0-2.5B,TiRex-2,0.571,0.286,1.0,0.009,-0.004,0.022
-Toto-2.0-2.5B,FlowState,0.571,0.143,0.861,0.022,-0.008,0.055
-Toto-2.0-2.5B,Toto-2.0-22m,0.857,0.571,1.0,0.019,-0.005,0.045
-Toto-2.0-2.5B,TS-ICL,0.714,0.429,1.0,0.021,-0.011,0.056
-Toto-2.0-2.5B,TabPFN-TS-3,0.714,0.429,1.0,0.043,-0.002,0.11
-Toto-2.0-2.5B,TFT,0.571,0.286,0.857,0.11,-0.003,0.266
-Toto-2.0-2.5B,Toto-2.0-4m,0.857,0.571,1.0,0.076,0.031,0.122
-Toto-2.0-2.5B,Chronos-Bolt,0.857,0.571,1.0,0.081,0.027,0.148
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.424,0.323,0.51
-TiRex,TimesFM-3,0.143,0.0,0.429,-0.073,-0.13,-0.025
-TiRex,Chronos-2,0.0,0.0,0.0,-0.035,-0.076,-0.012
-TiRex,Toto-2.0-1B,0.143,0.0,0.429,-0.015,-0.032,0.002
-TiRex,t0-beta,0.286,0.0,0.714,-0.022,-0.05,0.006
-TiRex,TimesFM-2.5,0.429,0.143,0.857,-0.011,-0.044,0.027
-TiRex,Toto-2.0-313m,0.429,0.143,0.714,-0.009,-0.03,0.01
-TiRex,Toto-2.0-2.5B,0.429,0.143,0.714,-0.006,-0.024,0.011
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TiRex-2,0.714,0.429,1.0,0.003,-0.01,0.017
-TiRex,FlowState,0.429,0.143,0.857,0.016,-0.011,0.051
-TiRex,Toto-2.0-22m,0.714,0.286,1.0,0.014,-0.013,0.045
-TiRex,TS-ICL,0.714,0.429,1.0,0.016,-0.018,0.055
-TiRex,TabPFN-TS-3,0.714,0.429,1.0,0.038,-0.007,0.11
-TiRex,TFT,0.857,0.571,1.0,0.105,0.005,0.253
-TiRex,Toto-2.0-4m,0.857,0.571,1.0,0.071,0.022,0.119
-TiRex,Chronos-Bolt,1.0,1.0,1.0,0.076,0.024,0.15
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.421,0.325,0.506
-TiRex-2,TimesFM-3,0.286,0.0,0.714,-0.076,-0.149,-0.021
-TiRex-2,Chronos-2,0.286,0.0,0.571,-0.038,-0.093,-0.006
-TiRex-2,Toto-2.0-1B,0.286,0.0,0.571,-0.018,-0.037,-0.002
-TiRex-2,t0-beta,0.286,0.0,0.714,-0.025,-0.063,0.009
-TiRex-2,TimesFM-2.5,0.429,0.143,0.857,-0.014,-0.058,0.03
-TiRex-2,Toto-2.0-313m,0.286,0.0,0.571,-0.012,-0.029,0.002
-TiRex-2,Toto-2.0-2.5B,0.429,0.0,0.714,-0.009,-0.023,0.004
-TiRex-2,TiRex,0.286,0.0,0.571,-0.003,-0.017,0.01
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,FlowState,0.429,0.143,0.857,0.013,-0.021,0.052
-TiRex-2,Toto-2.0-22m,0.714,0.286,1.0,0.011,-0.008,0.031
-TiRex-2,TS-ICL,0.714,0.429,1.0,0.013,-0.023,0.054
-TiRex-2,TabPFN-TS-3,0.571,0.143,0.861,0.035,-0.01,0.108
-TiRex-2,TFT,0.714,0.429,1.0,0.102,-0.012,0.258
-TiRex-2,Toto-2.0-4m,0.857,0.571,1.0,0.068,0.027,0.109
-TiRex-2,Chronos-Bolt,0.714,0.429,1.0,0.073,0.019,0.145
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.419,0.322,0.502
-FlowState,TimesFM-3,0.0,0.0,0.0,-0.09,-0.128,-0.054
-FlowState,Chronos-2,0.286,0.0,0.571,-0.052,-0.099,-0.013
-FlowState,Toto-2.0-1B,0.286,0.0,0.571,-0.031,-0.076,0.001
-FlowState,t0-beta,0.143,0.0,0.429,-0.038,-0.059,-0.017
-FlowState,TimesFM-2.5,0.0,0.0,0.0,-0.027,-0.039,-0.016
-FlowState,Toto-2.0-313m,0.429,0.139,0.857,-0.026,-0.07,0.008
-FlowState,Toto-2.0-2.5B,0.429,0.139,0.857,-0.022,-0.059,0.008
-FlowState,TiRex,0.571,0.143,0.857,-0.016,-0.053,0.01
-FlowState,TiRex-2,0.571,0.143,0.857,-0.013,-0.054,0.021
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Toto-2.0-22m,0.571,0.143,0.857,-0.002,-0.062,0.048
-FlowState,TS-ICL,0.429,0.143,0.857,-0.0,-0.022,0.025
-FlowState,TabPFN-TS-3,0.571,0.282,0.857,0.022,-0.011,0.071
-FlowState,TFT,0.714,0.429,1.0,0.09,-0.02,0.235
-FlowState,Toto-2.0-4m,0.571,0.143,0.857,0.056,-0.021,0.125
-FlowState,Chronos-Bolt,1.0,1.0,1.0,0.061,0.021,0.114
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.411,0.301,0.504
-Toto-2.0-22m,TimesFM-3,0.286,0.0,0.714,-0.087,-0.175,-0.014
-Toto-2.0-22m,Chronos-2,0.143,0.0,0.429,-0.05,-0.125,-0.006
-Toto-2.0-22m,Toto-2.0-1B,0.143,0.0,0.429,-0.029,-0.062,-0.005
-Toto-2.0-22m,t0-beta,0.286,0.0,0.714,-0.036,-0.096,0.015
-Toto-2.0-22m,TimesFM-2.5,0.286,0.0,0.714,-0.025,-0.087,0.037
-Toto-2.0-22m,Toto-2.0-313m,0.143,0.0,0.429,-0.023,-0.051,-0.002
-Toto-2.0-22m,Toto-2.0-2.5B,0.143,0.0,0.429,-0.02,-0.047,0.005
-Toto-2.0-22m,TiRex,0.286,0.0,0.714,-0.014,-0.047,0.013
-Toto-2.0-22m,TiRex-2,0.286,0.0,0.714,-0.011,-0.032,0.007
-Toto-2.0-22m,FlowState,0.429,0.143,0.857,0.002,-0.05,0.058
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TS-ICL,0.571,0.143,0.857,0.002,-0.044,0.056
-Toto-2.0-22m,TabPFN-TS-3,0.571,0.143,0.861,0.024,-0.039,0.113
-Toto-2.0-22m,TFT,0.571,0.143,0.857,0.092,-0.042,0.259
-Toto-2.0-22m,Toto-2.0-4m,1.0,1.0,1.0,0.058,0.027,0.092
-Toto-2.0-22m,Chronos-Bolt,0.714,0.429,1.0,0.063,-0.005,0.147
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.413,0.315,0.494
-TS-ICL,TimesFM-3,0.0,0.0,0.0,-0.09,-0.138,-0.048
-TS-ICL,Chronos-2,0.286,0.0,0.571,-0.052,-0.119,0.001
-TS-ICL,Toto-2.0-1B,0.143,0.0,0.429,-0.031,-0.079,0.01
-TS-ICL,t0-beta,0.286,0.0,0.571,-0.038,-0.083,0.0
-TS-ICL,TimesFM-2.5,0.143,0.0,0.429,-0.027,-0.056,-0.007
-TS-ICL,Toto-2.0-313m,0.286,0.0,0.571,-0.025,-0.071,0.015
-TS-ICL,Toto-2.0-2.5B,0.286,0.0,0.571,-0.022,-0.06,0.011
-TS-ICL,TiRex,0.286,0.0,0.571,-0.016,-0.058,0.017
-TS-ICL,TiRex-2,0.286,0.0,0.571,-0.013,-0.057,0.023
-TS-ICL,FlowState,0.571,0.143,0.857,0.0,-0.025,0.022
-TS-ICL,Toto-2.0-22m,0.429,0.143,0.857,-0.002,-0.059,0.042
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TabPFN-TS-3,0.571,0.143,1.0,0.022,-0.017,0.073
-TS-ICL,TFT,0.714,0.429,1.0,0.09,-0.031,0.236
-TS-ICL,Toto-2.0-4m,0.714,0.286,1.0,0.056,-0.024,0.126
-TS-ICL,Chronos-Bolt,0.857,0.571,1.0,0.061,0.013,0.118
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.411,0.291,0.511
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.115,-0.192,-0.052
-TabPFN-TS-3,Chronos-2,0.286,0.0,0.571,-0.076,-0.171,-0.011
-TabPFN-TS-3,Toto-2.0-1B,0.286,0.0,0.571,-0.055,-0.142,0.001
-TabPFN-TS-3,t0-beta,0.143,0.0,0.429,-0.062,-0.13,-0.017
-TabPFN-TS-3,TimesFM-2.5,0.286,0.0,0.571,-0.051,-0.107,-0.009
-TabPFN-TS-3,Toto-2.0-313m,0.286,0.0,0.571,-0.049,-0.136,0.005
-TabPFN-TS-3,Toto-2.0-2.5B,0.286,0.0,0.571,-0.045,-0.123,0.002
-TabPFN-TS-3,TiRex,0.286,0.0,0.571,-0.039,-0.123,0.007
-TabPFN-TS-3,TiRex-2,0.429,0.139,0.857,-0.036,-0.121,0.01
-TabPFN-TS-3,FlowState,0.429,0.143,0.718,-0.023,-0.077,0.01
-TabPFN-TS-3,Toto-2.0-22m,0.429,0.139,0.857,-0.025,-0.127,0.037
-TabPFN-TS-3,TS-ICL,0.429,0.0,0.857,-0.023,-0.079,0.017
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TFT,0.571,0.143,0.857,0.069,-0.088,0.235
-TabPFN-TS-3,Toto-2.0-4m,0.714,0.286,1.0,0.035,-0.085,0.113
-TabPFN-TS-3,Chronos-Bolt,1.0,1.0,1.0,0.04,0.014,0.074
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.398,0.268,0.502
-TFT,TimesFM-3,0.0,0.0,0.0,-0.198,-0.41,-0.075
-TFT,Chronos-2,0.0,0.0,0.0,-0.156,-0.385,-0.038
-TFT,Toto-2.0-1B,0.143,0.0,0.429,-0.133,-0.375,-0.011
-TFT,t0-beta,0.143,0.0,0.429,-0.141,-0.348,-0.022
-TFT,TimesFM-2.5,0.143,0.0,0.429,-0.129,-0.339,-0.011
-TFT,Toto-2.0-313m,0.286,0.0,0.571,-0.127,-0.373,0.0
-TFT,Toto-2.0-2.5B,0.429,0.143,0.714,-0.123,-0.362,0.003
-TFT,TiRex,0.143,0.0,0.429,-0.117,-0.339,-0.005
-TFT,TiRex-2,0.286,0.0,0.571,-0.114,-0.347,0.012
-TFT,FlowState,0.286,0.0,0.571,-0.099,-0.307,0.019
-TFT,Toto-2.0-22m,0.429,0.143,0.857,-0.102,-0.35,0.04
-TFT,TS-ICL,0.286,0.0,0.571,-0.099,-0.309,0.03
-TFT,TabPFN-TS-3,0.429,0.143,0.857,-0.075,-0.306,0.081
-TFT,TFT,0.5,0.5,0.5,0.0,0.0,0.0
-TFT,Toto-2.0-4m,0.429,0.143,0.857,-0.038,-0.282,0.112
-TFT,Chronos-Bolt,0.714,0.429,1.0,-0.032,-0.249,0.122
-TFT,Seasonal Naive,1.0,1.0,1.0,0.353,0.219,0.471
-Toto-2.0-4m,TimesFM-3,0.143,0.0,0.429,-0.155,-0.285,-0.048
-Toto-2.0-4m,Chronos-2,0.0,0.0,0.0,-0.114,-0.204,-0.046
-Toto-2.0-4m,Toto-2.0-1B,0.0,0.0,0.0,-0.092,-0.151,-0.044
-Toto-2.0-4m,t0-beta,0.286,0.0,0.714,-0.1,-0.182,-0.024
-Toto-2.0-4m,TimesFM-2.5,0.286,0.0,0.714,-0.088,-0.186,-0.002
-Toto-2.0-4m,Toto-2.0-313m,0.143,0.0,0.429,-0.086,-0.137,-0.04
-Toto-2.0-4m,Toto-2.0-2.5B,0.143,0.0,0.429,-0.083,-0.139,-0.032
-Toto-2.0-4m,TiRex,0.143,0.0,0.429,-0.076,-0.135,-0.022
-Toto-2.0-4m,TiRex-2,0.143,0.0,0.429,-0.073,-0.122,-0.028
-Toto-2.0-4m,FlowState,0.429,0.143,0.857,-0.059,-0.143,0.021
-Toto-2.0-4m,Toto-2.0-22m,0.0,0.0,0.0,-0.062,-0.101,-0.028
-Toto-2.0-4m,TS-ICL,0.286,0.0,0.714,-0.06,-0.144,0.024
-Toto-2.0-4m,TabPFN-TS-3,0.286,0.0,0.714,-0.036,-0.128,0.078
-Toto-2.0-4m,TFT,0.571,0.143,0.857,0.036,-0.126,0.22
-Toto-2.0-4m,Toto-2.0-4m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-4m,Chronos-Bolt,0.571,0.143,0.861,0.005,-0.083,0.107
-Toto-2.0-4m,Seasonal Naive,1.0,1.0,1.0,0.376,0.285,0.456
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.161,-0.254,-0.089
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.12,-0.208,-0.056
-Chronos-Bolt,Toto-2.0-1B,0.143,0.0,0.429,-0.098,-0.195,-0.029
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.106,-0.171,-0.06
-Chronos-Bolt,TimesFM-2.5,0.0,0.0,0.0,-0.094,-0.161,-0.046
-Chronos-Bolt,Toto-2.0-313m,0.143,0.0,0.429,-0.092,-0.184,-0.024
-Chronos-Bolt,Toto-2.0-2.5B,0.143,0.0,0.429,-0.089,-0.173,-0.028
-Chronos-Bolt,TiRex,0.0,0.0,0.0,-0.082,-0.176,-0.025
-Chronos-Bolt,TiRex-2,0.286,0.0,0.571,-0.079,-0.17,-0.019
-Chronos-Bolt,FlowState,0.0,0.0,0.0,-0.065,-0.129,-0.022
-Chronos-Bolt,Toto-2.0-22m,0.286,0.0,0.571,-0.068,-0.173,0.005
-Chronos-Bolt,TS-ICL,0.143,0.0,0.429,-0.065,-0.133,-0.013
-Chronos-Bolt,TabPFN-TS-3,0.0,0.0,0.0,-0.041,-0.08,-0.015
-Chronos-Bolt,TFT,0.286,0.0,0.571,0.031,-0.138,0.199
-Chronos-Bolt,Toto-2.0-4m,0.429,0.139,0.857,-0.005,-0.12,0.077
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.373,0.248,0.474
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.851,-1.247,-0.532
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.787,-1.087,-0.531
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.751,-1.054,-0.497
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.763,-1.073,-0.508
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.744,-1.092,-0.458
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.742,-1.042,-0.487
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.736,-1.042,-0.476
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.726,-1.023,-0.482
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.721,-1.008,-0.475
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.698,-1.017,-0.431
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.702,-0.977,-0.46
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.699,-1.044,-0.411
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.661,-1.007,-0.366
-Seasonal Naive,TFT,0.0,0.0,0.0,-0.545,-0.89,-0.28
-Seasonal Naive,Toto-2.0-4m,0.0,0.0,0.0,-0.603,-0.837,-0.4
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.594,-0.902,-0.329
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_mobility/pairwise_WAPE.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.571,0.143,0.857,0.034,-0.012,0.08
-TimesFM-3,Toto-2.0-1B,0.714,0.286,1.0,0.053,0.011,0.102
-TimesFM-3,Toto-2.0-313m,0.857,0.571,1.0,0.059,0.012,0.109
-TimesFM-3,t0-beta,0.857,0.571,1.0,0.055,0.016,0.099
-TimesFM-3,Toto-2.0-2.5B,0.857,0.571,1.0,0.061,0.017,0.11
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.052,0.032,0.07
-TimesFM-3,FlowState,1.0,1.0,1.0,0.073,0.042,0.102
-TimesFM-3,TiRex-2,0.857,0.571,1.0,0.077,0.025,0.138
-TimesFM-3,TS-ICL,1.0,1.0,1.0,0.082,0.043,0.123
-TimesFM-3,TiRex,1.0,1.0,1.0,0.072,0.029,0.119
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.093,0.037,0.154
-TimesFM-3,Toto-2.0-22m,0.714,0.286,1.0,0.081,0.021,0.145
-TimesFM-3,TFT,1.0,1.0,1.0,0.143,0.045,0.264
-TimesFM-3,TabPFN-TS,1.0,1.0,1.0,0.113,0.071,0.158
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.115,0.059,0.176
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.338,0.238,0.434
-Chronos-2,TimesFM-3,0.429,0.143,0.857,-0.036,-0.087,0.012
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-2.0-1B,0.429,0.143,0.714,0.02,-0.008,0.067
-Chronos-2,Toto-2.0-313m,0.429,0.143,0.714,0.025,-0.01,0.082
-Chronos-2,t0-beta,0.714,0.429,1.0,0.021,-0.01,0.057
-Chronos-2,Toto-2.0-2.5B,0.429,0.143,0.714,0.028,-0.01,0.083
-Chronos-2,TimesFM-2.5,0.571,0.286,0.857,0.018,-0.024,0.065
-Chronos-2,FlowState,0.714,0.429,1.0,0.04,0.004,0.081
-Chronos-2,TiRex-2,0.714,0.429,1.0,0.044,0.007,0.106
-Chronos-2,TS-ICL,0.714,0.429,1.0,0.049,-0.002,0.109
-Chronos-2,TiRex,1.0,1.0,1.0,0.039,0.011,0.084
-Chronos-2,TabPFN-TS-3,0.714,0.429,1.0,0.061,0.008,0.13
-Chronos-2,Toto-2.0-22m,0.857,0.571,1.0,0.048,0.009,0.112
-Chronos-2,TFT,0.857,0.571,1.0,0.113,0.018,0.255
-Chronos-2,TabPFN-TS,1.0,1.0,1.0,0.082,0.049,0.113
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.083,0.038,0.134
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.314,0.232,0.391
-Toto-2.0-1B,TimesFM-3,0.286,0.0,0.714,-0.056,-0.114,-0.011
-Toto-2.0-1B,Chronos-2,0.571,0.286,0.857,-0.02,-0.072,0.008
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,Toto-2.0-313m,0.429,0.143,0.857,0.006,-0.002,0.016
-Toto-2.0-1B,t0-beta,0.429,0.143,0.857,0.002,-0.032,0.034
-Toto-2.0-1B,Toto-2.0-2.5B,0.571,0.286,0.857,0.008,-0.003,0.02
-Toto-2.0-1B,TimesFM-2.5,0.429,0.143,0.857,-0.001,-0.035,0.035
-Toto-2.0-1B,FlowState,0.571,0.143,0.861,0.021,-0.013,0.061
-Toto-2.0-1B,TiRex-2,1.0,1.0,1.0,0.025,0.011,0.044
-Toto-2.0-1B,TS-ICL,0.857,0.571,1.0,0.03,0.001,0.071
-Toto-2.0-1B,TiRex,1.0,1.0,1.0,0.019,0.01,0.03
-Toto-2.0-1B,TabPFN-TS-3,0.571,0.143,0.861,0.042,-0.012,0.12
-Toto-2.0-1B,Toto-2.0-22m,0.857,0.571,1.0,0.029,0.01,0.051
-Toto-2.0-1B,TFT,0.714,0.429,1.0,0.095,-0.026,0.244
-Toto-2.0-1B,TabPFN-TS,0.857,0.571,1.0,0.063,0.025,0.097
-Toto-2.0-1B,Chronos-Bolt,1.0,1.0,1.0,0.065,0.022,0.12
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.3,0.224,0.371
-Toto-2.0-313m,TimesFM-3,0.143,0.0,0.429,-0.062,-0.123,-0.012
-Toto-2.0-313m,Chronos-2,0.571,0.286,0.857,-0.026,-0.09,0.01
-Toto-2.0-313m,Toto-2.0-1B,0.571,0.143,0.857,-0.006,-0.017,0.002
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,t0-beta,0.429,0.143,0.857,-0.004,-0.045,0.033
-Toto-2.0-313m,Toto-2.0-2.5B,0.571,0.143,0.861,0.002,-0.006,0.013
-Toto-2.0-313m,TimesFM-2.5,0.429,0.143,0.857,-0.007,-0.047,0.033
-Toto-2.0-313m,FlowState,0.571,0.143,0.861,0.015,-0.025,0.057
-Toto-2.0-313m,TiRex-2,0.857,0.571,1.0,0.02,0.007,0.033
-Toto-2.0-313m,TS-ICL,0.857,0.571,1.0,0.025,-0.002,0.062
-Toto-2.0-313m,TiRex,0.714,0.429,1.0,0.014,-0.005,0.03
-Toto-2.0-313m,TabPFN-TS-3,0.714,0.286,1.0,0.036,-0.024,0.116
-Toto-2.0-313m,Toto-2.0-22m,0.857,0.571,1.0,0.023,0.005,0.039
-Toto-2.0-313m,TFT,0.714,0.429,1.0,0.09,-0.041,0.244
-Toto-2.0-313m,TabPFN-TS,0.857,0.571,1.0,0.058,0.011,0.098
-Toto-2.0-313m,Chronos-Bolt,0.857,0.571,1.0,0.06,0.012,0.116
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.296,0.218,0.369
-t0-beta,TimesFM-3,0.143,0.0,0.429,-0.058,-0.11,-0.016
-t0-beta,Chronos-2,0.286,0.0,0.571,-0.022,-0.06,0.01
-t0-beta,Toto-2.0-1B,0.571,0.143,0.857,-0.002,-0.035,0.031
-t0-beta,Toto-2.0-313m,0.571,0.143,0.857,0.004,-0.034,0.043
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,Toto-2.0-2.5B,0.571,0.143,0.857,0.006,-0.024,0.04
-t0-beta,TimesFM-2.5,0.714,0.429,1.0,-0.003,-0.036,0.02
-t0-beta,FlowState,0.857,0.571,1.0,0.019,0.002,0.033
-t0-beta,TiRex-2,0.571,0.143,0.857,0.023,-0.017,0.066
-t0-beta,TS-ICL,0.571,0.286,0.857,0.028,-0.007,0.065
-t0-beta,TiRex,0.714,0.286,1.0,0.018,-0.013,0.044
-t0-beta,TabPFN-TS-3,0.857,0.571,1.0,0.04,0.005,0.094
-t0-beta,Toto-2.0-22m,0.714,0.286,1.0,0.027,-0.023,0.073
-t0-beta,TFT,0.571,0.143,0.857,0.094,-0.014,0.228
-t0-beta,TabPFN-TS,1.0,1.0,1.0,0.062,0.039,0.085
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.063,0.034,0.097
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.299,0.214,0.374
-Toto-2.0-2.5B,TimesFM-3,0.143,0.0,0.429,-0.065,-0.124,-0.017
-Toto-2.0-2.5B,Chronos-2,0.571,0.286,0.857,-0.028,-0.09,0.01
-Toto-2.0-2.5B,Toto-2.0-1B,0.429,0.143,0.714,-0.008,-0.02,0.003
-Toto-2.0-2.5B,Toto-2.0-313m,0.429,0.139,0.857,-0.002,-0.013,0.006
-Toto-2.0-2.5B,t0-beta,0.429,0.143,0.857,-0.006,-0.041,0.023
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,TimesFM-2.5,0.571,0.143,0.857,-0.009,-0.047,0.026
-Toto-2.0-2.5B,FlowState,0.714,0.286,1.0,0.013,-0.022,0.05
-Toto-2.0-2.5B,TiRex-2,0.857,0.571,1.0,0.017,0.0,0.034
-Toto-2.0-2.5B,TS-ICL,0.714,0.429,1.0,0.022,0.0,0.053
-Toto-2.0-2.5B,TiRex,0.714,0.429,1.0,0.011,-0.008,0.027
-Toto-2.0-2.5B,TabPFN-TS-3,0.714,0.286,1.0,0.034,-0.02,0.104
-Toto-2.0-2.5B,Toto-2.0-22m,0.857,0.571,1.0,0.021,-0.005,0.042
-Toto-2.0-2.5B,TFT,0.714,0.429,1.0,0.088,-0.043,0.24
-Toto-2.0-2.5B,TabPFN-TS,0.857,0.571,1.0,0.056,0.013,0.093
-Toto-2.0-2.5B,Chronos-Bolt,0.857,0.571,1.0,0.057,0.017,0.104
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.295,0.215,0.366
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.055,-0.075,-0.033
-TimesFM-2.5,Chronos-2,0.429,0.143,0.714,-0.019,-0.069,0.024
-TimesFM-2.5,Toto-2.0-1B,0.571,0.143,0.857,0.001,-0.036,0.034
-TimesFM-2.5,Toto-2.0-313m,0.571,0.143,0.857,0.007,-0.035,0.045
-TimesFM-2.5,t0-beta,0.286,0.0,0.571,0.003,-0.02,0.035
-TimesFM-2.5,Toto-2.0-2.5B,0.429,0.143,0.857,0.009,-0.027,0.045
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,FlowState,0.857,0.571,1.0,0.022,0.007,0.037
-TimesFM-2.5,TiRex-2,0.571,0.143,0.857,0.026,-0.023,0.074
-TimesFM-2.5,TS-ICL,0.857,0.571,1.0,0.031,0.005,0.06
-TimesFM-2.5,TiRex,0.571,0.143,0.857,0.021,-0.017,0.056
-TimesFM-2.5,TabPFN-TS-3,0.571,0.143,1.0,0.043,-0.004,0.104
-TimesFM-2.5,Toto-2.0-22m,0.714,0.286,1.0,0.03,-0.023,0.081
-TimesFM-2.5,TFT,0.714,0.429,1.0,0.096,-0.01,0.224
-TimesFM-2.5,TabPFN-TS,1.0,1.0,1.0,0.064,0.035,0.097
-TimesFM-2.5,Chronos-Bolt,0.857,0.571,1.0,0.066,0.024,0.118
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.301,0.204,0.392
-FlowState,TimesFM-3,0.0,0.0,0.0,-0.079,-0.114,-0.044
-FlowState,Chronos-2,0.286,0.0,0.571,-0.042,-0.088,-0.004
-FlowState,Toto-2.0-1B,0.429,0.139,0.857,-0.021,-0.065,0.012
-FlowState,Toto-2.0-313m,0.429,0.139,0.857,-0.016,-0.06,0.024
-FlowState,t0-beta,0.143,0.0,0.429,-0.02,-0.034,-0.002
-FlowState,Toto-2.0-2.5B,0.286,0.0,0.714,-0.013,-0.052,0.021
-FlowState,TimesFM-2.5,0.143,0.0,0.429,-0.023,-0.039,-0.007
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,TiRex-2,0.571,0.143,0.857,0.004,-0.048,0.051
-FlowState,TS-ICL,0.429,0.143,0.857,0.009,-0.022,0.043
-FlowState,TiRex,0.571,0.143,0.857,-0.002,-0.043,0.031
-FlowState,TabPFN-TS-3,0.714,0.286,1.0,0.021,-0.021,0.077
-FlowState,Toto-2.0-22m,0.571,0.143,0.857,0.008,-0.054,0.06
-FlowState,TFT,0.714,0.429,1.0,0.076,-0.033,0.205
-FlowState,TabPFN-TS,1.0,1.0,1.0,0.043,0.023,0.067
-FlowState,Chronos-Bolt,0.857,0.571,1.0,0.045,0.007,0.088
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.285,0.189,0.371
-TiRex-2,TimesFM-3,0.143,0.0,0.429,-0.084,-0.161,-0.025
-TiRex-2,Chronos-2,0.286,0.0,0.571,-0.047,-0.119,-0.007
-TiRex-2,Toto-2.0-1B,0.0,0.0,0.0,-0.026,-0.046,-0.011
-TiRex-2,Toto-2.0-313m,0.143,0.0,0.429,-0.02,-0.034,-0.007
-TiRex-2,t0-beta,0.429,0.143,0.857,-0.024,-0.071,0.017
-TiRex-2,Toto-2.0-2.5B,0.143,0.0,0.429,-0.018,-0.035,-0.0
-TiRex-2,TimesFM-2.5,0.429,0.143,0.857,-0.027,-0.08,0.022
-TiRex-2,FlowState,0.429,0.143,0.857,-0.004,-0.054,0.045
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,TS-ICL,0.571,0.143,0.857,0.005,-0.032,0.053
-TiRex-2,TiRex,0.429,0.143,0.714,-0.006,-0.029,0.012
-TiRex-2,TabPFN-TS-3,0.571,0.143,0.861,0.017,-0.051,0.103
-TiRex-2,Toto-2.0-22m,0.857,0.571,1.0,0.004,-0.006,0.011
-TiRex-2,TFT,0.571,0.286,0.857,0.072,-0.075,0.231
-TiRex-2,TabPFN-TS,0.857,0.571,1.0,0.039,-0.009,0.081
-TiRex-2,Chronos-Bolt,0.714,0.429,1.0,0.041,-0.011,0.099
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.282,0.211,0.351
-TS-ICL,TimesFM-3,0.0,0.0,0.0,-0.089,-0.14,-0.045
-TS-ICL,Chronos-2,0.286,0.0,0.571,-0.052,-0.122,0.002
-TS-ICL,Toto-2.0-1B,0.143,0.0,0.429,-0.031,-0.076,-0.001
-TS-ICL,Toto-2.0-313m,0.143,0.0,0.429,-0.025,-0.067,0.002
-TS-ICL,t0-beta,0.429,0.143,0.714,-0.029,-0.07,0.007
-TS-ICL,Toto-2.0-2.5B,0.286,0.0,0.571,-0.023,-0.056,-0.0
-TS-ICL,TimesFM-2.5,0.143,0.0,0.429,-0.032,-0.064,-0.005
-TS-ICL,FlowState,0.571,0.143,0.857,-0.009,-0.045,0.022
-TS-ICL,TiRex-2,0.429,0.143,0.857,-0.005,-0.056,0.031
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TiRex,0.429,0.143,0.714,-0.011,-0.056,0.023
-TS-ICL,TabPFN-TS-3,0.714,0.286,1.0,0.012,-0.036,0.063
-TS-ICL,Toto-2.0-22m,0.571,0.286,0.857,-0.001,-0.06,0.039
-TS-ICL,TFT,0.714,0.429,1.0,0.067,-0.071,0.214
-TS-ICL,TabPFN-TS,0.571,0.143,0.857,0.034,-0.019,0.08
-TS-ICL,Chronos-Bolt,0.857,0.571,1.0,0.036,-0.002,0.081
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.279,0.173,0.365
-TiRex,TimesFM-3,0.0,0.0,0.0,-0.077,-0.135,-0.03
-TiRex,Chronos-2,0.0,0.0,0.0,-0.04,-0.091,-0.011
-TiRex,Toto-2.0-1B,0.0,0.0,0.0,-0.02,-0.031,-0.01
-TiRex,Toto-2.0-313m,0.286,0.0,0.571,-0.014,-0.031,0.005
-TiRex,t0-beta,0.286,0.0,0.714,-0.018,-0.046,0.013
-TiRex,Toto-2.0-2.5B,0.286,0.0,0.571,-0.012,-0.028,0.008
-TiRex,TimesFM-2.5,0.429,0.143,0.857,-0.021,-0.059,0.016
-TiRex,FlowState,0.429,0.143,0.857,0.002,-0.031,0.041
-TiRex,TiRex-2,0.571,0.286,0.857,0.006,-0.012,0.028
-TiRex,TS-ICL,0.571,0.286,0.857,0.011,-0.023,0.053
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TabPFN-TS-3,0.429,0.143,0.857,0.023,-0.03,0.101
-TiRex,Toto-2.0-22m,0.571,0.286,0.857,0.01,-0.011,0.034
-TiRex,TFT,0.571,0.143,0.857,0.077,-0.044,0.226
-TiRex,TabPFN-TS,0.714,0.286,1.0,0.045,0.01,0.078
-TiRex,Chronos-Bolt,0.714,0.429,1.0,0.047,0.006,0.101
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.287,0.21,0.357
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.102,-0.182,-0.038
-TabPFN-TS-3,Chronos-2,0.286,0.0,0.571,-0.065,-0.149,-0.008
-TabPFN-TS-3,Toto-2.0-1B,0.429,0.139,0.857,-0.043,-0.136,0.012
-TabPFN-TS-3,Toto-2.0-313m,0.286,0.0,0.714,-0.038,-0.131,0.023
-TabPFN-TS-3,t0-beta,0.143,0.0,0.429,-0.042,-0.104,-0.005
-TabPFN-TS-3,Toto-2.0-2.5B,0.286,0.0,0.714,-0.035,-0.116,0.02
-TabPFN-TS-3,TimesFM-2.5,0.429,0.0,0.857,-0.045,-0.116,0.004
-TabPFN-TS-3,FlowState,0.286,0.0,0.714,-0.022,-0.084,0.02
-TabPFN-TS-3,TiRex-2,0.429,0.139,0.857,-0.017,-0.114,0.048
-TabPFN-TS-3,TS-ICL,0.286,0.0,0.714,-0.012,-0.067,0.035
-TabPFN-TS-3,TiRex,0.571,0.143,0.857,-0.023,-0.113,0.029
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,Toto-2.0-22m,0.429,0.139,0.857,-0.013,-0.121,0.057
-TabPFN-TS-3,TFT,0.429,0.143,0.718,0.056,-0.099,0.215
-TabPFN-TS-3,TabPFN-TS,0.857,0.571,1.0,0.022,-0.05,0.073
-TabPFN-TS-3,Chronos-Bolt,0.857,0.571,1.0,0.024,-0.016,0.062
-TabPFN-TS-3,Seasonal Naive,0.857,0.571,1.0,0.27,0.138,0.362
-Toto-2.0-22m,TimesFM-3,0.286,0.0,0.714,-0.088,-0.169,-0.022
-Toto-2.0-22m,Chronos-2,0.143,0.0,0.429,-0.051,-0.127,-0.009
-Toto-2.0-22m,Toto-2.0-1B,0.143,0.0,0.429,-0.03,-0.054,-0.01
-Toto-2.0-22m,Toto-2.0-313m,0.143,0.0,0.429,-0.024,-0.041,-0.005
-Toto-2.0-22m,t0-beta,0.286,0.0,0.714,-0.028,-0.079,0.023
-Toto-2.0-22m,Toto-2.0-2.5B,0.143,0.0,0.429,-0.022,-0.044,0.005
-Toto-2.0-22m,TimesFM-2.5,0.286,0.0,0.714,-0.031,-0.088,0.023
-Toto-2.0-22m,FlowState,0.429,0.143,0.857,-0.008,-0.064,0.051
-Toto-2.0-22m,TiRex-2,0.143,0.0,0.429,-0.004,-0.011,0.006
-Toto-2.0-22m,TS-ICL,0.429,0.143,0.714,0.001,-0.041,0.057
-Toto-2.0-22m,TiRex,0.429,0.143,0.714,-0.01,-0.036,0.011
-Toto-2.0-22m,TabPFN-TS-3,0.571,0.143,0.861,0.013,-0.061,0.108
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TFT,0.571,0.143,0.857,0.068,-0.079,0.229
-Toto-2.0-22m,TabPFN-TS,0.714,0.286,1.0,0.035,-0.018,0.083
-Toto-2.0-22m,Chronos-Bolt,0.714,0.429,1.0,0.037,-0.018,0.103
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.28,0.212,0.347
-TFT,TimesFM-3,0.0,0.0,0.0,-0.167,-0.359,-0.048
-TFT,Chronos-2,0.143,0.0,0.429,-0.127,-0.342,-0.018
-TFT,Toto-2.0-1B,0.286,0.0,0.571,-0.105,-0.322,0.025
-TFT,Toto-2.0-313m,0.286,0.0,0.571,-0.099,-0.323,0.04
-TFT,t0-beta,0.429,0.143,0.857,-0.103,-0.296,0.014
-TFT,Toto-2.0-2.5B,0.286,0.0,0.571,-0.096,-0.317,0.041
-TFT,TimesFM-2.5,0.286,0.0,0.571,-0.107,-0.289,0.01
-TFT,FlowState,0.286,0.0,0.571,-0.082,-0.258,0.032
-TFT,TiRex-2,0.429,0.143,0.714,-0.077,-0.3,0.069
-TFT,TS-ICL,0.286,0.0,0.571,-0.072,-0.272,0.066
-TFT,TiRex,0.429,0.143,0.857,-0.084,-0.292,0.042
-TFT,TabPFN-TS-3,0.571,0.282,0.857,-0.059,-0.273,0.09
-TFT,Toto-2.0-22m,0.429,0.143,0.857,-0.073,-0.296,0.073
-TFT,TFT,0.5,0.5,0.5,0.0,0.0,0.0
-TFT,TabPFN-TS,0.714,0.429,1.0,-0.035,-0.202,0.071
-TFT,Chronos-Bolt,0.571,0.282,0.857,-0.033,-0.24,0.101
-TFT,Seasonal Naive,0.857,0.571,1.0,0.227,0.023,0.368
-TabPFN-TS,TimesFM-3,0.0,0.0,0.0,-0.128,-0.187,-0.076
-TabPFN-TS,Chronos-2,0.0,0.0,0.0,-0.089,-0.128,-0.052
-TabPFN-TS,Toto-2.0-1B,0.143,0.0,0.429,-0.067,-0.108,-0.026
-TabPFN-TS,Toto-2.0-313m,0.143,0.0,0.429,-0.061,-0.108,-0.011
-TabPFN-TS,t0-beta,0.0,0.0,0.0,-0.066,-0.093,-0.04
-TabPFN-TS,Toto-2.0-2.5B,0.143,0.0,0.429,-0.059,-0.102,-0.013
-TabPFN-TS,TimesFM-2.5,0.0,0.0,0.0,-0.069,-0.108,-0.036
-TabPFN-TS,FlowState,0.0,0.0,0.0,-0.045,-0.072,-0.023
-TabPFN-TS,TiRex-2,0.143,0.0,0.429,-0.041,-0.088,0.009
-TabPFN-TS,TS-ICL,0.429,0.143,0.857,-0.035,-0.086,0.019
-TabPFN-TS,TiRex,0.286,0.0,0.714,-0.047,-0.085,-0.01
-TabPFN-TS,TabPFN-TS-3,0.143,0.0,0.429,-0.023,-0.079,0.047
-TabPFN-TS,Toto-2.0-22m,0.286,0.0,0.714,-0.037,-0.091,0.017
-TabPFN-TS,TFT,0.286,0.0,0.571,0.034,-0.077,0.168
-TabPFN-TS,TabPFN-TS,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS,Chronos-Bolt,0.571,0.286,1.0,0.002,-0.05,0.054
-TabPFN-TS,Seasonal Naive,1.0,1.0,1.0,0.253,0.163,0.331
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.13,-0.214,-0.062
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.091,-0.155,-0.04
-Chronos-Bolt,Toto-2.0-1B,0.0,0.0,0.0,-0.069,-0.136,-0.023
-Chronos-Bolt,Toto-2.0-313m,0.143,0.0,0.429,-0.063,-0.131,-0.012
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.068,-0.107,-0.035
-Chronos-Bolt,Toto-2.0-2.5B,0.143,0.0,0.429,-0.061,-0.116,-0.017
-Chronos-Bolt,TimesFM-2.5,0.143,0.0,0.429,-0.071,-0.134,-0.025
-Chronos-Bolt,FlowState,0.143,0.0,0.429,-0.047,-0.096,-0.007
-Chronos-Bolt,TiRex-2,0.286,0.0,0.571,-0.042,-0.109,0.011
-Chronos-Bolt,TS-ICL,0.143,0.0,0.429,-0.037,-0.088,0.002
-Chronos-Bolt,TiRex,0.286,0.0,0.571,-0.049,-0.112,-0.006
-Chronos-Bolt,TabPFN-TS-3,0.143,0.0,0.429,-0.025,-0.066,0.016
-Chronos-Bolt,Toto-2.0-22m,0.286,0.0,0.571,-0.038,-0.115,0.018
-Chronos-Bolt,TFT,0.429,0.143,0.718,0.032,-0.112,0.193
-Chronos-Bolt,TabPFN-TS,0.429,0.0,0.714,-0.002,-0.057,0.047
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,0.857,0.571,1.0,0.252,0.148,0.333
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.51,-0.767,-0.313
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.458,-0.643,-0.303
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.429,-0.591,-0.289
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.421,-0.584,-0.279
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.427,-0.597,-0.272
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.418,-0.577,-0.274
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.431,-0.644,-0.257
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.399,-0.59,-0.233
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.393,-0.54,-0.267
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.386,-0.576,-0.209
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.402,-0.555,-0.267
-Seasonal Naive,TabPFN-TS-3,0.143,0.0,0.429,-0.37,-0.567,-0.16
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.388,-0.53,-0.269
-Seasonal Naive,TFT,0.143,0.0,0.429,-0.293,-0.583,-0.023
-Seasonal Naive,TabPFN-TS,0.0,0.0,0.0,-0.339,-0.495,-0.195
-Seasonal Naive,Chronos-Bolt,0.143,0.0,0.429,-0.337,-0.499,-0.174
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_mobility/pairwise_WQL.csv

@@ -1,290 +0,0 @@
-model_1,model_2,win_rate,win_rate_lower,win_rate_upper,skill_score,skill_score_lower,skill_score_upper
-TimesFM-3,TimesFM-3,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-3,Chronos-2,0.571,0.143,0.857,0.034,-0.012,0.081
-TimesFM-3,Toto-2.0-1B,0.714,0.286,1.0,0.051,0.002,0.101
-TimesFM-3,t0-beta,0.857,0.571,1.0,0.054,0.015,0.094
-TimesFM-3,TimesFM-2.5,1.0,1.0,1.0,0.057,0.032,0.081
-TimesFM-3,Toto-2.0-2.5B,0.857,0.571,1.0,0.058,0.009,0.108
-TimesFM-3,Toto-2.0-313m,0.857,0.571,1.0,0.059,0.005,0.116
-TimesFM-3,TabPFN-TS-3,1.0,1.0,1.0,0.094,0.035,0.161
-TimesFM-3,TS-ICL,1.0,1.0,1.0,0.078,0.045,0.111
-TimesFM-3,TiRex,1.0,1.0,1.0,0.07,0.028,0.119
-TimesFM-3,TiRex-2,0.857,0.571,1.0,0.078,0.024,0.142
-TimesFM-3,FlowState,1.0,1.0,1.0,0.081,0.047,0.113
-TimesFM-3,Toto-2.0-22m,0.714,0.286,1.0,0.079,0.014,0.146
-TimesFM-3,TFT,1.0,1.0,1.0,0.152,0.058,0.276
-TimesFM-3,citras-fm,1.0,1.0,1.0,0.138,0.065,0.222
-TimesFM-3,Chronos-Bolt,1.0,1.0,1.0,0.14,0.076,0.211
-TimesFM-3,Seasonal Naive,1.0,1.0,1.0,0.465,0.349,0.562
-Chronos-2,TimesFM-3,0.429,0.143,0.857,-0.036,-0.088,0.012
-Chronos-2,Chronos-2,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-2,Toto-2.0-1B,0.571,0.286,0.857,0.017,-0.011,0.06
-Chronos-2,t0-beta,0.714,0.429,1.0,0.02,-0.009,0.051
-Chronos-2,TimesFM-2.5,0.571,0.286,0.857,0.023,-0.013,0.065
-Chronos-2,Toto-2.0-2.5B,0.429,0.143,0.714,0.024,-0.011,0.075
-Chronos-2,Toto-2.0-313m,0.714,0.429,1.0,0.026,-0.011,0.079
-Chronos-2,TabPFN-TS-3,0.714,0.429,1.0,0.062,0.008,0.137
-Chronos-2,TS-ICL,0.714,0.429,1.0,0.045,-0.003,0.099
-Chronos-2,TiRex,1.0,1.0,1.0,0.037,0.014,0.072
-Chronos-2,TiRex-2,0.714,0.429,1.0,0.045,0.008,0.102
-Chronos-2,FlowState,0.714,0.429,1.0,0.048,0.014,0.086
-Chronos-2,Toto-2.0-22m,0.857,0.571,1.0,0.046,0.006,0.107
-Chronos-2,TFT,0.857,0.571,1.0,0.122,0.025,0.267
-Chronos-2,citras-fm,1.0,1.0,1.0,0.107,0.047,0.2
-Chronos-2,Chronos-Bolt,1.0,1.0,1.0,0.109,0.05,0.179
-Chronos-2,Seasonal Naive,1.0,1.0,1.0,0.445,0.347,0.528
-Toto-2.0-1B,TimesFM-3,0.286,0.0,0.714,-0.054,-0.113,-0.002
-Toto-2.0-1B,Chronos-2,0.429,0.143,0.714,-0.018,-0.064,0.011
-Toto-2.0-1B,Toto-2.0-1B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-1B,t0-beta,0.429,0.143,0.857,0.003,-0.034,0.04
-Toto-2.0-1B,TimesFM-2.5,0.429,0.143,0.857,0.006,-0.032,0.05
-Toto-2.0-1B,Toto-2.0-2.5B,0.429,0.143,0.857,0.007,-0.004,0.019
-Toto-2.0-1B,Toto-2.0-313m,0.714,0.429,1.0,0.008,-0.001,0.022
-Toto-2.0-1B,TabPFN-TS-3,0.571,0.143,0.861,0.045,-0.012,0.127
-Toto-2.0-1B,TS-ICL,0.857,0.571,1.0,0.028,-0.006,0.07
-Toto-2.0-1B,TiRex,1.0,1.0,1.0,0.02,0.006,0.035
-Toto-2.0-1B,TiRex-2,0.857,0.571,1.0,0.028,0.012,0.048
-Toto-2.0-1B,FlowState,0.571,0.143,0.861,0.031,-0.002,0.073
-Toto-2.0-1B,Toto-2.0-22m,1.0,1.0,1.0,0.029,0.01,0.052
-Toto-2.0-1B,TFT,0.714,0.429,1.0,0.107,-0.013,0.261
-Toto-2.0-1B,citras-fm,0.857,0.571,1.0,0.091,0.019,0.194
-Toto-2.0-1B,Chronos-Bolt,0.857,0.571,1.0,0.094,0.03,0.174
-Toto-2.0-1B,Seasonal Naive,1.0,1.0,1.0,0.436,0.333,0.522
-t0-beta,TimesFM-3,0.143,0.0,0.429,-0.057,-0.104,-0.015
-t0-beta,Chronos-2,0.286,0.0,0.571,-0.02,-0.053,0.008
-t0-beta,Toto-2.0-1B,0.571,0.143,0.857,-0.003,-0.041,0.033
-t0-beta,t0-beta,0.5,0.5,0.5,0.0,0.0,0.0
-t0-beta,TimesFM-2.5,0.571,0.286,0.857,0.003,-0.022,0.027
-t0-beta,Toto-2.0-2.5B,0.571,0.143,0.857,0.005,-0.032,0.043
-t0-beta,Toto-2.0-313m,0.429,0.139,0.857,0.006,-0.038,0.05
-t0-beta,TabPFN-TS-3,0.857,0.571,1.0,0.042,0.001,0.105
-t0-beta,TS-ICL,0.571,0.286,0.857,0.025,-0.01,0.062
-t0-beta,TiRex,0.714,0.286,1.0,0.017,-0.009,0.042
-t0-beta,TiRex-2,0.714,0.286,1.0,0.025,-0.014,0.068
-t0-beta,FlowState,0.857,0.571,1.0,0.029,0.011,0.045
-t0-beta,Toto-2.0-22m,0.714,0.286,1.0,0.026,-0.025,0.077
-t0-beta,TFT,0.714,0.429,1.0,0.104,0.003,0.24
-t0-beta,citras-fm,1.0,1.0,1.0,0.089,0.032,0.173
-t0-beta,Chronos-Bolt,1.0,1.0,1.0,0.091,0.046,0.151
-t0-beta,Seasonal Naive,1.0,1.0,1.0,0.434,0.334,0.522
-TimesFM-2.5,TimesFM-3,0.0,0.0,0.0,-0.06,-0.088,-0.033
-TimesFM-2.5,Chronos-2,0.429,0.143,0.714,-0.024,-0.07,0.013
-TimesFM-2.5,Toto-2.0-1B,0.571,0.143,0.857,-0.006,-0.053,0.031
-TimesFM-2.5,t0-beta,0.429,0.143,0.714,-0.003,-0.028,0.022
-TimesFM-2.5,TimesFM-2.5,0.5,0.5,0.5,0.0,0.0,0.0
-TimesFM-2.5,Toto-2.0-2.5B,0.571,0.143,0.857,0.001,-0.04,0.04
-TimesFM-2.5,Toto-2.0-313m,0.571,0.143,0.857,0.002,-0.049,0.048
-TimesFM-2.5,TabPFN-TS-3,0.714,0.429,1.0,0.039,-0.001,0.094
-TimesFM-2.5,TS-ICL,0.714,0.429,1.0,0.022,0.005,0.045
-TimesFM-2.5,TiRex,0.571,0.143,0.857,0.014,-0.025,0.047
-TimesFM-2.5,TiRex-2,0.571,0.143,0.857,0.022,-0.03,0.071
-TimesFM-2.5,FlowState,1.0,1.0,1.0,0.025,0.015,0.036
-TimesFM-2.5,Toto-2.0-22m,0.714,0.286,1.0,0.023,-0.039,0.08
-TimesFM-2.5,TFT,0.714,0.429,1.0,0.101,-0.006,0.24
-TimesFM-2.5,citras-fm,1.0,1.0,1.0,0.086,0.03,0.162
-TimesFM-2.5,Chronos-Bolt,1.0,1.0,1.0,0.088,0.043,0.149
-TimesFM-2.5,Seasonal Naive,1.0,1.0,1.0,0.432,0.315,0.529
-Toto-2.0-2.5B,TimesFM-3,0.143,0.0,0.429,-0.062,-0.121,-0.009
-Toto-2.0-2.5B,Chronos-2,0.571,0.286,0.857,-0.025,-0.081,0.011
-Toto-2.0-2.5B,Toto-2.0-1B,0.571,0.143,0.857,-0.007,-0.02,0.004
-Toto-2.0-2.5B,t0-beta,0.429,0.143,0.857,-0.005,-0.045,0.031
-Toto-2.0-2.5B,TimesFM-2.5,0.429,0.143,0.857,-0.001,-0.042,0.038
-Toto-2.0-2.5B,Toto-2.0-2.5B,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-2.5B,Toto-2.0-313m,0.429,0.139,0.857,0.001,-0.009,0.009
-Toto-2.0-2.5B,TabPFN-TS-3,0.571,0.143,0.861,0.038,-0.019,0.114
-Toto-2.0-2.5B,TS-ICL,0.571,0.143,0.857,0.021,-0.008,0.054
-Toto-2.0-2.5B,TiRex,0.714,0.429,1.0,0.013,-0.008,0.031
-Toto-2.0-2.5B,TiRex-2,0.857,0.571,1.0,0.021,0.004,0.037
-Toto-2.0-2.5B,FlowState,0.714,0.286,1.0,0.024,-0.01,0.06
-Toto-2.0-2.5B,Toto-2.0-22m,0.857,0.571,1.0,0.022,-0.0,0.042
-Toto-2.0-2.5B,TFT,0.571,0.286,0.857,0.1,-0.028,0.257
-Toto-2.0-2.5B,citras-fm,0.857,0.571,1.0,0.085,0.01,0.182
-Toto-2.0-2.5B,Chronos-Bolt,0.857,0.571,1.0,0.087,0.027,0.16
-Toto-2.0-2.5B,Seasonal Naive,1.0,1.0,1.0,0.432,0.323,0.521
-Toto-2.0-313m,TimesFM-3,0.143,0.0,0.429,-0.063,-0.132,-0.005
-Toto-2.0-313m,Chronos-2,0.286,0.0,0.571,-0.026,-0.086,0.011
-Toto-2.0-313m,Toto-2.0-1B,0.286,0.0,0.571,-0.009,-0.022,0.001
-Toto-2.0-313m,t0-beta,0.571,0.143,0.861,-0.006,-0.052,0.036
-Toto-2.0-313m,TimesFM-2.5,0.429,0.143,0.857,-0.002,-0.051,0.046
-Toto-2.0-313m,Toto-2.0-2.5B,0.571,0.143,0.861,-0.001,-0.009,0.009
-Toto-2.0-313m,Toto-2.0-313m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-313m,TabPFN-TS-3,0.571,0.143,0.861,0.037,-0.03,0.122
-Toto-2.0-313m,TS-ICL,0.571,0.143,0.857,0.02,-0.015,0.061
-Toto-2.0-313m,TiRex,0.857,0.571,1.0,0.012,-0.012,0.032
-Toto-2.0-313m,TiRex-2,0.857,0.571,1.0,0.02,0.008,0.032
-Toto-2.0-313m,FlowState,0.571,0.143,0.861,0.023,-0.019,0.068
-Toto-2.0-313m,Toto-2.0-22m,0.857,0.571,1.0,0.021,0.007,0.035
-Toto-2.0-313m,TFT,0.714,0.429,1.0,0.099,-0.032,0.257
-Toto-2.0-313m,citras-fm,0.857,0.571,1.0,0.084,0.002,0.189
-Toto-2.0-313m,Chronos-Bolt,0.857,0.571,1.0,0.086,0.019,0.168
-Toto-2.0-313m,Seasonal Naive,1.0,1.0,1.0,0.431,0.326,0.518
-TabPFN-TS-3,TimesFM-3,0.0,0.0,0.0,-0.104,-0.192,-0.036
-TabPFN-TS-3,Chronos-2,0.286,0.0,0.571,-0.066,-0.159,-0.008
-TabPFN-TS-3,Toto-2.0-1B,0.429,0.139,0.857,-0.047,-0.145,0.012
-TabPFN-TS-3,t0-beta,0.143,0.0,0.429,-0.044,-0.117,-0.001
-TabPFN-TS-3,TimesFM-2.5,0.286,0.0,0.571,-0.041,-0.104,0.001
-TabPFN-TS-3,Toto-2.0-2.5B,0.429,0.139,0.857,-0.04,-0.129,0.019
-TabPFN-TS-3,Toto-2.0-313m,0.429,0.139,0.857,-0.038,-0.139,0.029
-TabPFN-TS-3,TabPFN-TS-3,0.5,0.5,0.5,0.0,0.0,0.0
-TabPFN-TS-3,TS-ICL,0.429,0.0,0.857,-0.018,-0.08,0.032
-TabPFN-TS-3,TiRex,0.571,0.143,0.857,-0.026,-0.119,0.026
-TabPFN-TS-3,TiRex-2,0.429,0.139,0.857,-0.018,-0.123,0.051
-TabPFN-TS-3,FlowState,0.714,0.286,1.0,-0.014,-0.075,0.022
-TabPFN-TS-3,Toto-2.0-22m,0.429,0.139,0.857,-0.017,-0.132,0.058
-TabPFN-TS-3,TFT,0.429,0.143,0.718,0.064,-0.093,0.23
-TabPFN-TS-3,citras-fm,1.0,1.0,1.0,0.049,0.027,0.077
-TabPFN-TS-3,Chronos-Bolt,1.0,1.0,1.0,0.051,0.029,0.085
-TabPFN-TS-3,Seasonal Naive,1.0,1.0,1.0,0.409,0.27,0.515
-TS-ICL,TimesFM-3,0.0,0.0,0.0,-0.084,-0.125,-0.047
-TS-ICL,Chronos-2,0.286,0.0,0.571,-0.047,-0.11,0.003
-TS-ICL,Toto-2.0-1B,0.143,0.0,0.429,-0.029,-0.075,0.006
-TS-ICL,t0-beta,0.429,0.143,0.714,-0.026,-0.066,0.009
-TS-ICL,TimesFM-2.5,0.286,0.0,0.571,-0.023,-0.047,-0.005
-TS-ICL,Toto-2.0-2.5B,0.429,0.143,0.857,-0.021,-0.058,0.008
-TS-ICL,Toto-2.0-313m,0.429,0.143,0.857,-0.02,-0.065,0.014
-TS-ICL,TabPFN-TS-3,0.571,0.143,1.0,0.018,-0.033,0.074
-TS-ICL,TS-ICL,0.5,0.5,0.5,0.0,0.0,0.0
-TS-ICL,TiRex,0.286,0.0,0.571,-0.008,-0.051,0.024
-TS-ICL,TiRex-2,0.429,0.143,0.857,-0.0,-0.049,0.041
-TS-ICL,FlowState,0.571,0.143,0.857,0.003,-0.023,0.026
-TS-ICL,Toto-2.0-22m,0.429,0.143,0.857,0.001,-0.056,0.049
-TS-ICL,TFT,0.714,0.429,1.0,0.081,-0.041,0.223
-TS-ICL,citras-fm,0.857,0.571,1.0,0.065,-0.005,0.146
-TS-ICL,Chronos-Bolt,0.857,0.571,1.0,0.068,0.014,0.128
-TS-ICL,Seasonal Naive,1.0,1.0,1.0,0.419,0.296,0.522
-TiRex,TimesFM-3,0.0,0.0,0.0,-0.075,-0.134,-0.029
-TiRex,Chronos-2,0.0,0.0,0.0,-0.038,-0.078,-0.015
-TiRex,Toto-2.0-1B,0.0,0.0,0.0,-0.02,-0.037,-0.006
-TiRex,t0-beta,0.286,0.0,0.714,-0.018,-0.044,0.009
-TiRex,TimesFM-2.5,0.429,0.143,0.857,-0.014,-0.049,0.024
-TiRex,Toto-2.0-2.5B,0.286,0.0,0.571,-0.013,-0.032,0.007
-TiRex,Toto-2.0-313m,0.143,0.0,0.429,-0.012,-0.034,0.012
-TiRex,TabPFN-TS-3,0.429,0.143,0.857,0.026,-0.027,0.107
-TiRex,TS-ICL,0.714,0.429,1.0,0.008,-0.025,0.048
-TiRex,TiRex,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex,TiRex-2,0.714,0.429,1.0,0.008,-0.012,0.033
-TiRex,FlowState,0.429,0.143,0.857,0.011,-0.016,0.046
-TiRex,Toto-2.0-22m,0.571,0.286,0.857,0.009,-0.017,0.041
-TiRex,TFT,0.714,0.429,1.0,0.088,-0.023,0.237
-TiRex,citras-fm,0.857,0.571,1.0,0.073,0.002,0.175
-TiRex,Chronos-Bolt,0.857,0.571,1.0,0.075,0.017,0.156
-TiRex,Seasonal Naive,1.0,1.0,1.0,0.424,0.325,0.511
-TiRex-2,TimesFM-3,0.143,0.0,0.429,-0.084,-0.166,-0.025
-TiRex-2,Chronos-2,0.286,0.0,0.571,-0.047,-0.114,-0.008
-TiRex-2,Toto-2.0-1B,0.143,0.0,0.429,-0.029,-0.051,-0.012
-TiRex-2,t0-beta,0.286,0.0,0.714,-0.026,-0.073,0.014
-TiRex-2,TimesFM-2.5,0.429,0.143,0.857,-0.023,-0.076,0.029
-TiRex-2,Toto-2.0-2.5B,0.143,0.0,0.429,-0.021,-0.038,-0.004
-TiRex-2,Toto-2.0-313m,0.143,0.0,0.429,-0.02,-0.034,-0.008
-TiRex-2,TabPFN-TS-3,0.571,0.143,0.861,0.018,-0.053,0.11
-TiRex-2,TS-ICL,0.571,0.143,0.857,0.0,-0.043,0.047
-TiRex-2,TiRex,0.286,0.0,0.571,-0.008,-0.034,0.012
-TiRex-2,TiRex-2,0.5,0.5,0.5,0.0,0.0,0.0
-TiRex-2,FlowState,0.429,0.143,0.857,0.003,-0.043,0.051
-TiRex-2,Toto-2.0-22m,0.714,0.286,1.0,0.001,-0.01,0.011
-TiRex-2,TFT,0.714,0.429,1.0,0.081,-0.058,0.241
-TiRex-2,citras-fm,0.857,0.571,1.0,0.065,-0.023,0.177
-TiRex-2,Chronos-Bolt,0.714,0.429,1.0,0.068,0.001,0.151
-TiRex-2,Seasonal Naive,1.0,1.0,1.0,0.42,0.321,0.501
-FlowState,TimesFM-3,0.0,0.0,0.0,-0.088,-0.128,-0.049
-FlowState,Chronos-2,0.286,0.0,0.571,-0.05,-0.094,-0.014
-FlowState,Toto-2.0-1B,0.429,0.139,0.857,-0.032,-0.079,0.002
-FlowState,t0-beta,0.143,0.0,0.429,-0.029,-0.048,-0.012
-FlowState,TimesFM-2.5,0.0,0.0,0.0,-0.026,-0.037,-0.015
-FlowState,Toto-2.0-2.5B,0.286,0.0,0.714,-0.025,-0.063,0.01
-FlowState,Toto-2.0-313m,0.429,0.139,0.857,-0.024,-0.073,0.019
-FlowState,TabPFN-TS-3,0.286,0.0,0.714,0.014,-0.022,0.069
-FlowState,TS-ICL,0.429,0.143,0.857,-0.003,-0.027,0.023
-FlowState,TiRex,0.571,0.143,0.857,-0.012,-0.049,0.016
-FlowState,TiRex-2,0.571,0.143,0.857,-0.003,-0.054,0.042
-FlowState,FlowState,0.5,0.5,0.5,0.0,0.0,0.0
-FlowState,Toto-2.0-22m,0.571,0.143,0.857,-0.002,-0.065,0.051
-FlowState,TFT,0.571,0.286,0.857,0.078,-0.035,0.221
-FlowState,citras-fm,0.714,0.286,1.0,0.062,0.009,0.139
-FlowState,Chronos-Bolt,1.0,1.0,1.0,0.065,0.02,0.123
-FlowState,Seasonal Naive,1.0,1.0,1.0,0.418,0.304,0.514
-Toto-2.0-22m,TimesFM-3,0.286,0.0,0.714,-0.085,-0.171,-0.014
-Toto-2.0-22m,Chronos-2,0.143,0.0,0.429,-0.048,-0.12,-0.007
-Toto-2.0-22m,Toto-2.0-1B,0.0,0.0,0.0,-0.03,-0.055,-0.01
-Toto-2.0-22m,t0-beta,0.286,0.0,0.714,-0.027,-0.083,0.025
-Toto-2.0-22m,TimesFM-2.5,0.286,0.0,0.714,-0.024,-0.086,0.038
-Toto-2.0-22m,Toto-2.0-2.5B,0.143,0.0,0.429,-0.022,-0.044,0.0
-Toto-2.0-22m,Toto-2.0-313m,0.143,0.0,0.429,-0.021,-0.037,-0.007
-Toto-2.0-22m,TabPFN-TS-3,0.571,0.143,0.861,0.017,-0.062,0.117
-Toto-2.0-22m,TS-ICL,0.571,0.143,0.857,-0.001,-0.051,0.053
-Toto-2.0-22m,TiRex,0.429,0.143,0.714,-0.009,-0.042,0.017
-Toto-2.0-22m,TiRex-2,0.286,0.0,0.714,-0.001,-0.011,0.01
-Toto-2.0-22m,FlowState,0.429,0.143,0.857,0.002,-0.054,0.061
-Toto-2.0-22m,Toto-2.0-22m,0.5,0.5,0.5,0.0,0.0,0.0
-Toto-2.0-22m,TFT,0.571,0.143,0.857,0.08,-0.064,0.248
-Toto-2.0-22m,citras-fm,0.857,0.571,1.0,0.064,-0.029,0.184
-Toto-2.0-22m,Chronos-Bolt,0.714,0.429,1.0,0.067,-0.009,0.156
-Toto-2.0-22m,Seasonal Naive,1.0,1.0,1.0,0.419,0.32,0.502
-TFT,TimesFM-3,0.0,0.0,0.0,-0.18,-0.381,-0.061
-TFT,Chronos-2,0.143,0.0,0.429,-0.139,-0.364,-0.026
-TFT,Toto-2.0-1B,0.286,0.0,0.571,-0.119,-0.353,0.013
-TFT,t0-beta,0.286,0.0,0.571,-0.116,-0.316,-0.003
-TFT,TimesFM-2.5,0.286,0.0,0.571,-0.113,-0.315,0.006
-TFT,Toto-2.0-2.5B,0.429,0.143,0.714,-0.111,-0.346,0.027
-TFT,Toto-2.0-313m,0.286,0.0,0.571,-0.11,-0.346,0.031
-TFT,TabPFN-TS-3,0.571,0.282,0.857,-0.069,-0.298,0.085
-TFT,TS-ICL,0.286,0.0,0.571,-0.088,-0.287,0.04
-TFT,TiRex,0.286,0.0,0.571,-0.097,-0.311,0.022
-TFT,TiRex-2,0.286,0.0,0.571,-0.088,-0.317,0.055
-TFT,FlowState,0.429,0.143,0.714,-0.084,-0.283,0.034
-TFT,Toto-2.0-22m,0.429,0.143,0.857,-0.087,-0.329,0.06
-TFT,TFT,0.5,0.5,0.5,0.0,0.0,0.0
-TFT,citras-fm,0.571,0.282,0.857,-0.017,-0.229,0.146
-TFT,Chronos-Bolt,0.714,0.429,1.0,-0.014,-0.221,0.136
-TFT,Seasonal Naive,1.0,1.0,1.0,0.368,0.241,0.486
-citras-fm,TimesFM-3,0.0,0.0,0.0,-0.16,-0.285,-0.069
-citras-fm,Chronos-2,0.0,0.0,0.0,-0.12,-0.251,-0.049
-citras-fm,Toto-2.0-1B,0.143,0.0,0.429,-0.101,-0.241,-0.019
-citras-fm,t0-beta,0.0,0.0,0.0,-0.097,-0.209,-0.033
-citras-fm,TimesFM-2.5,0.0,0.0,0.0,-0.094,-0.194,-0.031
-citras-fm,Toto-2.0-2.5B,0.143,0.0,0.429,-0.093,-0.222,-0.01
-citras-fm,Toto-2.0-313m,0.143,0.0,0.429,-0.091,-0.232,-0.002
-citras-fm,TabPFN-TS-3,0.0,0.0,0.0,-0.051,-0.084,-0.028
-citras-fm,TS-ICL,0.143,0.0,0.429,-0.07,-0.17,0.005
-citras-fm,TiRex,0.143,0.0,0.429,-0.079,-0.213,-0.002
-citras-fm,TiRex-2,0.143,0.0,0.429,-0.07,-0.215,0.022
-citras-fm,FlowState,0.286,0.0,0.714,-0.066,-0.162,-0.009
-citras-fm,Toto-2.0-22m,0.143,0.0,0.429,-0.069,-0.226,0.028
-citras-fm,TFT,0.429,0.143,0.718,0.017,-0.171,0.186
-citras-fm,citras-fm,0.5,0.5,0.5,0.0,0.0,0.0
-citras-fm,Chronos-Bolt,0.714,0.429,1.0,0.003,-0.044,0.048
-citras-fm,Seasonal Naive,0.857,0.571,1.0,0.379,0.221,0.494
-Chronos-Bolt,TimesFM-3,0.0,0.0,0.0,-0.163,-0.268,-0.082
-Chronos-Bolt,Chronos-2,0.0,0.0,0.0,-0.123,-0.218,-0.052
-Chronos-Bolt,Toto-2.0-1B,0.143,0.0,0.429,-0.104,-0.21,-0.031
-Chronos-Bolt,t0-beta,0.0,0.0,0.0,-0.1,-0.177,-0.048
-Chronos-Bolt,TimesFM-2.5,0.0,0.0,0.0,-0.097,-0.175,-0.045
-Chronos-Bolt,Toto-2.0-2.5B,0.143,0.0,0.429,-0.095,-0.19,-0.027
-Chronos-Bolt,Toto-2.0-313m,0.143,0.0,0.429,-0.094,-0.201,-0.019
-Chronos-Bolt,TabPFN-TS-3,0.0,0.0,0.0,-0.054,-0.093,-0.03
-Chronos-Bolt,TS-ICL,0.143,0.0,0.429,-0.073,-0.147,-0.015
-Chronos-Bolt,TiRex,0.143,0.0,0.429,-0.081,-0.185,-0.017
-Chronos-Bolt,TiRex-2,0.286,0.0,0.571,-0.073,-0.178,-0.001
-Chronos-Bolt,FlowState,0.0,0.0,0.0,-0.069,-0.14,-0.021
-Chronos-Bolt,Toto-2.0-22m,0.286,0.0,0.571,-0.072,-0.185,0.009
-Chronos-Bolt,TFT,0.286,0.0,0.571,0.014,-0.158,0.181
-Chronos-Bolt,citras-fm,0.286,0.0,0.571,-0.003,-0.05,0.042
-Chronos-Bolt,Chronos-Bolt,0.5,0.5,0.5,0.0,0.0,0.0
-Chronos-Bolt,Seasonal Naive,1.0,1.0,1.0,0.377,0.246,0.48
-Seasonal Naive,TimesFM-3,0.0,0.0,0.0,-0.868,-1.286,-0.535
-Seasonal Naive,Chronos-2,0.0,0.0,0.0,-0.803,-1.12,-0.532
-Seasonal Naive,Toto-2.0-1B,0.0,0.0,0.0,-0.772,-1.094,-0.499
-Seasonal Naive,t0-beta,0.0,0.0,0.0,-0.767,-1.09,-0.502
-Seasonal Naive,TimesFM-2.5,0.0,0.0,0.0,-0.762,-1.122,-0.461
-Seasonal Naive,Toto-2.0-2.5B,0.0,0.0,0.0,-0.759,-1.087,-0.477
-Seasonal Naive,Toto-2.0-313m,0.0,0.0,0.0,-0.757,-1.076,-0.483
-Seasonal Naive,TabPFN-TS-3,0.0,0.0,0.0,-0.692,-1.063,-0.37
-Seasonal Naive,TS-ICL,0.0,0.0,0.0,-0.723,-1.093,-0.42
-Seasonal Naive,TiRex,0.0,0.0,0.0,-0.737,-1.043,-0.481
-Seasonal Naive,TiRex-2,0.0,0.0,0.0,-0.723,-1.006,-0.472
-Seasonal Naive,FlowState,0.0,0.0,0.0,-0.717,-1.057,-0.436
-Seasonal Naive,Toto-2.0-22m,0.0,0.0,0.0,-0.721,-1.008,-0.47
-Seasonal Naive,TFT,0.0,0.0,0.0,-0.583,-0.946,-0.318
-Seasonal Naive,citras-fm,0.143,0.0,0.429,-0.61,-0.975,-0.284
-Seasonal Naive,Chronos-Bolt,0.0,0.0,0.0,-0.606,-0.925,-0.327
-Seasonal Naive,Seasonal Naive,0.5,0.5,0.5,0.0,0.0,0.0

tables/domain_nature/leaderboard_MASE.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-TimesFM-3,90.32258064516128,32.670141043316725,0.0,5.4817234602246785,0.0,0.0
-t0-beta,89.6774193548387,32.01293033595749,0.0,4.218731696663392,0.0,0.0
-Chronos-2,85.80645161290323,32.66797317900995,0.0,1.2412635011904762,0.0,0.0
-TiRex-2,78.06451612903226,30.201739251352212,0.0,0.5037701877188825,0.0,0.0
-TiRex,74.83870967741936,29.260350065108376,0.0,0.5982643197619048,0.0,0.0
-citras-fm,74.83870967741936,29.209520364239804,0.0,2.3397720910989763,0.0,0.0
-Toto-2.0-2.5B,72.90322580645162,29.93563029482772,0.0,5.480653777619048,0.0,0.0
-Toto-2.0-1B,72.25806451612902,29.99164696817904,0.0,2.6320384638095238,0.0,0.0
-FlowState,70.3225806451613,29.357226912555344,0.0,3.96545264,0.0,0.0
-Toto-2.0-313m,69.03225806451613,29.754752173256584,0.0,1.0491609395238097,0.0,0.0
-Chronos-Bolt,67.41935483870968,28.93605738519158,0.0,0.48393358404761905,0.0,0.0
-TimesFM-2.5,66.45161290322581,29.394157929053712,0.0,8.123959618571428,0.0,0.0
-Toto-2.0-22m,60.64516129032258,28.76118230177598,0.0,0.288075893939394,0.0,0.0
-Moirai-2.0,59.67741935483871,27.399232776718353,0.0,0.9636899613636363,0.6,0.0
-TS-ICL,59.354838709677416,27.337264578289744,0.0,3.338946787241314,0.0,0.0
-Sundial-Base,58.06451612903226,27.294413166287423,0.0,8.222455888744589,0.0,0.0
-Toto-1.0,57.419354838709666,27.802663844137786,0.0,45.546909770000006,0.0,0.0
-Toto-2.0-4m,55.48387096774194,27.78289022024678,0.0,0.2509964376623377,0.0,0.0
-Stat. Ensemble,45.80645161290323,23.420687735560985,0.0,464.32897872499996,0.0,0.0
-TabPFN-TS-3,45.80645161290323,24.109596179935487,0.0,296.51637025115633,0.0,0.0
-TabPFN-TS,41.935483870967744,23.98149756470208,0.0,289.5137977333333,0.0,0.0
-AutoTheta,40.0,21.542038924284434,0.0,3.6892116628571427,0.0,0.0
-AutoETS,28.387096774193548,-29.622695283539358,0.0,12.04727024095238,0.0,0.0
-AutoARIMA,28.387096774193544,17.97726241921238,0.0,74.60550639090908,0.0,0.0
-TFT,16.7741935483871,11.739357763049185,4425.985155724524,3.3604472566666668,0.0,0.0
-Naive,16.7741935483871,7.795601696116828,0.0,1.2708901502164502,0.0,0.0
-PatchTST,15.483870967741936,9.449688890714715,3313.3185033727273,3.1006886961904763,0.0,0.0
-Drift,12.903225806451612,4.078700196776586,0.0,1.1961910245238094,0.0,0.0
-LightGBM,12.903225806451612,4.1721599099919455,7.8792804414285715,1.6888857054761903,0.0,0.0
-CatBoost,12.258064516129032,4.184526702220593,101.213129105,2.2554284954545456,0.0,0.0
-DeepAR,10.967741935483872,3.384538751976529,4186.5014168181815,5.73706040909091,0.0,0.0
-Seasonal Naive,9.03225806451613,0.0,0.0,1.2824682583333336,0.0,0.0

tables/domain_nature/leaderboard_SQL.csv

@@ -1,33 +0,0 @@
-model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures
-t0-beta,93.54838709677419,39.93945084542874,0.0,4.218731696663392,0.0,0.0
-TimesFM-3,90.32258064516128,40.347061778148706,0.0,5.4817234602246785,0.0,0.0
-Chronos-2,86.4516129032258,40.14261361598851,0.0,1.2412635011904762,0.0,0.0
-TiRex-2,81.29032258064515,38.09386445171089,0.0,0.5037701877188825,0.0,0.0
-TiRex,77.41935483870968,37.43876342889425,0.0,0.5982643197619048,0.0,0.0
-Toto-2.0-2.5B,75.48387096774192,37.83157222733069,0.0,5.480653777619048,0.0,0.0
-Toto-2.0-1B,72.25806451612904,37.66612649055474,0.0,2.6320384638095238,0.0,0.0
-Toto-2.0-313m,71.61290322580646,37.58550747009978,0.0,1.0491609395238097,0.0,0.0
-TimesFM-2.5,70.3225806451613,37.188322050437485,0.0,8.123959618571428,0.0,0.0
-citras-fm,69.03225806451613,36.04259739782568,0.0,2.3397720910989763,0.0,0.0
-FlowState,66.45161290322581,36.31166826953211,0.0,3.96545264,0.0,0.0
-Chronos-Bolt,65.48387096774194,36.03582808206656,0.0,0.48393358404761905,0.0,0.0
-TS-ICL,63.22580645161291,35.85151872644183,0.0,3.338946787241314,0.0,0.0
-Toto-2.0-22m,60.64516129032259,36.293037504059534,0.0,0.288075893939394,0.0,0.0
-Moirai-2.0,60.32258064516128,34.85309081790271,0.0,0.9636899613636363,0.6,0.0
-Toto-1.0,60.00000000000001,35.99499337037837,0.0,45.546909770000006,0.0,0.0
-Toto-2.0-4m,57.41935483870968,35.936651145406394,0.0,0.2509964376623377,0.0,0.0
-TabPFN-TS-3,52.9032258064516,32.679408744349004,0.0,296.51637025115633,0.0,0.0
-TabPFN-TS,50.967741935483865,32.757599647708304,0.0,289.5137977333333,0.0,0.0
-Sundial-Base,43.2258064516129,30.90991527640704,0.0,8.222455888744589,0.0,0.0
-Stat. Ensemble,36.774193548387096,17.231323121576647,0.0,464.32897872499996,0.0,0.0
-AutoARIMA,31.612903225806456,22.423106139028192,0.0,74.60550639090908,0.0,0.0
-TFT,27.74193548387097,18.511138237688506,4425.985155724524,3.3604472566666668,0.0,0.0
-PatchTST,25.161290322580648,17.09711611460085,3313.3185033727273,3.1006886961904763,0.0,0.0
-AutoETS,22.58064516129032,-136.42889638840893,0.0,12.04727024095238,0.0,0.0
-DeepAR,21.935483870967744,9.609592105853038,4186.5014168181815,5.73706040909091,0.0,0.0
-AutoTheta,16.7741935483871,-2.841792105310592,0.0,3.6892116628571427,0.0,0.0
-Seasonal Naive,15.48387096774194,0.0,0.0,1.2824682583333336,0.0,0.0
-CatBoost,12.258064516129034,-6.491295800307162,101.213129105,2.2554284954545456,0.0,0.0
-LightGBM,12.258064516129032,-6.505040508588555,7.8792804414285715,1.6888857054761903,0.0,0.0
-Naive,6.451612903225806,-23.56398425913284,0.0,1.2708901502164502,0.0,0.0
-Drift,2.5806451612903225,-28.21332719128542,0.0,1.1961910245238094,0.0,0.0