File size: 7,651 Bytes
185fe37 ede8d89 2c3a715 ede8d89 185fe37 b34ec11 ecea46f b34ec11 185fe37 8e9d9a6 185fe37 1357a37 3d2745e 185fe37 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 | ---
license: openmdw-1.1
library_name: simons
pipeline_tag: time-series-forecasting
datasets:
- abel-lab/Simons-Pretrain
thumbnail: https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/abel-color.png
tags:
- time-series
- forecasting
- probabilistic-forecasting
- foundation-model
- covariates
- pretrained
- pytorch
model-index:
- name: Simons-25M
results:
- task:
type: time-series-forecasting
dataset:
name: GIFT-Eval
type: Salesforce/GiftEval
metrics:
- name: MASE (relative to Seasonal Naive)
type: mase
value: 0.6860
- name: CRPS (relative to Seasonal Naive)
type: crps
value: 0.4683
source:
name: GIFT-Eval leaderboard
url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
- task:
type: time-series-forecasting
dataset:
name: fev-bench
type: autogluon/fev_datasets
metrics:
- name: SQL skill score (%, relative to Seasonal Naive)
type: sql
value: 47.74
- name: MASE skill score (%, relative to Seasonal Naive)
type: mase
value: 36.27
source:
name: fev-bench leaderboard
url: https://huggingface.co/spaces/autogluon/fev-bench
- task:
type: time-series-forecasting
dataset:
name: TIME
type: Real-TSF/TIME
metrics:
- name: MASE (relative to Seasonal Naive)
type: mase
value: 0.6473
- name: CRPS (relative to Seasonal Naive)
type: crps
value: 0.5426
source:
name: TIME leaderboard
url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
---
<p align="center">
<img class="dark:hidden"
src="https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/abel-color.png" alt="Abel"
width="240" />
<img class="hidden dark:block"
src="https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/abel-white.png" alt="Abel"
width="240" />
</p>
# Simons-25M
[](https://github.com/Abel-ai-lab/Simons)
[](https://huggingface.co/datasets/abel-lab/Simons-Pretrain)
Simons-25M is an open time series foundation model from Abel AI Lab for probabilistic forecasting.
It supports univariate and multivariate series with known-future covariates.
The [GitHub repository](https://github.com/Abel-ai-lab/Simons) contains inference and training code.
The release post, [Introducing Simons](https://abel.ai/research/introducing-simons/), tells how the models were built.
All four sizes and the training data are in the [Simons 1](https://huggingface.co/collections/abel-lab/simons-1-6ae3d4ce9705938e293c52dd) collection.
The [Simons Forecast Explorer](https://huggingface.co/spaces/abel-lab/simons-forecast-explorer) shows forecasts of the four sizes in the browser.
## Model details
- **Size:** 25.1M parameters.
- **Architecture:** a causal transformer over patches of 32 time steps, then an attention layer
across the variates of a series; 12 layers, width 384, 6 heads.
- **Context and horizon:** up to 16,384 time steps of history; 512 steps per forward pass, longer
horizons block by block.
- **Inputs:** up to 32 variates and up to 16 known-future covariates per series, numeric or
categorical; NaN marks missing values. Past-only covariates are accepted and dropped.
- **Outputs:** 9 quantiles (0.1, 0.2, ..., 0.9).
- **Training:** four stages, from synthetic pretraining to post-training on real data; the released
weights are the uniform average of the two continuations (Model soups).
- **Inference:** PyTorch on CPU or GPU, with the `simons` package, version 0.1.0 or later.
## Benchmarks
<p align="center">
<img class="dark:hidden"
src="https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/benchmark-places.png" alt="Places on public benchmark leaderboards"
width="720" />
<img class="hidden dark:block"
src="https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/benchmark-places-dark.png" alt="Places on public benchmark leaderboards"
width="720" />
</p>
The place of Simons-297M and four widely used models on each benchmark. On
[GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), [fev-bench](https://huggingface.co/spaces/autogluon/fev-bench) and [TIME](https://huggingface.co/spaces/Real-TSF/TIME-leaderboard) the places are among the open-weight entries.
### Efficiency
Simons is fast to run: on one A100 GPU, Simons-297M forecasts a whole benchmark in minutes, about ten
times faster than models of similar size.
<p align="center">
<img class="dark:hidden"
src="https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/inference-time.png" alt="Time to forecast GIFT-Eval, TIME and fev-bench"
width="720" />
<img class="hidden dark:block"
src="https://huggingface.co/abel-lab/Simons-25M/resolve/main/assets/inference-time-dark.png" alt="Time to forecast GIFT-Eval, TIME and fev-bench"
width="720" />
</p>
## Get started
```shell
pip install "git+https://github.com/Abel-ai-lab/Simons"
```
```python
import torch
from simons import Simons
device = "cuda" if torch.cuda.is_available() else "cpu"
model = Simons.from_pretrained("abel-lab/Simons-25M", device=device)
# [batch, time] or [batch, variates, time]; NaN marks missing values
history = torch.randn(8, 2000).cumsum(-1)
quantiles = model.forecast(history, horizon=96) # [8, 96, 9]
# Known-future covariates: [batch, covariates, time + horizon]
covariates = torch.randn(8, 2, 2000 + 96)
quantiles = model.forecast(history, horizon=96, covariates=covariates)
```
- **Training data:** [abel-lab/Simons-Pretrain](https://huggingface.co/datasets/abel-lab/Simons-Pretrain),
the public part of the data the models were trained on.
- **Getting started:** [docs/GETTING_STARTED.md](https://github.com/Abel-ai-lab/Simons/blob/main/docs/GETTING_STARTED.md) covers the input format,
covariates, forecast options and fine-tuning.
- **Models:** [docs/MODEL.md](https://github.com/Abel-ai-lab/Simons/blob/main/docs/MODEL.md) compares the four sizes and gives their scores.
- **Training:** [docs/TRAINING.md](https://github.com/Abel-ai-lab/Simons/blob/main/docs/TRAINING.md) covers the stages, configs and GPU settings.
- **Data:** [docs/DATA.md](https://github.com/Abel-ai-lab/Simons/blob/main/docs/DATA.md) describes what the models were trained on.
## Training data
- Synthetic series from the open generators in
[`src/simons/synth`](https://github.com/Abel-ai-lab/Simons/tree/main/src/simons/synth), with
synthetic known-future covariates of known effect.
- Public datasets with a permissive or share-alike license, most of them released as
[abel-lab/Simons-Pretrain](https://huggingface.co/datasets/abel-lab/Simons-Pretrain).
- Internal data: an in-house corpus.
See the
[dataset](https://huggingface.co/datasets/abel-lab/Simons-Pretrain) for data details
and the [training quickstart](https://github.com/Abel-ai-lab/Simons#train) for training commands.
Notices required by the training data's licenses: [NOTICE.md](NOTICE.md).
## License
The weights are licensed under OpenMDW-1.1 ([LICENSE](LICENSE)); the code on GitHub is licensed
under Apache-2.0 ([LICENSE](https://github.com/Abel-ai-lab/Simons/blob/main/LICENSE)). Each training
dataset keeps its own license; see [NOTICE.md](NOTICE.md) for details.
## Citation
```bibtex
@misc{simons2026,
title = {Simons: Building Open Time Series Foundation Models through Auto-Research},
author = {{Abel AI Lab}},
year = {2026},
url = {https://github.com/Abel-ai-lab/Simons}
}
```
|