| ---
|
| language: en
|
| license: apache-2.0
|
| tags:
|
| - time-series
|
| - forecasting
|
| - chronos
|
| - patch-aliasing
|
| base_model: amazon/chronos-bolt-tiny
|
| ---
|
|
|
| # Chronos-Bolt Patch-Stride Sweep
|
|
|
| Retrained variants of [Chronos-Bolt Tiny](https://huggingface.co/amazon/chronos-bolt-tiny) (~8.7M params) with different **patch size (P)** and **patch stride (S)** configurations, trained from scratch on the full official Chronos pre-training data.
|
|
|
| ## Purpose
|
|
|
| These models support the **structural patch-aliasing** study: investigating how the (P, S) patch geometry of Chronos-Bolt creates frequency-dependent artifacts in time-series forecasting. Each model is trained identically except for the patch geometry, so any downstream difference in aliasing probes is attributable to (P, S).
|
|
|
| ## Models
|
|
|
| | Subfolder | P | S | Overlap | Status |
|
| |---|---|---|---|---|
|
| | `p8-s4-seed42` | 8 | 4 | 0.500 | done |
|
| | `p8-s8-seed42` | 8 | 8 | 0.000 | done |
|
| | `p16-s4-seed42` | 16 | 4 | 0.750 | done |
|
| | `p16-s8-seed42` | 16 | 8 | 0.500 | done |
|
| | `p16-s12-seed42` | 16 | 12 | 0.250 | done |
|
| | `p16-s15-seed42` | 16 | 15 | 0.062 | done |
|
| | `p16-s16-seed42` | 16 | 16 | 0.000 | done |
|
| | `p24-s8-seed42` | 24 | 8 | 0.667 | done |
|
| | `p24-s12-seed42` | 24 | 12 | 0.500 | done |
|
| | `p24-s15-seed42` | 24 | 15 | 0.375 | done |
|
| | `p24-s16-seed42` | 24 | 16 | 0.333 | done |
|
| | `p24-s20-seed42` | 24 | 20 | 0.167 | done |
|
| | `p24-s24-seed42` | 24 | 24 | 0.000 | done |
|
| | `p32-s8-seed42` | 32 | 8 | 0.750 | done |
|
| | `p32-s12-seed42` | 32 | 12 | 0.625 | done |
|
| | `p32-s15-seed42` | 32 | 15 | 0.531 | done |
|
| | `p32-s16-seed42` | 32 | 16 | 0.500 | done |
|
| | `p32-s20-seed42` | 32 | 20 | 0.375 | done |
|
| | `p32-s24-seed42` | 32 | 24 | 0.250 | done |
|
| | `p32-s28-seed42` | 32 | 28 | 0.125 | done |
|
| | `p32-s32-seed42` | 32 | 32 | 0.000 | done |
|
|
|
| ## Training setup
|
|
|
| All models share the same training regime (only P and S vary):
|
|
|
| - **Architecture**: Chronos-Bolt Tiny (T5-based, ~8.7M params), random initialization
|
| - **Data**: Official Chronos pre-training corpus — TSMixup (10M series) + KernelSynth (1M series) at 9:1 ratio
|
| - **Steps**: 100,000 (fixed budget across all runs)
|
| - **Optimizer**: AdamW, lr=1e-3, linear decay, no warmup
|
| - **Batch size**: 32
|
| - **Precision**: fp32 + TF32 matmuls (Ampere+ GPUs)
|
| - **Context**: 2048 tokens, prediction horizon: 64
|
| - **Quantiles**: 9 (0.1 to 0.9)
|
| - **Seed**: 42
|
|
|
| Full provenance is recorded in each subfolder's `run_config.json`.
|
|
|
| ## Usage
|
|
|
| ```python
|
| from chronos import BaseChronosPipeline
|
|
|
| pipe = BaseChronosPipeline.from_pretrained(
|
| "federicosabbadini/chronos-bolt-patch-sweep",
|
| subfolder="p24-s16-seed42",
|
| device_map="cpu",
|
| )
|
| ```
|
|
|
| ## Files per model
|
|
|
| - `config.json` — model architecture config
|
| - `model.safetensors` — trained weights (~34 MB)
|
| - `run_config.json` — full training provenance + result metrics
|
| - `loss_history.npy` — per-step training loss
|
| - `loss_curve.png` — training loss plot
|
|
|
| ## License
|
|
|
| The models are derived from the Chronos architecture (Apache-2.0) and trained on the official Chronos datasets. See the original [Chronos repository](https://github.com/amazon-science/chronos-forecasting) for details.
|
|
|
