shubham-yhatlabs commited on
Commit
d23cae0
·
0 Parent(s):

model card

Browse files
Files changed (2) hide show
  1. .gitattributes +35 -0
  2. README.md +106 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,106 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: non-commercial-research-evaluation
4
+ license_link: https://yhatlabs.com
5
+ pipeline_tag: time-series-forecasting
6
+ tags:
7
+ - time-series
8
+ - forecasting
9
+ - zero-shot
10
+ - probabilistic-forecasting
11
+ - foundation-model
12
+ - research
13
+ model-index:
14
+ - name: ChakraTS-Lab
15
+ results:
16
+ - task:
17
+ type: time-series-forecasting
18
+ dataset:
19
+ name: GIFT-Eval
20
+ type: Salesforce/GiftEval
21
+ metrics:
22
+ - type: MASE
23
+ name: MASE (geometric mean, relative to seasonal naive)
24
+ value: 0.660
25
+ - type: CRPS
26
+ name: CRPS (geometric mean, relative to seasonal naive)
27
+ value: 0.452
28
+ source:
29
+ name: GIFT-Eval leaderboard
30
+ url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
31
+ ---
32
+
33
+ # ChakraTS-Lab
34
+
35
+ **ChakraTS-Lab is the research configuration of [ChakraTS](https://huggingface.co/yhatlabs/ChakraTS), YHat Labs' zero-shot probabilistic forecasting model. It is the same mixture of expert forecasters with models that are not part of YHat-Labs model family. It exists to show what the approach reaches when every strong open model is admitted, and it is available for research and benchmark evaluation only. This repository holds the model card; there are no weights to download.**
36
+
37
+ - Commercial product: [yhatlabs/ChakraTS](https://huggingface.co/yhatlabs/ChakraTS)
38
+ - Website: https://yhatlabs.com
39
+ - Code, benchmark files and notebooks: https://github.com/yhatlabs/yhatlabs
40
+ - Leaderboards(coming soon): [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval) · [fev-bench](https://huggingface.co/spaces/autogluon/fev-bench)
41
+
42
+ ## Access
43
+
44
+ ChakraTS-Lab is not sold. Benchmark maintainers and researchers who need to reproduce the leaderboard entries can request evaluation access at https://yhatlabs.com. The request and response format is identical to ChakraTS (see its [model card](https://huggingface.co/yhatlabs/ChakraTS)); the Lab configuration is served from a separate endpoint.
45
+
46
+ ## Evaluation
47
+
48
+ *Leaderboard submissions are not yet published; the numbers below are from our runs of the official protocols.*
49
+
50
+ Official protocols, full benchmarks, official seasonal-naive baselines. ChakraTS-Lab is zero-shot: no benchmark training split, GIFT-Eval's included, is used to fit, tune or select anything, and no benchmark test data is seen at any point. The per-series weights are computed from each series' own past windows at request time.
51
+
52
+ ### GIFT-Eval (97 dataset configurations) — not yet published
53
+
54
+ | Model | MASE | CRPS | Licence |
55
+ |---|---|---|---|
56
+ | **ChakraTS-Lab** | **0.660** | **0.452** | research only |
57
+ | TimesFM-3 | 0.667 | 0.456 | non-commercial |
58
+ | ChakraTS | 0.671 | 0.462 | commercial API |
59
+ | Toto-2.0-FnF | 0.676 | 0.463 | |
60
+ | T0-beta | 0.687 | 0.474 | Apache-2.0 |
61
+ | TiRex-2 | 0.697 | 0.478 | Apache-2.0 |
62
+ | Chronos-2 | 0.698 | 0.485 | Apache-2.0 |
63
+ | TimesFM-2.5 | 0.705 | 0.490 | Apache-2.0 |
64
+
65
+ ### fev-bench (100 tasks) — not yet published
66
+
67
+ | Model | Skill score |
68
+ |---|---|
69
+ | ChakraTS-Lab | not evaluated on fev-bench |
70
+ | ChakraTS (`chakra-ts-fev` configuration) | 48.1 |
71
+ | TimesFM-3 | 48.7 |
72
+ | Chronos-2 | 47.3 |
73
+ | TimesFM-2.5 | 42.2 (leaderboard figure, after its leakage replacement) |
74
+ | T0-beta | 46.7 |
75
+ | TiRex-2 | 45.5 |
76
+
77
+ Per-task result files and the evaluation notebooks are in the [GitHub repository](https://github.com/yhatlabs/yhatlabs).
78
+
79
+ ## Approach
80
+
81
+ ChakraTS-Lab is a mixture of expert forecasters. Each expert produces a full predictive distribution for every series and the distributions are pooled. There is no trained gate and nothing is learned across datasets, which is why the configuration can be evaluated on any benchmark without a leakage question. The difference from ChakraTS is only the expert pool.
82
+
83
+ YHat Labs has trained its own forecasting models. The current one that powers ChakraTS is a 30M-parameter patch-based transformer trained on a curated corpus that is disjoint from the public benchmarks. It is one of the experts in the pool.
84
+
85
+ ## Intended use
86
+
87
+ Research comparison and benchmark evaluation of zero-shot forecasting systems.
88
+
89
+ ## Not intended use
90
+
91
+ This model is not for any commercial or production use. For production use, see [ChakraTS](https://huggingface.co/yhatlabs/ChakraTS).
92
+
93
+ ## Citation
94
+
95
+ ```bibtex
96
+ @misc{chakratslab2026,
97
+ title = {ChakraTS-Lab: research configuration of ChakraTS},
98
+ author = {YHat Labs},
99
+ year = {2026},
100
+ url = {https://huggingface.co/yhatlabs/ChakraTS-Lab}
101
+ }
102
+ ```
103
+
104
+ ## Contact
105
+
106
+ founders@yhatlabs.com · https://yhatlabs.com