IUseAMouse commited on
Commit
ec60f33
·
verified ·
1 Parent(s): 3b2a629

Card: architecture figure

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -208,6 +208,11 @@ series.
208
 
209
  ## Model
210
 
 
 
 
 
 
211
  Four layers, each a causal S4D layer followed by causal attention over the patch
212
  tokens, applied in two shared passes; width 352, state size 32, 8 heads; 9,982,512 parameters.
213
  Each series is normalized causally, patch by patch, then passed through an arcsinh. The horizon is
 
208
 
209
  ## Model
210
 
211
+ ![TimeSSM-10M: the RateIN layer resamples the context to several rates and sign-flips it, the trunk (causal normalization, patches of 16 steps, four layers of gated S4D and causal attention run twice, quantile head) forecasts each one, and the RateIN layer returns the forecasts to the native grid and mixes them](assets/timessm_10m_architecture.png)
212
+
213
+ *The RateIN layer is the first and the last layer of the model. The trunk holds the 9.98M
214
+ learned weights and runs once per rate and per sign.*
215
+
216
  Four layers, each a causal S4D layer followed by causal attention over the patch
217
  tokens, applied in two shared passes; width 352, state size 32, 8 heads; 9,982,512 parameters.
218
  Each series is normalized causally, patch by patch, then passed through an arcsinh. The horizon is