Card: architecture figure
Browse files
README.md
CHANGED
|
@@ -208,6 +208,11 @@ series.
|
|
| 208 |
|
| 209 |
## Model
|
| 210 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 211 |
Four layers, each a causal S4D layer followed by causal attention over the patch
|
| 212 |
tokens, applied in two shared passes; width 352, state size 32, 8 heads; 9,982,512 parameters.
|
| 213 |
Each series is normalized causally, patch by patch, then passed through an arcsinh. The horizon is
|
|
|
|
| 208 |
|
| 209 |
## Model
|
| 210 |
|
| 211 |
+

|
| 212 |
+
|
| 213 |
+
*The RateIN layer is the first and the last layer of the model. The trunk holds the 9.98M
|
| 214 |
+
learned weights and runs once per rate and per sign.*
|
| 215 |
+
|
| 216 |
Four layers, each a causal S4D layer followed by causal attention over the patch
|
| 217 |
tokens, applied in two shared passes; width 352, state size 32, 8 heads; 9,982,512 parameters.
|
| 218 |
Each series is normalized causally, patch by patch, then passed through an arcsinh. The horizon is
|