phclab commited on
Commit
c52c81f
·
verified ·
1 Parent(s): dfe6af2

CentralComplex_Pong v1 (decay)

Browse files
README.md CHANGED
@@ -20,21 +20,25 @@ Synaptic weights trained with PHCSSM parallel-scan mode, deployment in sequentia
20
  made by Po-Han Chiang @ NYCU
21
 
22
  ## What the central complex does in the fly
23
- The central complex is the fly's navigation and steering centre: it keeps track of heading and turns it into steering commands. In the real fly, the central complex keeps track of heading with a ring-shaped “internal compass”, integrates the path travelled, and steers where the fly goes next.
24
 
25
  ## Architecture
26
  * **Wiring:** MaleCNS v1.0 central complex -- 2,950 neurons (Ring neurons (ER, ExR) 308; PFN columnar neurons 456; PFL output neurons 50; Other central-complex neurons 2,136) and 439,500
27
- neuron-to-neuron connections. The connectivity mask is fixed to the connectome; 357,964 connections
28
  carry a nonzero weight and 0 weights lie off the connectome.
29
  * **Dale's law:** one sign per presynaptic neuron from predicted neurotransmitters (excitatory 1,873,
30
  inhibitory 918, modulatory 159); 0 weights violate it.
31
  * **Input:** each frame provides 6 numbers seen from the fly's side of the court: the ball's position and
32
  velocity and the positions of both paddles. A linear encoder with LayerNorm drives only the input population:
33
- 764 ring neurons (ER, ExR) and PFN columnar neurons.
34
  * **Neurons:** leaky integrate-and-fire with per-neuron leak, threshold and reset; synaptic delay of one step.
35
- * **Readout:** linear map from the membrane voltage of the output population only, 50 PFL1, PFL2 and PFL3 steering neurons,
36
  to 3 paddle commands (stay, up, down).
37
- * **No dopamine gate and no fast weight** (those belong to the mushroom body).
 
 
 
 
38
  * **Deployment:** sequential RSNN mode, one timestep per frame at 60 frames per second, with the neuron state carried
39
  across the whole game.
40
 
@@ -46,11 +50,11 @@ Data source: actions of a scripted Pong player.
46
 
47
  | opponent | games won | point share | fly's return rate |
48
  |---|---|---|---|
49
- | a noisy scripted player | 18 / 20 | 0.629 | 93.0% |
50
- | a weak scripted player | 20 / 20 | 0.917 | 94.4% |
51
- | a perfect scripted player | 0 / 20 | 0.000 | 95.7% |
52
 
53
- On 131,072 held-out frames, the fly's choice matches the scripted player's action on 97.4% in both parallel-scan and sequential RSNN mode, and the two modes choose the same action on 99.92% of frames.
54
 
55
  ## Files
56
  * `manifest.json` -- every tensor (file, dtype, shape, bytes), the model scalars and a connectome audit.
@@ -58,9 +62,9 @@ On 131,072 held-out frames, the fly's choice matches the scripted player's actio
58
  * `selfcheck_<precision>.json` -- reference observations and logits that the page replays when it loads.
59
  * `fp16/`, `fp32/` -- raw little-endian arrays.
60
 
61
- Two precisions are listed in the manifest: `fp16w32` (default, 2.3 MB: float16 for the
62
  readout matrix `dec_w`, float32 for the recurrent weights and all other tensors) and
63
- `fp16` (1.6 MB, recurrent weights in float16 as well).
64
 
65
  The recurrent weight matrix W[dst, src] is stored in CSC order by source neuron (`W_colptr`, `W_rowidx`, `W_vals`):
66
  each step multiplies W by a sparse binary spike vector, so the engine visits only the columns of the neurons that
@@ -73,6 +77,14 @@ observation encoder and `dec_w` [3, 50] is read against the output population's
73
  | `enc_obs_b` | `fp32/enc_obs_b.bin` | float32 | 2950 |
74
  | `ln_obs_w` | `fp32/ln_obs_w.bin` | float32 | 2950 |
75
  | `ln_obs_b` | `fp32/ln_obs_b.bin` | float32 | 2950 |
 
 
 
 
 
 
 
 
76
  | `dec_w` | `fp16/dec_w.bin` | float16 | 3x50 |
77
  | `dec_b` | `fp32/dec_b.bin` | float32 | 3 |
78
  | `alpha_exc` | `fp32/alpha_exc.bin` | float32 | 2950 |
@@ -82,8 +94,8 @@ observation encoder and `dec_w` [3, 50] is read against the output population's
82
  | `in_idx` | `fp32/in_idx.bin` | int32 | 764 |
83
  | `out_idx` | `fp32/out_idx.bin` | int32 | 50 |
84
  | `W_colptr` | `fp32/W_colptr.bin` | uint32 | 2951 |
85
- | `W_rowidx` | `fp32/W_rowidx.bin` | uint16 | 357964 |
86
- | `W_vals` | `fp32/W_vals.bin` | float32 | 357964 |
87
 
88
  **Numerical check:** 0 of 27,281,600 spike bits differ from the reference on the same weights (2,048 held-out frames and a 7,200-frame closed-loop game).
89
 
 
20
  made by Po-Han Chiang @ NYCU
21
 
22
  ## What the central complex does in the fly
23
+ The central complex is the fly's navigation and steering centre: it keeps track of heading and turns it into steering commands. Its plasticity gate is driven by 123 neuromodulatory cells — dopamine, serotonin and octopamine — over 793 real synapses, and what they write into the fast weight fades within about two frames. In the real fly, the central complex keeps track of heading with a ring-shaped “internal compass”, integrates the path travelled, and steers where the fly goes next.
24
 
25
  ## Architecture
26
  * **Wiring:** MaleCNS v1.0 central complex -- 2,950 neurons (Ring neurons (ER, ExR) 308; PFN columnar neurons 456; PFL output neurons 50; Other central-complex neurons 2,136) and 439,500
27
+ neuron-to-neuron connections. The connectivity mask is fixed to the connectome; 360,336 connections
28
  carry a nonzero weight and 0 weights lie off the connectome.
29
  * **Dale's law:** one sign per presynaptic neuron from predicted neurotransmitters (excitatory 1,873,
30
  inhibitory 918, modulatory 159); 0 weights violate it.
31
  * **Input:** each frame provides 6 numbers seen from the fly's side of the court: the ball's position and
32
  velocity and the positions of both paddles. A linear encoder with LayerNorm drives only the input population:
33
+ 764 ER ring (landmark/visual) + PFN (self-motion via NO) + ExR.
34
  * **Neurons:** leaky integrate-and-fire with per-neuron leak, threshold and reset; synaptic delay of one step.
35
+ * **Readout:** linear map from the membrane voltage of the output population only, 50 PFL1/2/3 (steering -> LAL),
36
  to 3 paddle commands (stay, up, down).
37
+ * **Neuromodulatory gate:** 123 of this region's own known-neuromodulator cells (dopamine+octopamine+serotonin) gate the
38
+ current into the output population, masked to the 793 real gate-cell -> output synapses in the connectome.
39
+ * **Fast weight:** a value written onto the 1,556 real input -> output synapses, gated by the same cells, read
40
+ back into the output neurons' voltages. It is read with the current frame's input spikes and written with the same
41
+ frame's, and it decays: one trainable factor per output neuron, a decay time constant of about 1.80 frames (30.0 ms at 60 fps).
42
  * **Deployment:** sequential RSNN mode, one timestep per frame at 60 frames per second, with the neuron state carried
43
  across the whole game.
44
 
 
50
 
51
  | opponent | games won | point share | fly's return rate |
52
  |---|---|---|---|
53
+ | a noisy scripted player | 11 / 20 | 0.520 | 88.2% |
54
+ | a weak scripted player | 20 / 20 | 0.880 | 91.9% |
55
+ | a perfect scripted player | 0 / 20 | 0.000 | 91.7% |
56
 
57
+ On 131,072 held-out frames the fly's choice matches the scripted player's action on 97.1% in sequential RSNN mode, and the parallel-scan and sequential modes choose the same action on 99.68% of frames.
58
 
59
  ## Files
60
  * `manifest.json` -- every tensor (file, dtype, shape, bytes), the model scalars and a connectome audit.
 
62
  * `selfcheck_<precision>.json` -- reference observations and logits that the page replays when it loads.
63
  * `fp16/`, `fp32/` -- raw little-endian arrays.
64
 
65
+ Two precisions are listed in the manifest: `fp16w32` (default, 2.4 MB: float16 for the
66
  readout matrix `dec_w`, float32 for the recurrent weights and all other tensors) and
67
+ `fp16` (1.7 MB, recurrent weights in float16 as well).
68
 
69
  The recurrent weight matrix W[dst, src] is stored in CSC order by source neuron (`W_colptr`, `W_rowidx`, `W_vals`):
70
  each step multiplies W by a sparse binary spike vector, so the engine visits only the columns of the neurons that
 
77
  | `enc_obs_b` | `fp32/enc_obs_b.bin` | float32 | 2950 |
78
  | `ln_obs_w` | `fp32/ln_obs_w.bin` | float32 | 2950 |
79
  | `ln_obs_b` | `fp32/ln_obs_b.bin` | float32 | 2950 |
80
+ | `teach_T` | `fp32/teach_T.bin` | float32 | 6x123 |
81
+ | `teach_b` | `fp32/teach_b.bin` | float32 | 123 |
82
+ | `W_gate` | `fp32/W_gate.bin` | float32 | 50x123 |
83
+ | `W_val` | `fp32/W_val.bin` | float32 | 50x123 |
84
+ | `gate_idx` | `fp32/gate_idx.bin` | int32 | 123 |
85
+ | `fw_in` | `fp32/fw_in.bin` | int32 | 1556 |
86
+ | `fw_out` | `fp32/fw_out.bin` | int32 | 1556 |
87
+ | `gamma` | `fp32/gamma.bin` | float32 | 50 |
88
  | `dec_w` | `fp16/dec_w.bin` | float16 | 3x50 |
89
  | `dec_b` | `fp32/dec_b.bin` | float32 | 3 |
90
  | `alpha_exc` | `fp32/alpha_exc.bin` | float32 | 2950 |
 
94
  | `in_idx` | `fp32/in_idx.bin` | int32 | 764 |
95
  | `out_idx` | `fp32/out_idx.bin` | int32 | 50 |
96
  | `W_colptr` | `fp32/W_colptr.bin` | uint32 | 2951 |
97
+ | `W_rowidx` | `fp32/W_rowidx.bin` | uint16 | 360336 |
98
+ | `W_vals` | `fp32/W_vals.bin` | float32 | 360336 |
99
 
100
  **Numerical check:** 0 of 27,281,600 spike bits differ from the reference on the same weights (2,048 held-out frames and a 7,200-frame closed-loop game).
101
 
fp16/W_vals.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82c0b5bd6e5fd9fa4a3fc896eca73686f6347f38d06f6bcf5d25b0eeeda3bd27
3
- size 715928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81e3ab4da8720a1ebd0f33a0c3cc433d9907165021475cffb2bb4b63244dc4ba
3
+ size 720672
fp16/dec_w.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74f8ab2fe40e6cdcbbe2cd721da60135129f82671d2666e6904dd79baa93e1e0
3
  size 300
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68590860193bcc929efdc144c8685c19617f97c8ee06cae9df80a41909d88534
3
  size 300
fp32/W_colptr.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:73ba3f78ddb2a19ce112314f8019b9e67494ee678169b21af8e6f894121cee4b
3
  size 11804
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11d843954d5e539cddc2e18a46dab3935f6d3c4b5a5db42bea0a0bcab1bf1ee6
3
  size 11804
fp32/W_gate.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7483ce562fa23a659f8f4c9246b7477ee4bb17f1ed8ef2e7cbbd535dea2ba92d
3
+ size 24600
fp32/W_rowidx.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe01b21030c4496e5a3a4456b59d31ec66b6c7a2fdd22eb2a61a5f26c27ece1e
3
- size 715928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:889be470dfccc43a8489ee03daa1c79699f203b56e76cbafd8c205c6d7d6396c
3
+ size 720672
fp32/W_val.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d63975759038367f298c15fed512e706c325d7d07a8994af20949da57da9f3f
3
+ size 24600
fp32/W_vals.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50fba33afe2d10f0bb98b8fde1d3b0f3500b25f5180297633bd99db8e1411746
3
- size 1431856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50448dd1649e1816ca2b271a8ce002bf3c02469e6ccbfffce97b4c5050b907a7
3
+ size 1441344
fp32/alpha_exc.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7b2f402706ead0fdb1bfcb02a9d8d2c467c43abacd775046afc8bf41d940a555
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:561760635883a7cd6cd2a19235f8263382251d19d80e0db907bc218d663740ec
3
  size 11800
fp32/alpha_inh.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bab3fa2486d8eca8424fd5e3b99247c56d63dc2b044c3e9c251e6f51f15752e3
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9ae61fc9acaa5898568b1ad530726654ba570367c06ceba9886f822c81cfdf1
3
  size 11800
fp32/dec_b.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6bc996aec27e901b1ecad3f1757309aa3e17c169c9e6cb50d37d4d288fb8e54
3
  size 12
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9b4cdc893dd880312b09a5dfff296897297083d73dc255aedc1993d2d0abee6
3
  size 12
fp32/enc_obs_T.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8bf699a607dfaa1798c586ccbf1a1edadd54d2edf7c90fa446a1ab65f340d53c
3
  size 70800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d91c5bc6602f796c546eaaa2ea70d6ba9e58e5e66d066a826788cd0d2f92f78e
3
  size 70800
fp32/enc_obs_b.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f22d85f64607273ba461d5c69593749bcb69cb39c4fd89ce06634dd68bd2516
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a1dca22048b9730aac790d598e0725f6d3c43acea958a79ec5be1f3b1d2a9fd
3
  size 11800
fp32/fw_in.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d32b595604acc85375ebf3b52f9fbbfafa48a588ebc4c85d5d1e268415a3b24f
3
+ size 6224
fp32/fw_out.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16bdfc2284013728258c7e03ef49810e50bb786c779dbc1ddc624c8120136ac8
3
+ size 6224
fp32/gamma.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3490fd9d421fe33d72f0f3479b3cec9138735789d47c6eb336c9f035d807ae4b
3
+ size 200
fp32/gate_idx.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:583f72f790b7c230b2ea1d04f53f618f526330a3e59f4ebafc77b695b6f31782
3
+ size 492
fp32/ln_obs_b.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:59d070ee82170ee893f38bd448cd9810589261996687fcdd9dc02208bd18f9b9
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0562f6b65dabba43b0269f6f31f13fb6f70c6d3399313390e022e2c4d49b979f
3
  size 11800
fp32/ln_obs_w.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ee6a67e8d18532ee904457aeffb26e491e40e95ae7b03966978e988b851e95f
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f5d35f3613df1610046e9af6e123f07bf0ab804636827602eb7ac59a1b07e54
3
  size 11800
fp32/reset_weight.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d15f9d6c074577914eb23ced7fb2176ba1e276f69d2f06891dbe1aa92390403e
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3433a93ded56c8beaf4c311b8f8a30767dc6da9cad3f3c93ed801599427111e
3
  size 11800
fp32/teach_T.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19704d821b5aa1b80fe23e69bf2a11c525c2d7bb52555c35e5f169d335b25c12
3
+ size 2952
fp32/teach_b.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e811bc12447983ffd855f958b4d151b3ba7122677973766283f6ef848e561be
3
+ size 492
fp32/v_th.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c76d0ead6ade89406ae030974691d5b4bb35ee78a77c381a38fe4e3e74783a0e
3
  size 11800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b954b82958f11c356888b03a1c3f3780f4abcbc7c951645f42c9492db69a7bb
3
  size 11800
info.json CHANGED
The diff for this file is too large to render. See raw diff
 
manifest.json CHANGED
@@ -11,8 +11,29 @@
11
  "n_out": 50,
12
  "e_cl": -0.5,
13
  "drive_alpha": 1.0,
14
- "mode": "off",
15
- "nnz": 357964
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  },
17
  "variants": {
18
  "fp16w32": {
@@ -49,6 +70,73 @@
49
  ],
50
  "bytes": 11800
51
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
  "dec_w": {
53
  "file": "fp16/dec_w.bin",
54
  "dtype": "float16",
@@ -126,17 +214,17 @@
126
  "file": "fp32/W_rowidx.bin",
127
  "dtype": "uint16",
128
  "shape": [
129
- 357964
130
  ],
131
- "bytes": 715928
132
  },
133
  "W_vals": {
134
  "file": "fp32/W_vals.bin",
135
  "dtype": "float32",
136
  "shape": [
137
- 357964
138
  ],
139
- "bytes": 1431856
140
  }
141
  },
142
  "fp16": {
@@ -173,6 +261,73 @@
173
  ],
174
  "bytes": 11800
175
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
176
  "dec_w": {
177
  "file": "fp16/dec_w.bin",
178
  "dtype": "float16",
@@ -250,23 +405,23 @@
250
  "file": "fp32/W_rowidx.bin",
251
  "dtype": "uint16",
252
  "shape": [
253
- 357964
254
  ],
255
- "bytes": 715928
256
  },
257
  "W_vals": {
258
  "file": "fp16/W_vals.bin",
259
  "dtype": "float16",
260
  "shape": [
261
- 357964
262
  ],
263
- "bytes": 715928
264
  }
265
  }
266
  },
267
  "connectome_audit": {
268
  "connections": 439500,
269
- "nonzero_weights": 357964,
270
  "off_connectome": 0,
271
  "wrong_sign": 0,
272
  "excitatory": 1873,
 
11
  "n_out": 50,
12
  "e_cl": -0.5,
13
  "drive_alpha": 1.0,
14
+ "mode": "mech",
15
+ "nnz": 360336,
16
+ "dan_teach": 1.0,
17
+ "lam": 1.0,
18
+ "mech": true,
19
+ "n_gate": 123,
20
+ "fw_edges": 1556,
21
+ "gate_edges": 793,
22
+ "decay": true,
23
+ "gate_label": "dopamine+octopamine+serotonin",
24
+ "gate_types": {
25
+ "dopamine": 22,
26
+ "octopamine": 18,
27
+ "serotonin": 83
28
+ },
29
+ "gate_type_edges": {
30
+ "dopamine": 427,
31
+ "octopamine": 15,
32
+ "serotonin": 351
33
+ },
34
+ "input_label": "ER ring (landmark/visual) + PFN (self-motion via NO) + ExR",
35
+ "output_label": "PFL1/2/3 (steering -> LAL)",
36
+ "region": "CX_all"
37
  },
38
  "variants": {
39
  "fp16w32": {
 
70
  ],
71
  "bytes": 11800
72
  },
73
+ "teach_T": {
74
+ "file": "fp32/teach_T.bin",
75
+ "dtype": "float32",
76
+ "shape": [
77
+ 6,
78
+ 123
79
+ ],
80
+ "bytes": 2952
81
+ },
82
+ "teach_b": {
83
+ "file": "fp32/teach_b.bin",
84
+ "dtype": "float32",
85
+ "shape": [
86
+ 123
87
+ ],
88
+ "bytes": 492
89
+ },
90
+ "W_gate": {
91
+ "file": "fp32/W_gate.bin",
92
+ "dtype": "float32",
93
+ "shape": [
94
+ 50,
95
+ 123
96
+ ],
97
+ "bytes": 24600
98
+ },
99
+ "W_val": {
100
+ "file": "fp32/W_val.bin",
101
+ "dtype": "float32",
102
+ "shape": [
103
+ 50,
104
+ 123
105
+ ],
106
+ "bytes": 24600
107
+ },
108
+ "gate_idx": {
109
+ "file": "fp32/gate_idx.bin",
110
+ "dtype": "int32",
111
+ "shape": [
112
+ 123
113
+ ],
114
+ "bytes": 492
115
+ },
116
+ "fw_in": {
117
+ "file": "fp32/fw_in.bin",
118
+ "dtype": "int32",
119
+ "shape": [
120
+ 1556
121
+ ],
122
+ "bytes": 6224
123
+ },
124
+ "fw_out": {
125
+ "file": "fp32/fw_out.bin",
126
+ "dtype": "int32",
127
+ "shape": [
128
+ 1556
129
+ ],
130
+ "bytes": 6224
131
+ },
132
+ "gamma": {
133
+ "file": "fp32/gamma.bin",
134
+ "dtype": "float32",
135
+ "shape": [
136
+ 50
137
+ ],
138
+ "bytes": 200
139
+ },
140
  "dec_w": {
141
  "file": "fp16/dec_w.bin",
142
  "dtype": "float16",
 
214
  "file": "fp32/W_rowidx.bin",
215
  "dtype": "uint16",
216
  "shape": [
217
+ 360336
218
  ],
219
+ "bytes": 720672
220
  },
221
  "W_vals": {
222
  "file": "fp32/W_vals.bin",
223
  "dtype": "float32",
224
  "shape": [
225
+ 360336
226
  ],
227
+ "bytes": 1441344
228
  }
229
  },
230
  "fp16": {
 
261
  ],
262
  "bytes": 11800
263
  },
264
+ "teach_T": {
265
+ "file": "fp32/teach_T.bin",
266
+ "dtype": "float32",
267
+ "shape": [
268
+ 6,
269
+ 123
270
+ ],
271
+ "bytes": 2952
272
+ },
273
+ "teach_b": {
274
+ "file": "fp32/teach_b.bin",
275
+ "dtype": "float32",
276
+ "shape": [
277
+ 123
278
+ ],
279
+ "bytes": 492
280
+ },
281
+ "W_gate": {
282
+ "file": "fp32/W_gate.bin",
283
+ "dtype": "float32",
284
+ "shape": [
285
+ 50,
286
+ 123
287
+ ],
288
+ "bytes": 24600
289
+ },
290
+ "W_val": {
291
+ "file": "fp32/W_val.bin",
292
+ "dtype": "float32",
293
+ "shape": [
294
+ 50,
295
+ 123
296
+ ],
297
+ "bytes": 24600
298
+ },
299
+ "gate_idx": {
300
+ "file": "fp32/gate_idx.bin",
301
+ "dtype": "int32",
302
+ "shape": [
303
+ 123
304
+ ],
305
+ "bytes": 492
306
+ },
307
+ "fw_in": {
308
+ "file": "fp32/fw_in.bin",
309
+ "dtype": "int32",
310
+ "shape": [
311
+ 1556
312
+ ],
313
+ "bytes": 6224
314
+ },
315
+ "fw_out": {
316
+ "file": "fp32/fw_out.bin",
317
+ "dtype": "int32",
318
+ "shape": [
319
+ 1556
320
+ ],
321
+ "bytes": 6224
322
+ },
323
+ "gamma": {
324
+ "file": "fp32/gamma.bin",
325
+ "dtype": "float32",
326
+ "shape": [
327
+ 50
328
+ ],
329
+ "bytes": 200
330
+ },
331
  "dec_w": {
332
  "file": "fp16/dec_w.bin",
333
  "dtype": "float16",
 
405
  "file": "fp32/W_rowidx.bin",
406
  "dtype": "uint16",
407
  "shape": [
408
+ 360336
409
  ],
410
+ "bytes": 720672
411
  },
412
  "W_vals": {
413
  "file": "fp16/W_vals.bin",
414
  "dtype": "float16",
415
  "shape": [
416
+ 360336
417
  ],
418
+ "bytes": 720672
419
  }
420
  }
421
  },
422
  "connectome_audit": {
423
  "connections": 439500,
424
+ "nonzero_weights": 360336,
425
  "off_connectome": 0,
426
  "wrong_sign": 0,
427
  "excitatory": 1873,
selfcheck_fp16.json CHANGED
@@ -1 +1 @@
1
- {"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.8787394762039185,-0.6114039421081543,-0.5088789463043213]},{"ids":[0,1,2],"top1":0,"logits":[2.085676670074463,-2.9228463172912598,-2.7851476669311523]},{"ids":[0,1,2],"top1":0,"logits":[1.5073764324188232,-4.950127124786377,-4.559909820556641]},{"ids":[0,1,2],"top1":0,"logits":[5.883167266845703,-10.54907512664795,-7.706550121307373]},{"ids":[0,1,2],"top1":0,"logits":[8.806675910949707,-12.952544212341309,-10.455337524414062]},{"ids":[0,1,2],"top1":0,"logits":[10.039826393127441,-14.367136001586914,-11.041876792907715]},{"ids":[0,1,2],"top1":0,"logits":[10.002545356750488,-14.335160255432129,-11.146500587463379]},{"ids":[0,1,2],"top1":0,"logits":[10.148820877075195,-14.13672924041748,-11.700505256652832]},{"ids":[0,1,2],"top1":0,"logits":[10.239065170288086,-14.076438903808594,-12.00818920135498]},{"ids":[0,1,2],"top1":0,"logits":[10.226348876953125,-14.024569511413574,-12.193458557128906]},{"ids":[0,1,2],"top1":0,"logits":[10.433571815490723,-13.717543601989746,-12.593491554260254]},{"ids":[0,1,2],"top1":0,"logits":[10.527689933776855,-13.354146957397461,-12.844412803649902]},{"ids":[0,1,2],"top1":0,"logits":[10.600767135620117,-13.177018165588379,-13.004024505615234]},{"ids":[0,1,2],"top1":0,"logits":[10.646618843078613,-13.084250450134277,-13.09901237487793]},{"ids":[0,1,2],"top1":0,"logits":[10.663775444030762,-13.041987419128418,-13.143875122070312]},{"ids":[0,1,2],"top1":0,"logits":[10.666483879089355,-13.018174171447754,-13.165557861328125]}]}
 
1
+ {"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.3026662766933441,-0.22481447458267212,-0.20093734562397003]},{"ids":[0,1,2],"top1":0,"logits":[2.350318431854248,-3.9179489612579346,-4.813953399658203]},{"ids":[0,1,2],"top1":0,"logits":[3.8600001335144043,-7.494997978210449,-6.629037857055664]},{"ids":[0,1,2],"top1":0,"logits":[4.608853816986084,-12.67160415649414,-7.4519758224487305]},{"ids":[0,1,2],"top1":0,"logits":[4.967690944671631,-14.353910446166992,-8.63898754119873]},{"ids":[0,1,2],"top1":0,"logits":[2.6720259189605713,-11.852953910827637,-6.721469879150391]},{"ids":[0,1,2],"top1":0,"logits":[3.2054336071014404,-12.480395317077637,-7.568173408508301]},{"ids":[0,1,2],"top1":0,"logits":[3.843613862991333,-12.901008605957031,-8.75387191772461]},{"ids":[0,1,2],"top1":0,"logits":[4.664247989654541,-11.042426109313965,-10.909772872924805]},{"ids":[0,1,2],"top1":0,"logits":[5.874533176422119,-10.570650100708008,-12.709486961364746]},{"ids":[0,1,2],"top1":0,"logits":[6.321775436401367,-10.1642427444458,-13.304863929748535]},{"ids":[0,1,2],"top1":0,"logits":[6.6664652824401855,-9.830596923828125,-14.235029220581055]},{"ids":[0,1,2],"top1":0,"logits":[6.812446594238281,-9.598345756530762,-14.748185157775879]},{"ids":[0,1,2],"top1":0,"logits":[6.724730014801025,-10.364381790161133,-14.428290367126465]},{"ids":[0,1,2],"top1":0,"logits":[6.545581817626953,-10.016763687133789,-14.337736129760742]},{"ids":[0,1,2],"top1":0,"logits":[6.437992095947266,-9.82512378692627,-14.27882194519043]}]}
selfcheck_fp16w32.json CHANGED
@@ -1 +1 @@
1
- {"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.8787394762039185,-0.6114039421081543,-0.5088789463043213]},{"ids":[0,1,2],"top1":0,"logits":[2.0856924057006836,-2.9230527877807617,-2.784801959991455]},{"ids":[0,1,2],"top1":0,"logits":[1.507352590560913,-4.950775146484375,-4.559138774871826]},{"ids":[0,1,2],"top1":0,"logits":[5.88360071182251,-10.55046272277832,-7.705632209777832]},{"ids":[0,1,2],"top1":0,"logits":[8.80713939666748,-12.954005241394043,-10.454439163208008]},{"ids":[0,1,2],"top1":0,"logits":[10.040287971496582,-14.368544578552246,-11.04150676727295]},{"ids":[0,1,2],"top1":0,"logits":[10.002815246582031,-14.336383819580078,-11.145890235900879]},{"ids":[0,1,2],"top1":0,"logits":[10.14904499053955,-14.137933731079102,-11.699775695800781]},{"ids":[0,1,2],"top1":0,"logits":[10.239214897155762,-14.077561378479004,-12.007400512695312]},{"ids":[0,1,2],"top1":0,"logits":[10.226428985595703,-14.025628089904785,-12.192631721496582]},{"ids":[0,1,2],"top1":0,"logits":[10.433588981628418,-13.718503952026367,-12.592643737792969]},{"ids":[0,1,2],"top1":0,"logits":[10.527669906616211,-13.35501766204834,-12.843552589416504]},{"ids":[0,1,2],"top1":0,"logits":[10.600716590881348,-13.177835464477539,-13.003154754638672]},{"ids":[0,1,2],"top1":0,"logits":[10.646552085876465,-13.085036277770996,-13.098134994506836]},{"ids":[0,1,2],"top1":0,"logits":[10.66369915008545,-13.042764663696289,-13.142993927001953]},{"ids":[0,1,2],"top1":0,"logits":[10.674837112426758,-13.020223617553711,-13.169859886169434]}]}
 
1
+ {"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.3026662766933441,-0.22481447458267212,-0.20093734562397003]},{"ids":[0,1,2],"top1":0,"logits":[2.3503289222717285,-3.917922019958496,-4.813990592956543]},{"ids":[0,1,2],"top1":0,"logits":[3.860015869140625,-7.495028495788574,-6.62905216217041]},{"ids":[0,1,2],"top1":0,"logits":[4.608800888061523,-12.671577453613281,-7.451944351196289]},{"ids":[0,1,2],"top1":0,"logits":[4.967630863189697,-14.353872299194336,-8.638978958129883]},{"ids":[0,1,2],"top1":0,"logits":[2.671954870223999,-11.852911949157715,-6.721457481384277]},{"ids":[0,1,2],"top1":0,"logits":[3.2054200172424316,-12.48039722442627,-7.5682196617126465]},{"ids":[0,1,2],"top1":0,"logits":[3.843602418899536,-12.901015281677246,-8.753922462463379]},{"ids":[0,1,2],"top1":0,"logits":[4.664289474487305,-11.042506217956543,-10.909829139709473]},{"ids":[0,1,2],"top1":0,"logits":[5.87457275390625,-10.570738792419434,-12.709527969360352]},{"ids":[0,1,2],"top1":0,"logits":[6.321731090545654,-10.164267539978027,-13.304828643798828]},{"ids":[0,1,2],"top1":0,"logits":[6.666418552398682,-9.830619812011719,-14.235002517700195]},{"ids":[0,1,2],"top1":0,"logits":[6.81240177154541,-9.598366737365723,-14.748161315917969]},{"ids":[0,1,2],"top1":0,"logits":[6.724684715270996,-10.364402770996094,-14.428264617919922]},{"ids":[0,1,2],"top1":0,"logits":[6.54553747177124,-10.01678466796875,-14.337713241577148]},{"ids":[0,1,2],"top1":0,"logits":[6.437949180603027,-9.82514476776123,-14.278800010681152]}]}