CentralComplex_Pong v1 (decay)
Browse files- README.md +25 -13
- fp16/W_vals.bin +2 -2
- fp16/dec_w.bin +1 -1
- fp32/W_colptr.bin +1 -1
- fp32/W_gate.bin +3 -0
- fp32/W_rowidx.bin +2 -2
- fp32/W_val.bin +3 -0
- fp32/W_vals.bin +2 -2
- fp32/alpha_exc.bin +1 -1
- fp32/alpha_inh.bin +1 -1
- fp32/dec_b.bin +1 -1
- fp32/enc_obs_T.bin +1 -1
- fp32/enc_obs_b.bin +1 -1
- fp32/fw_in.bin +3 -0
- fp32/fw_out.bin +3 -0
- fp32/gamma.bin +3 -0
- fp32/gate_idx.bin +3 -0
- fp32/ln_obs_b.bin +1 -1
- fp32/ln_obs_w.bin +1 -1
- fp32/reset_weight.bin +1 -1
- fp32/teach_T.bin +3 -0
- fp32/teach_b.bin +3 -0
- fp32/v_th.bin +1 -1
- info.json +0 -0
- manifest.json +166 -11
- selfcheck_fp16.json +1 -1
- selfcheck_fp16w32.json +1 -1
README.md
CHANGED
|
@@ -20,21 +20,25 @@ Synaptic weights trained with PHCSSM parallel-scan mode, deployment in sequentia
|
|
| 20 |
made by Po-Han Chiang @ NYCU
|
| 21 |
|
| 22 |
## What the central complex does in the fly
|
| 23 |
-
The central complex is the fly's navigation and steering centre: it keeps track of heading and turns it into steering commands. In the real fly, the central complex keeps track of heading with a ring-shaped “internal compass”, integrates the path travelled, and steers where the fly goes next.
|
| 24 |
|
| 25 |
## Architecture
|
| 26 |
* **Wiring:** MaleCNS v1.0 central complex -- 2,950 neurons (Ring neurons (ER, ExR) 308; PFN columnar neurons 456; PFL output neurons 50; Other central-complex neurons 2,136) and 439,500
|
| 27 |
-
neuron-to-neuron connections. The connectivity mask is fixed to the connectome;
|
| 28 |
carry a nonzero weight and 0 weights lie off the connectome.
|
| 29 |
* **Dale's law:** one sign per presynaptic neuron from predicted neurotransmitters (excitatory 1,873,
|
| 30 |
inhibitory 918, modulatory 159); 0 weights violate it.
|
| 31 |
* **Input:** each frame provides 6 numbers seen from the fly's side of the court: the ball's position and
|
| 32 |
velocity and the positions of both paddles. A linear encoder with LayerNorm drives only the input population:
|
| 33 |
-
764 ring
|
| 34 |
* **Neurons:** leaky integrate-and-fire with per-neuron leak, threshold and reset; synaptic delay of one step.
|
| 35 |
-
* **Readout:** linear map from the membrane voltage of the output population only, 50 PFL1
|
| 36 |
to 3 paddle commands (stay, up, down).
|
| 37 |
-
* **
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
* **Deployment:** sequential RSNN mode, one timestep per frame at 60 frames per second, with the neuron state carried
|
| 39 |
across the whole game.
|
| 40 |
|
|
@@ -46,11 +50,11 @@ Data source: actions of a scripted Pong player.
|
|
| 46 |
|
| 47 |
| opponent | games won | point share | fly's return rate |
|
| 48 |
|---|---|---|---|
|
| 49 |
-
| a noisy scripted player |
|
| 50 |
-
| a weak scripted player | 20 / 20 | 0.
|
| 51 |
-
| a perfect scripted player | 0 / 20 | 0.000 |
|
| 52 |
|
| 53 |
-
On 131,072 held-out frames
|
| 54 |
|
| 55 |
## Files
|
| 56 |
* `manifest.json` -- every tensor (file, dtype, shape, bytes), the model scalars and a connectome audit.
|
|
@@ -58,9 +62,9 @@ On 131,072 held-out frames, the fly's choice matches the scripted player's actio
|
|
| 58 |
* `selfcheck_<precision>.json` -- reference observations and logits that the page replays when it loads.
|
| 59 |
* `fp16/`, `fp32/` -- raw little-endian arrays.
|
| 60 |
|
| 61 |
-
Two precisions are listed in the manifest: `fp16w32` (default, 2.
|
| 62 |
readout matrix `dec_w`, float32 for the recurrent weights and all other tensors) and
|
| 63 |
-
`fp16` (1.
|
| 64 |
|
| 65 |
The recurrent weight matrix W[dst, src] is stored in CSC order by source neuron (`W_colptr`, `W_rowidx`, `W_vals`):
|
| 66 |
each step multiplies W by a sparse binary spike vector, so the engine visits only the columns of the neurons that
|
|
@@ -73,6 +77,14 @@ observation encoder and `dec_w` [3, 50] is read against the output population's
|
|
| 73 |
| `enc_obs_b` | `fp32/enc_obs_b.bin` | float32 | 2950 |
|
| 74 |
| `ln_obs_w` | `fp32/ln_obs_w.bin` | float32 | 2950 |
|
| 75 |
| `ln_obs_b` | `fp32/ln_obs_b.bin` | float32 | 2950 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
| `dec_w` | `fp16/dec_w.bin` | float16 | 3x50 |
|
| 77 |
| `dec_b` | `fp32/dec_b.bin` | float32 | 3 |
|
| 78 |
| `alpha_exc` | `fp32/alpha_exc.bin` | float32 | 2950 |
|
|
@@ -82,8 +94,8 @@ observation encoder and `dec_w` [3, 50] is read against the output population's
|
|
| 82 |
| `in_idx` | `fp32/in_idx.bin` | int32 | 764 |
|
| 83 |
| `out_idx` | `fp32/out_idx.bin` | int32 | 50 |
|
| 84 |
| `W_colptr` | `fp32/W_colptr.bin` | uint32 | 2951 |
|
| 85 |
-
| `W_rowidx` | `fp32/W_rowidx.bin` | uint16 |
|
| 86 |
-
| `W_vals` | `fp32/W_vals.bin` | float32 |
|
| 87 |
|
| 88 |
**Numerical check:** 0 of 27,281,600 spike bits differ from the reference on the same weights (2,048 held-out frames and a 7,200-frame closed-loop game).
|
| 89 |
|
|
|
|
| 20 |
made by Po-Han Chiang @ NYCU
|
| 21 |
|
| 22 |
## What the central complex does in the fly
|
| 23 |
+
The central complex is the fly's navigation and steering centre: it keeps track of heading and turns it into steering commands. Its plasticity gate is driven by 123 neuromodulatory cells — dopamine, serotonin and octopamine — over 793 real synapses, and what they write into the fast weight fades within about two frames. In the real fly, the central complex keeps track of heading with a ring-shaped “internal compass”, integrates the path travelled, and steers where the fly goes next.
|
| 24 |
|
| 25 |
## Architecture
|
| 26 |
* **Wiring:** MaleCNS v1.0 central complex -- 2,950 neurons (Ring neurons (ER, ExR) 308; PFN columnar neurons 456; PFL output neurons 50; Other central-complex neurons 2,136) and 439,500
|
| 27 |
+
neuron-to-neuron connections. The connectivity mask is fixed to the connectome; 360,336 connections
|
| 28 |
carry a nonzero weight and 0 weights lie off the connectome.
|
| 29 |
* **Dale's law:** one sign per presynaptic neuron from predicted neurotransmitters (excitatory 1,873,
|
| 30 |
inhibitory 918, modulatory 159); 0 weights violate it.
|
| 31 |
* **Input:** each frame provides 6 numbers seen from the fly's side of the court: the ball's position and
|
| 32 |
velocity and the positions of both paddles. A linear encoder with LayerNorm drives only the input population:
|
| 33 |
+
764 ER ring (landmark/visual) + PFN (self-motion via NO) + ExR.
|
| 34 |
* **Neurons:** leaky integrate-and-fire with per-neuron leak, threshold and reset; synaptic delay of one step.
|
| 35 |
+
* **Readout:** linear map from the membrane voltage of the output population only, 50 PFL1/2/3 (steering -> LAL),
|
| 36 |
to 3 paddle commands (stay, up, down).
|
| 37 |
+
* **Neuromodulatory gate:** 123 of this region's own known-neuromodulator cells (dopamine+octopamine+serotonin) gate the
|
| 38 |
+
current into the output population, masked to the 793 real gate-cell -> output synapses in the connectome.
|
| 39 |
+
* **Fast weight:** a value written onto the 1,556 real input -> output synapses, gated by the same cells, read
|
| 40 |
+
back into the output neurons' voltages. It is read with the current frame's input spikes and written with the same
|
| 41 |
+
frame's, and it decays: one trainable factor per output neuron, a decay time constant of about 1.80 frames (30.0 ms at 60 fps).
|
| 42 |
* **Deployment:** sequential RSNN mode, one timestep per frame at 60 frames per second, with the neuron state carried
|
| 43 |
across the whole game.
|
| 44 |
|
|
|
|
| 50 |
|
| 51 |
| opponent | games won | point share | fly's return rate |
|
| 52 |
|---|---|---|---|
|
| 53 |
+
| a noisy scripted player | 11 / 20 | 0.520 | 88.2% |
|
| 54 |
+
| a weak scripted player | 20 / 20 | 0.880 | 91.9% |
|
| 55 |
+
| a perfect scripted player | 0 / 20 | 0.000 | 91.7% |
|
| 56 |
|
| 57 |
+
On 131,072 held-out frames the fly's choice matches the scripted player's action on 97.1% in sequential RSNN mode, and the parallel-scan and sequential modes choose the same action on 99.68% of frames.
|
| 58 |
|
| 59 |
## Files
|
| 60 |
* `manifest.json` -- every tensor (file, dtype, shape, bytes), the model scalars and a connectome audit.
|
|
|
|
| 62 |
* `selfcheck_<precision>.json` -- reference observations and logits that the page replays when it loads.
|
| 63 |
* `fp16/`, `fp32/` -- raw little-endian arrays.
|
| 64 |
|
| 65 |
+
Two precisions are listed in the manifest: `fp16w32` (default, 2.4 MB: float16 for the
|
| 66 |
readout matrix `dec_w`, float32 for the recurrent weights and all other tensors) and
|
| 67 |
+
`fp16` (1.7 MB, recurrent weights in float16 as well).
|
| 68 |
|
| 69 |
The recurrent weight matrix W[dst, src] is stored in CSC order by source neuron (`W_colptr`, `W_rowidx`, `W_vals`):
|
| 70 |
each step multiplies W by a sparse binary spike vector, so the engine visits only the columns of the neurons that
|
|
|
|
| 77 |
| `enc_obs_b` | `fp32/enc_obs_b.bin` | float32 | 2950 |
|
| 78 |
| `ln_obs_w` | `fp32/ln_obs_w.bin` | float32 | 2950 |
|
| 79 |
| `ln_obs_b` | `fp32/ln_obs_b.bin` | float32 | 2950 |
|
| 80 |
+
| `teach_T` | `fp32/teach_T.bin` | float32 | 6x123 |
|
| 81 |
+
| `teach_b` | `fp32/teach_b.bin` | float32 | 123 |
|
| 82 |
+
| `W_gate` | `fp32/W_gate.bin` | float32 | 50x123 |
|
| 83 |
+
| `W_val` | `fp32/W_val.bin` | float32 | 50x123 |
|
| 84 |
+
| `gate_idx` | `fp32/gate_idx.bin` | int32 | 123 |
|
| 85 |
+
| `fw_in` | `fp32/fw_in.bin` | int32 | 1556 |
|
| 86 |
+
| `fw_out` | `fp32/fw_out.bin` | int32 | 1556 |
|
| 87 |
+
| `gamma` | `fp32/gamma.bin` | float32 | 50 |
|
| 88 |
| `dec_w` | `fp16/dec_w.bin` | float16 | 3x50 |
|
| 89 |
| `dec_b` | `fp32/dec_b.bin` | float32 | 3 |
|
| 90 |
| `alpha_exc` | `fp32/alpha_exc.bin` | float32 | 2950 |
|
|
|
|
| 94 |
| `in_idx` | `fp32/in_idx.bin` | int32 | 764 |
|
| 95 |
| `out_idx` | `fp32/out_idx.bin` | int32 | 50 |
|
| 96 |
| `W_colptr` | `fp32/W_colptr.bin` | uint32 | 2951 |
|
| 97 |
+
| `W_rowidx` | `fp32/W_rowidx.bin` | uint16 | 360336 |
|
| 98 |
+
| `W_vals` | `fp32/W_vals.bin` | float32 | 360336 |
|
| 99 |
|
| 100 |
**Numerical check:** 0 of 27,281,600 spike bits differ from the reference on the same weights (2,048 held-out frames and a 7,200-frame closed-loop game).
|
| 101 |
|
fp16/W_vals.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81e3ab4da8720a1ebd0f33a0c3cc433d9907165021475cffb2bb4b63244dc4ba
|
| 3 |
+
size 720672
|
fp16/dec_w.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 300
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:68590860193bcc929efdc144c8685c19617f97c8ee06cae9df80a41909d88534
|
| 3 |
size 300
|
fp32/W_colptr.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11804
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:11d843954d5e539cddc2e18a46dab3935f6d3c4b5a5db42bea0a0bcab1bf1ee6
|
| 3 |
size 11804
|
fp32/W_gate.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7483ce562fa23a659f8f4c9246b7477ee4bb17f1ed8ef2e7cbbd535dea2ba92d
|
| 3 |
+
size 24600
|
fp32/W_rowidx.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:889be470dfccc43a8489ee03daa1c79699f203b56e76cbafd8c205c6d7d6396c
|
| 3 |
+
size 720672
|
fp32/W_val.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d63975759038367f298c15fed512e706c325d7d07a8994af20949da57da9f3f
|
| 3 |
+
size 24600
|
fp32/W_vals.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:50448dd1649e1816ca2b271a8ce002bf3c02469e6ccbfffce97b4c5050b907a7
|
| 3 |
+
size 1441344
|
fp32/alpha_exc.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:561760635883a7cd6cd2a19235f8263382251d19d80e0db907bc218d663740ec
|
| 3 |
size 11800
|
fp32/alpha_inh.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f9ae61fc9acaa5898568b1ad530726654ba570367c06ceba9886f822c81cfdf1
|
| 3 |
size 11800
|
fp32/dec_b.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 12
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9b4cdc893dd880312b09a5dfff296897297083d73dc255aedc1993d2d0abee6
|
| 3 |
size 12
|
fp32/enc_obs_T.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 70800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d91c5bc6602f796c546eaaa2ea70d6ba9e58e5e66d066a826788cd0d2f92f78e
|
| 3 |
size 70800
|
fp32/enc_obs_b.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a1dca22048b9730aac790d598e0725f6d3c43acea958a79ec5be1f3b1d2a9fd
|
| 3 |
size 11800
|
fp32/fw_in.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d32b595604acc85375ebf3b52f9fbbfafa48a588ebc4c85d5d1e268415a3b24f
|
| 3 |
+
size 6224
|
fp32/fw_out.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:16bdfc2284013728258c7e03ef49810e50bb786c779dbc1ddc624c8120136ac8
|
| 3 |
+
size 6224
|
fp32/gamma.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3490fd9d421fe33d72f0f3479b3cec9138735789d47c6eb336c9f035d807ae4b
|
| 3 |
+
size 200
|
fp32/gate_idx.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:583f72f790b7c230b2ea1d04f53f618f526330a3e59f4ebafc77b695b6f31782
|
| 3 |
+
size 492
|
fp32/ln_obs_b.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0562f6b65dabba43b0269f6f31f13fb6f70c6d3399313390e022e2c4d49b979f
|
| 3 |
size 11800
|
fp32/ln_obs_w.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7f5d35f3613df1610046e9af6e123f07bf0ab804636827602eb7ac59a1b07e54
|
| 3 |
size 11800
|
fp32/reset_weight.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d3433a93ded56c8beaf4c311b8f8a30767dc6da9cad3f3c93ed801599427111e
|
| 3 |
size 11800
|
fp32/teach_T.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:19704d821b5aa1b80fe23e69bf2a11c525c2d7bb52555c35e5f169d335b25c12
|
| 3 |
+
size 2952
|
fp32/teach_b.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5e811bc12447983ffd855f958b4d151b3ba7122677973766283f6ef848e561be
|
| 3 |
+
size 492
|
fp32/v_th.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 11800
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5b954b82958f11c356888b03a1c3f3780f4abcbc7c951645f42c9492db69a7bb
|
| 3 |
size 11800
|
info.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
manifest.json
CHANGED
|
@@ -11,8 +11,29 @@
|
|
| 11 |
"n_out": 50,
|
| 12 |
"e_cl": -0.5,
|
| 13 |
"drive_alpha": 1.0,
|
| 14 |
-
"mode": "
|
| 15 |
-
"nnz":
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
},
|
| 17 |
"variants": {
|
| 18 |
"fp16w32": {
|
|
@@ -49,6 +70,73 @@
|
|
| 49 |
],
|
| 50 |
"bytes": 11800
|
| 51 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
"dec_w": {
|
| 53 |
"file": "fp16/dec_w.bin",
|
| 54 |
"dtype": "float16",
|
|
@@ -126,17 +214,17 @@
|
|
| 126 |
"file": "fp32/W_rowidx.bin",
|
| 127 |
"dtype": "uint16",
|
| 128 |
"shape": [
|
| 129 |
-
|
| 130 |
],
|
| 131 |
-
"bytes":
|
| 132 |
},
|
| 133 |
"W_vals": {
|
| 134 |
"file": "fp32/W_vals.bin",
|
| 135 |
"dtype": "float32",
|
| 136 |
"shape": [
|
| 137 |
-
|
| 138 |
],
|
| 139 |
-
"bytes":
|
| 140 |
}
|
| 141 |
},
|
| 142 |
"fp16": {
|
|
@@ -173,6 +261,73 @@
|
|
| 173 |
],
|
| 174 |
"bytes": 11800
|
| 175 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 176 |
"dec_w": {
|
| 177 |
"file": "fp16/dec_w.bin",
|
| 178 |
"dtype": "float16",
|
|
@@ -250,23 +405,23 @@
|
|
| 250 |
"file": "fp32/W_rowidx.bin",
|
| 251 |
"dtype": "uint16",
|
| 252 |
"shape": [
|
| 253 |
-
|
| 254 |
],
|
| 255 |
-
"bytes":
|
| 256 |
},
|
| 257 |
"W_vals": {
|
| 258 |
"file": "fp16/W_vals.bin",
|
| 259 |
"dtype": "float16",
|
| 260 |
"shape": [
|
| 261 |
-
|
| 262 |
],
|
| 263 |
-
"bytes":
|
| 264 |
}
|
| 265 |
}
|
| 266 |
},
|
| 267 |
"connectome_audit": {
|
| 268 |
"connections": 439500,
|
| 269 |
-
"nonzero_weights":
|
| 270 |
"off_connectome": 0,
|
| 271 |
"wrong_sign": 0,
|
| 272 |
"excitatory": 1873,
|
|
|
|
| 11 |
"n_out": 50,
|
| 12 |
"e_cl": -0.5,
|
| 13 |
"drive_alpha": 1.0,
|
| 14 |
+
"mode": "mech",
|
| 15 |
+
"nnz": 360336,
|
| 16 |
+
"dan_teach": 1.0,
|
| 17 |
+
"lam": 1.0,
|
| 18 |
+
"mech": true,
|
| 19 |
+
"n_gate": 123,
|
| 20 |
+
"fw_edges": 1556,
|
| 21 |
+
"gate_edges": 793,
|
| 22 |
+
"decay": true,
|
| 23 |
+
"gate_label": "dopamine+octopamine+serotonin",
|
| 24 |
+
"gate_types": {
|
| 25 |
+
"dopamine": 22,
|
| 26 |
+
"octopamine": 18,
|
| 27 |
+
"serotonin": 83
|
| 28 |
+
},
|
| 29 |
+
"gate_type_edges": {
|
| 30 |
+
"dopamine": 427,
|
| 31 |
+
"octopamine": 15,
|
| 32 |
+
"serotonin": 351
|
| 33 |
+
},
|
| 34 |
+
"input_label": "ER ring (landmark/visual) + PFN (self-motion via NO) + ExR",
|
| 35 |
+
"output_label": "PFL1/2/3 (steering -> LAL)",
|
| 36 |
+
"region": "CX_all"
|
| 37 |
},
|
| 38 |
"variants": {
|
| 39 |
"fp16w32": {
|
|
|
|
| 70 |
],
|
| 71 |
"bytes": 11800
|
| 72 |
},
|
| 73 |
+
"teach_T": {
|
| 74 |
+
"file": "fp32/teach_T.bin",
|
| 75 |
+
"dtype": "float32",
|
| 76 |
+
"shape": [
|
| 77 |
+
6,
|
| 78 |
+
123
|
| 79 |
+
],
|
| 80 |
+
"bytes": 2952
|
| 81 |
+
},
|
| 82 |
+
"teach_b": {
|
| 83 |
+
"file": "fp32/teach_b.bin",
|
| 84 |
+
"dtype": "float32",
|
| 85 |
+
"shape": [
|
| 86 |
+
123
|
| 87 |
+
],
|
| 88 |
+
"bytes": 492
|
| 89 |
+
},
|
| 90 |
+
"W_gate": {
|
| 91 |
+
"file": "fp32/W_gate.bin",
|
| 92 |
+
"dtype": "float32",
|
| 93 |
+
"shape": [
|
| 94 |
+
50,
|
| 95 |
+
123
|
| 96 |
+
],
|
| 97 |
+
"bytes": 24600
|
| 98 |
+
},
|
| 99 |
+
"W_val": {
|
| 100 |
+
"file": "fp32/W_val.bin",
|
| 101 |
+
"dtype": "float32",
|
| 102 |
+
"shape": [
|
| 103 |
+
50,
|
| 104 |
+
123
|
| 105 |
+
],
|
| 106 |
+
"bytes": 24600
|
| 107 |
+
},
|
| 108 |
+
"gate_idx": {
|
| 109 |
+
"file": "fp32/gate_idx.bin",
|
| 110 |
+
"dtype": "int32",
|
| 111 |
+
"shape": [
|
| 112 |
+
123
|
| 113 |
+
],
|
| 114 |
+
"bytes": 492
|
| 115 |
+
},
|
| 116 |
+
"fw_in": {
|
| 117 |
+
"file": "fp32/fw_in.bin",
|
| 118 |
+
"dtype": "int32",
|
| 119 |
+
"shape": [
|
| 120 |
+
1556
|
| 121 |
+
],
|
| 122 |
+
"bytes": 6224
|
| 123 |
+
},
|
| 124 |
+
"fw_out": {
|
| 125 |
+
"file": "fp32/fw_out.bin",
|
| 126 |
+
"dtype": "int32",
|
| 127 |
+
"shape": [
|
| 128 |
+
1556
|
| 129 |
+
],
|
| 130 |
+
"bytes": 6224
|
| 131 |
+
},
|
| 132 |
+
"gamma": {
|
| 133 |
+
"file": "fp32/gamma.bin",
|
| 134 |
+
"dtype": "float32",
|
| 135 |
+
"shape": [
|
| 136 |
+
50
|
| 137 |
+
],
|
| 138 |
+
"bytes": 200
|
| 139 |
+
},
|
| 140 |
"dec_w": {
|
| 141 |
"file": "fp16/dec_w.bin",
|
| 142 |
"dtype": "float16",
|
|
|
|
| 214 |
"file": "fp32/W_rowidx.bin",
|
| 215 |
"dtype": "uint16",
|
| 216 |
"shape": [
|
| 217 |
+
360336
|
| 218 |
],
|
| 219 |
+
"bytes": 720672
|
| 220 |
},
|
| 221 |
"W_vals": {
|
| 222 |
"file": "fp32/W_vals.bin",
|
| 223 |
"dtype": "float32",
|
| 224 |
"shape": [
|
| 225 |
+
360336
|
| 226 |
],
|
| 227 |
+
"bytes": 1441344
|
| 228 |
}
|
| 229 |
},
|
| 230 |
"fp16": {
|
|
|
|
| 261 |
],
|
| 262 |
"bytes": 11800
|
| 263 |
},
|
| 264 |
+
"teach_T": {
|
| 265 |
+
"file": "fp32/teach_T.bin",
|
| 266 |
+
"dtype": "float32",
|
| 267 |
+
"shape": [
|
| 268 |
+
6,
|
| 269 |
+
123
|
| 270 |
+
],
|
| 271 |
+
"bytes": 2952
|
| 272 |
+
},
|
| 273 |
+
"teach_b": {
|
| 274 |
+
"file": "fp32/teach_b.bin",
|
| 275 |
+
"dtype": "float32",
|
| 276 |
+
"shape": [
|
| 277 |
+
123
|
| 278 |
+
],
|
| 279 |
+
"bytes": 492
|
| 280 |
+
},
|
| 281 |
+
"W_gate": {
|
| 282 |
+
"file": "fp32/W_gate.bin",
|
| 283 |
+
"dtype": "float32",
|
| 284 |
+
"shape": [
|
| 285 |
+
50,
|
| 286 |
+
123
|
| 287 |
+
],
|
| 288 |
+
"bytes": 24600
|
| 289 |
+
},
|
| 290 |
+
"W_val": {
|
| 291 |
+
"file": "fp32/W_val.bin",
|
| 292 |
+
"dtype": "float32",
|
| 293 |
+
"shape": [
|
| 294 |
+
50,
|
| 295 |
+
123
|
| 296 |
+
],
|
| 297 |
+
"bytes": 24600
|
| 298 |
+
},
|
| 299 |
+
"gate_idx": {
|
| 300 |
+
"file": "fp32/gate_idx.bin",
|
| 301 |
+
"dtype": "int32",
|
| 302 |
+
"shape": [
|
| 303 |
+
123
|
| 304 |
+
],
|
| 305 |
+
"bytes": 492
|
| 306 |
+
},
|
| 307 |
+
"fw_in": {
|
| 308 |
+
"file": "fp32/fw_in.bin",
|
| 309 |
+
"dtype": "int32",
|
| 310 |
+
"shape": [
|
| 311 |
+
1556
|
| 312 |
+
],
|
| 313 |
+
"bytes": 6224
|
| 314 |
+
},
|
| 315 |
+
"fw_out": {
|
| 316 |
+
"file": "fp32/fw_out.bin",
|
| 317 |
+
"dtype": "int32",
|
| 318 |
+
"shape": [
|
| 319 |
+
1556
|
| 320 |
+
],
|
| 321 |
+
"bytes": 6224
|
| 322 |
+
},
|
| 323 |
+
"gamma": {
|
| 324 |
+
"file": "fp32/gamma.bin",
|
| 325 |
+
"dtype": "float32",
|
| 326 |
+
"shape": [
|
| 327 |
+
50
|
| 328 |
+
],
|
| 329 |
+
"bytes": 200
|
| 330 |
+
},
|
| 331 |
"dec_w": {
|
| 332 |
"file": "fp16/dec_w.bin",
|
| 333 |
"dtype": "float16",
|
|
|
|
| 405 |
"file": "fp32/W_rowidx.bin",
|
| 406 |
"dtype": "uint16",
|
| 407 |
"shape": [
|
| 408 |
+
360336
|
| 409 |
],
|
| 410 |
+
"bytes": 720672
|
| 411 |
},
|
| 412 |
"W_vals": {
|
| 413 |
"file": "fp16/W_vals.bin",
|
| 414 |
"dtype": "float16",
|
| 415 |
"shape": [
|
| 416 |
+
360336
|
| 417 |
],
|
| 418 |
+
"bytes": 720672
|
| 419 |
}
|
| 420 |
}
|
| 421 |
},
|
| 422 |
"connectome_audit": {
|
| 423 |
"connections": 439500,
|
| 424 |
+
"nonzero_weights": 360336,
|
| 425 |
"off_connectome": 0,
|
| 426 |
"wrong_sign": 0,
|
| 427 |
"excitatory": 1873,
|
selfcheck_fp16.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.
|
|
|
|
| 1 |
+
{"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.3026662766933441,-0.22481447458267212,-0.20093734562397003]},{"ids":[0,1,2],"top1":0,"logits":[2.350318431854248,-3.9179489612579346,-4.813953399658203]},{"ids":[0,1,2],"top1":0,"logits":[3.8600001335144043,-7.494997978210449,-6.629037857055664]},{"ids":[0,1,2],"top1":0,"logits":[4.608853816986084,-12.67160415649414,-7.4519758224487305]},{"ids":[0,1,2],"top1":0,"logits":[4.967690944671631,-14.353910446166992,-8.63898754119873]},{"ids":[0,1,2],"top1":0,"logits":[2.6720259189605713,-11.852953910827637,-6.721469879150391]},{"ids":[0,1,2],"top1":0,"logits":[3.2054336071014404,-12.480395317077637,-7.568173408508301]},{"ids":[0,1,2],"top1":0,"logits":[3.843613862991333,-12.901008605957031,-8.75387191772461]},{"ids":[0,1,2],"top1":0,"logits":[4.664247989654541,-11.042426109313965,-10.909772872924805]},{"ids":[0,1,2],"top1":0,"logits":[5.874533176422119,-10.570650100708008,-12.709486961364746]},{"ids":[0,1,2],"top1":0,"logits":[6.321775436401367,-10.1642427444458,-13.304863929748535]},{"ids":[0,1,2],"top1":0,"logits":[6.6664652824401855,-9.830596923828125,-14.235029220581055]},{"ids":[0,1,2],"top1":0,"logits":[6.812446594238281,-9.598345756530762,-14.748185157775879]},{"ids":[0,1,2],"top1":0,"logits":[6.724730014801025,-10.364381790161133,-14.428290367126465]},{"ids":[0,1,2],"top1":0,"logits":[6.545581817626953,-10.016763687133789,-14.337736129760742]},{"ids":[0,1,2],"top1":0,"logits":[6.437992095947266,-9.82512378692627,-14.27882194519043]}]}
|
selfcheck_fp16w32.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.
|
|
|
|
| 1 |
+
{"obs":[[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0]],"plies":[{"ids":[0,1,2],"top1":0,"logits":[0.3026662766933441,-0.22481447458267212,-0.20093734562397003]},{"ids":[0,1,2],"top1":0,"logits":[2.3503289222717285,-3.917922019958496,-4.813990592956543]},{"ids":[0,1,2],"top1":0,"logits":[3.860015869140625,-7.495028495788574,-6.62905216217041]},{"ids":[0,1,2],"top1":0,"logits":[4.608800888061523,-12.671577453613281,-7.451944351196289]},{"ids":[0,1,2],"top1":0,"logits":[4.967630863189697,-14.353872299194336,-8.638978958129883]},{"ids":[0,1,2],"top1":0,"logits":[2.671954870223999,-11.852911949157715,-6.721457481384277]},{"ids":[0,1,2],"top1":0,"logits":[3.2054200172424316,-12.48039722442627,-7.5682196617126465]},{"ids":[0,1,2],"top1":0,"logits":[3.843602418899536,-12.901015281677246,-8.753922462463379]},{"ids":[0,1,2],"top1":0,"logits":[4.664289474487305,-11.042506217956543,-10.909829139709473]},{"ids":[0,1,2],"top1":0,"logits":[5.87457275390625,-10.570738792419434,-12.709527969360352]},{"ids":[0,1,2],"top1":0,"logits":[6.321731090545654,-10.164267539978027,-13.304828643798828]},{"ids":[0,1,2],"top1":0,"logits":[6.666418552398682,-9.830619812011719,-14.235002517700195]},{"ids":[0,1,2],"top1":0,"logits":[6.81240177154541,-9.598366737365723,-14.748161315917969]},{"ids":[0,1,2],"top1":0,"logits":[6.724684715270996,-10.364402770996094,-14.428264617919922]},{"ids":[0,1,2],"top1":0,"logits":[6.54553747177124,-10.01678466796875,-14.337713241577148]},{"ids":[0,1,2],"top1":0,"logits":[6.437949180603027,-9.82514476776123,-14.278800010681152]}]}
|