monomyth commited on
Commit
e340e6f
·
verified ·
1 Parent(s): 6041afb

Publish retained and experimental MaleCNS controllers with runtime assets and evidence

Browse files
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - robotics
7
+ - connectomics
8
+ - malecns
9
+ - mlx
10
+ - simulation
11
+ - experimental
12
+ model-index:
13
+ - name: fly-brain-codex
14
+ results: []
15
+ ---
16
+ # Fly Brain Codex
17
+
18
+ An experimental controller for a native macOS robot-arm simulator, built using a derived MaleCNS connectome. **MaleCNS is an anatomical wiring map, not a pretrained robot policy.** This release includes our learned parameters, derived sparse graph assets, frozen training features/targets, and historical evaluation records.
19
+
20
+ [Source, setup and demo](https://github.com/monomyth/fly-brain-codex) · [Simulator branch](https://github.com/monomyth/rebot-motion-lab/tree/fly-brain-codex)
21
+
22
+ ## Choose a profile
23
+
24
+ | Artifact | What it contains | Measured status |
25
+ |---|---|---|
26
+ | `stable.tar.gz` | Retained `retain-grasp-20260911` UI controller | 19/20 pickup-and-hold trials in X343–357, Y−10–8 mm; separate real UI pickup/hold/drop checks passed |
27
+ | `experimental.tar.gz` | Newer `touch-direct-20260912`, using bilateral finger contact to select pickup/holding parameter banks | 12/15 full tasks completed; 20 planned, 5 unrun. Not qualified for default UI deployment |
28
+ | `cuda-continuation.tar.gz` | Latest 12,000-iteration RTX 4090 continuation fit, parameters and fit metrics | Not imported into the deployed controller; no native closed-loop evaluation |
29
+ | `runtime-assets.tar.gz` | Shared prepared graph, sensory/motor/feedback circuits and brain-overlay geometry | Shared once by both profiles |
30
+
31
+ “Stable” identifies the retained UI baseline, not production-grade reliability. The validated task uses a **20 mm cube and a folded start**. Broad arbitrary placement and other cube sizes are not established. Historical results do not guarantee the same rate on another machine.
32
+
33
+ ## Run
34
+
35
+ Clone the [source repository](https://github.com/monomyth/fly-brain-codex), follow its macOS simulator build instructions, then run:
36
+
37
+ ```sh
38
+ python3 scripts/download_model.py
39
+ .venv/bin/python scripts/run_mlx_ui.py --check-deployment
40
+ ```
41
+
42
+ The downloader pins this Hub release by commit and SHA-256 in the source repository, verifies the archives, preserves differing existing assets, and writes only project-local `data/` and a local runtime configuration. No Hub login is needed for a public download. `--profile experimental` downloads the research controller without activating it.
43
+
44
+ `training-bundle.tar.gz` additionally contains the compact, versioned frozen-feature continuation experiment and its matching trainer; see the source repository training guide. It does not contain the full historical RGB dataset.
45
+
46
+ ## What controls the arm
47
+
48
+ Front and wrist-mounted RGB renders are converted to luminance and mapped to annotated retinal neurons. Joint, aperture and contact feedback drive an engineered sensory encoding. A fixed persistent sensory graph runs on MLX/Metal; a constrained learned motor head runs on CPU and produces six joint targets plus gripper aperture at a nominal 2 Hz. Cube coordinates and inverse kinematics are used by teachers/evaluation, not by the actor's action selection.
49
+
50
+ Training uses demonstration supervision and task-space objectives, with PyTorch MPS/CUDA optimization of selected existing signed connections and response offsets. It is not a validated biological learning simulation. A fixed dopamine multiplier in offline training is not demonstrated reward-driven fly learning. The touch-bank selector is engineered.
51
+
52
+ After a qualifying hold (at least 100 mm clearance, at most 5° tilt for five seconds), a **scripted completion routine opens the gripper and verifies the floor landing**. Release is not a learned neural action. RealityKit, native actuators, floor limiting, camera projection, and the fly-to-robot mapping are engineered components.
53
+
54
+ ## Reuse and provenance
55
+
56
+ Numerical arrays in the packaged checkpoints are byte-identical to their tested source versions. JSON provenance paths were normalized; `relocation.json` records before/after hashes. The installer preserves original historical evidence and rebases checkpoint addresses and metadata hashes in separate local copies. This is relocation verification, not a new simulator or hardware qualification. Backend parity was measured on Apple M2 Max with MLX 0.32.2.
57
+
58
+ The bundles contain frozen features/targets, not the entire historical RGB observation corpus. Raw MaleCNS download tables are not duplicated here. Download/rebuild commands and research scripts live in the source repository.
59
+
60
+ ## Attribution and license
61
+
62
+ Derived assets and published model artifacts: **CC BY 4.0**. Source code: MIT in the GitHub repository. MaleCNS work is by FlyEM at HHMI Janelia, University of Cambridge, MRC Laboratory of Molecular Biology, Google Research, and collaborators. Preserve the bundled `ATTRIBUTION.md` files.
63
+
64
+ Source: [MaleCNS downloads and attribution](https://male-cns.janelia.org/download/). This independent experiment is not an official MaleCNS, Google, Janelia, Orbbec, or ReBot release, and does not establish biological fidelity or physical-robot safety.
cuda-continuation.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d84d6d0aaab5c86aea1f1fa64cdde403e68e6dba4a569a794731749e22705f1e
3
+ size 165653
experimental.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57753366298efe52fca783f5253adf42b7285513547e6edd446b47765bf85867
3
+ size 8386965
release.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema": "fly-brain-hub-release-v1",
3
+ "version": "2026-09-12",
4
+ "repo": "monomyth/fly-brain-codex",
5
+ "license": "cc-by-4.0",
6
+ "source": "https://github.com/monomyth/fly-brain-codex",
7
+ "assets": {
8
+ "file": "runtime-assets.tar.gz",
9
+ "bytes": 348116008,
10
+ "sha256": "53fab941dce55d0dba3272f009eb88e63bff4251eda7a4f7ba943073ff29cfa9"
11
+ },
12
+ "profiles": {
13
+ "stable": {
14
+ "file": "stable.tar.gz",
15
+ "bytes": 6318603,
16
+ "sha256": "5cad89ef00ea4ce8d7368ca4b85c0b63ec7f77fc6be278c01c3447a4b3b47406",
17
+ "checkpoint_name": "retain-grasp-20260911",
18
+ "model_sha256": "734357c21c1d5d01c99a0f4decb9649ec0cc89f540e3adbb70f0377b6948e79b",
19
+ "manifest_sha256": "396ce273b323fbe97750964fc56c1423e5fb8c90766a00cff2f4606da24f4fe1",
20
+ "status": "19/20 pickup and hold in a narrow region; separate UI drop check passed"
21
+ },
22
+ "experimental": {
23
+ "file": "experimental.tar.gz",
24
+ "bytes": 8386965,
25
+ "sha256": "57753366298efe52fca783f5253adf42b7285513547e6edd446b47765bf85867",
26
+ "checkpoint_name": "touch-direct-20260912",
27
+ "model_sha256": "2bbaa3af747995982ca5602045334719324bdef24296a0a99a79f4ac77e876d8",
28
+ "manifest_sha256": "b45b2be105394c5d839bff0df554c9fe6f15862fd3bc8a51aaa8f26d73664d0b",
29
+ "status": "12/15 complete tasks; 5 planned trials unrun; not UI qualified"
30
+ }
31
+ },
32
+ "unqualified_cuda_continuation": {
33
+ "file": "cuda-continuation.tar.gz",
34
+ "bytes": 165653,
35
+ "sha256": "d84d6d0aaab5c86aea1f1fa64cdde403e68e6dba4a569a794731749e22705f1e"
36
+ },
37
+ "training_bundle": {
38
+ "file": "training-bundle.tar.gz",
39
+ "bytes": 8430820,
40
+ "sha256": "e34d097b6f9064f895aed1d1d46ae0e2170f8a26a3bbe867688a8e7e588c787b"
41
+ }
42
+ }
runtime-assets.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53fab941dce55d0dba3272f009eb88e63bff4251eda7a4f7ba943073ff29cfa9
3
+ size 348116008
stable.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cad89ef00ea4ce8d7368ca4b85c0b63ec7f77fc6be278c01c3447a4b3b47406
3
+ size 6318603
training-bundle.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e34d097b6f9064f895aed1d1d46ae0e2170f8a26a3bbe867688a8e7e588c787b
3
+ size 8430820