Instructions to use monomyth/fly-brain-codex with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use monomyth/fly-brain-codex with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download monomyth/fly-brain-codex --local-dir fly-brain-codex
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Publish retained and experimental MaleCNS controllers with runtime assets and evidence
Browse files- README.md +64 -0
- cuda-continuation.tar.gz +3 -0
- experimental.tar.gz +3 -0
- release.json +42 -0
- runtime-assets.tar.gz +3 -0
- stable.tar.gz +3 -0
- training-bundle.tar.gz +3 -0
README.md
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-4.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
tags:
|
| 6 |
+
- robotics
|
| 7 |
+
- connectomics
|
| 8 |
+
- malecns
|
| 9 |
+
- mlx
|
| 10 |
+
- simulation
|
| 11 |
+
- experimental
|
| 12 |
+
model-index:
|
| 13 |
+
- name: fly-brain-codex
|
| 14 |
+
results: []
|
| 15 |
+
---
|
| 16 |
+
# Fly Brain Codex
|
| 17 |
+
|
| 18 |
+
An experimental controller for a native macOS robot-arm simulator, built using a derived MaleCNS connectome. **MaleCNS is an anatomical wiring map, not a pretrained robot policy.** This release includes our learned parameters, derived sparse graph assets, frozen training features/targets, and historical evaluation records.
|
| 19 |
+
|
| 20 |
+
[Source, setup and demo](https://github.com/monomyth/fly-brain-codex) · [Simulator branch](https://github.com/monomyth/rebot-motion-lab/tree/fly-brain-codex)
|
| 21 |
+
|
| 22 |
+
## Choose a profile
|
| 23 |
+
|
| 24 |
+
| Artifact | What it contains | Measured status |
|
| 25 |
+
|---|---|---|
|
| 26 |
+
| `stable.tar.gz` | Retained `retain-grasp-20260911` UI controller | 19/20 pickup-and-hold trials in X343–357, Y−10–8 mm; separate real UI pickup/hold/drop checks passed |
|
| 27 |
+
| `experimental.tar.gz` | Newer `touch-direct-20260912`, using bilateral finger contact to select pickup/holding parameter banks | 12/15 full tasks completed; 20 planned, 5 unrun. Not qualified for default UI deployment |
|
| 28 |
+
| `cuda-continuation.tar.gz` | Latest 12,000-iteration RTX 4090 continuation fit, parameters and fit metrics | Not imported into the deployed controller; no native closed-loop evaluation |
|
| 29 |
+
| `runtime-assets.tar.gz` | Shared prepared graph, sensory/motor/feedback circuits and brain-overlay geometry | Shared once by both profiles |
|
| 30 |
+
|
| 31 |
+
“Stable” identifies the retained UI baseline, not production-grade reliability. The validated task uses a **20 mm cube and a folded start**. Broad arbitrary placement and other cube sizes are not established. Historical results do not guarantee the same rate on another machine.
|
| 32 |
+
|
| 33 |
+
## Run
|
| 34 |
+
|
| 35 |
+
Clone the [source repository](https://github.com/monomyth/fly-brain-codex), follow its macOS simulator build instructions, then run:
|
| 36 |
+
|
| 37 |
+
```sh
|
| 38 |
+
python3 scripts/download_model.py
|
| 39 |
+
.venv/bin/python scripts/run_mlx_ui.py --check-deployment
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
The downloader pins this Hub release by commit and SHA-256 in the source repository, verifies the archives, preserves differing existing assets, and writes only project-local `data/` and a local runtime configuration. No Hub login is needed for a public download. `--profile experimental` downloads the research controller without activating it.
|
| 43 |
+
|
| 44 |
+
`training-bundle.tar.gz` additionally contains the compact, versioned frozen-feature continuation experiment and its matching trainer; see the source repository training guide. It does not contain the full historical RGB dataset.
|
| 45 |
+
|
| 46 |
+
## What controls the arm
|
| 47 |
+
|
| 48 |
+
Front and wrist-mounted RGB renders are converted to luminance and mapped to annotated retinal neurons. Joint, aperture and contact feedback drive an engineered sensory encoding. A fixed persistent sensory graph runs on MLX/Metal; a constrained learned motor head runs on CPU and produces six joint targets plus gripper aperture at a nominal 2 Hz. Cube coordinates and inverse kinematics are used by teachers/evaluation, not by the actor's action selection.
|
| 49 |
+
|
| 50 |
+
Training uses demonstration supervision and task-space objectives, with PyTorch MPS/CUDA optimization of selected existing signed connections and response offsets. It is not a validated biological learning simulation. A fixed dopamine multiplier in offline training is not demonstrated reward-driven fly learning. The touch-bank selector is engineered.
|
| 51 |
+
|
| 52 |
+
After a qualifying hold (at least 100 mm clearance, at most 5° tilt for five seconds), a **scripted completion routine opens the gripper and verifies the floor landing**. Release is not a learned neural action. RealityKit, native actuators, floor limiting, camera projection, and the fly-to-robot mapping are engineered components.
|
| 53 |
+
|
| 54 |
+
## Reuse and provenance
|
| 55 |
+
|
| 56 |
+
Numerical arrays in the packaged checkpoints are byte-identical to their tested source versions. JSON provenance paths were normalized; `relocation.json` records before/after hashes. The installer preserves original historical evidence and rebases checkpoint addresses and metadata hashes in separate local copies. This is relocation verification, not a new simulator or hardware qualification. Backend parity was measured on Apple M2 Max with MLX 0.32.2.
|
| 57 |
+
|
| 58 |
+
The bundles contain frozen features/targets, not the entire historical RGB observation corpus. Raw MaleCNS download tables are not duplicated here. Download/rebuild commands and research scripts live in the source repository.
|
| 59 |
+
|
| 60 |
+
## Attribution and license
|
| 61 |
+
|
| 62 |
+
Derived assets and published model artifacts: **CC BY 4.0**. Source code: MIT in the GitHub repository. MaleCNS work is by FlyEM at HHMI Janelia, University of Cambridge, MRC Laboratory of Molecular Biology, Google Research, and collaborators. Preserve the bundled `ATTRIBUTION.md` files.
|
| 63 |
+
|
| 64 |
+
Source: [MaleCNS downloads and attribution](https://male-cns.janelia.org/download/). This independent experiment is not an official MaleCNS, Google, Janelia, Orbbec, or ReBot release, and does not establish biological fidelity or physical-robot safety.
|
cuda-continuation.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d84d6d0aaab5c86aea1f1fa64cdde403e68e6dba4a569a794731749e22705f1e
|
| 3 |
+
size 165653
|
experimental.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:57753366298efe52fca783f5253adf42b7285513547e6edd446b47765bf85867
|
| 3 |
+
size 8386965
|
release.json
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema": "fly-brain-hub-release-v1",
|
| 3 |
+
"version": "2026-09-12",
|
| 4 |
+
"repo": "monomyth/fly-brain-codex",
|
| 5 |
+
"license": "cc-by-4.0",
|
| 6 |
+
"source": "https://github.com/monomyth/fly-brain-codex",
|
| 7 |
+
"assets": {
|
| 8 |
+
"file": "runtime-assets.tar.gz",
|
| 9 |
+
"bytes": 348116008,
|
| 10 |
+
"sha256": "53fab941dce55d0dba3272f009eb88e63bff4251eda7a4f7ba943073ff29cfa9"
|
| 11 |
+
},
|
| 12 |
+
"profiles": {
|
| 13 |
+
"stable": {
|
| 14 |
+
"file": "stable.tar.gz",
|
| 15 |
+
"bytes": 6318603,
|
| 16 |
+
"sha256": "5cad89ef00ea4ce8d7368ca4b85c0b63ec7f77fc6be278c01c3447a4b3b47406",
|
| 17 |
+
"checkpoint_name": "retain-grasp-20260911",
|
| 18 |
+
"model_sha256": "734357c21c1d5d01c99a0f4decb9649ec0cc89f540e3adbb70f0377b6948e79b",
|
| 19 |
+
"manifest_sha256": "396ce273b323fbe97750964fc56c1423e5fb8c90766a00cff2f4606da24f4fe1",
|
| 20 |
+
"status": "19/20 pickup and hold in a narrow region; separate UI drop check passed"
|
| 21 |
+
},
|
| 22 |
+
"experimental": {
|
| 23 |
+
"file": "experimental.tar.gz",
|
| 24 |
+
"bytes": 8386965,
|
| 25 |
+
"sha256": "57753366298efe52fca783f5253adf42b7285513547e6edd446b47765bf85867",
|
| 26 |
+
"checkpoint_name": "touch-direct-20260912",
|
| 27 |
+
"model_sha256": "2bbaa3af747995982ca5602045334719324bdef24296a0a99a79f4ac77e876d8",
|
| 28 |
+
"manifest_sha256": "b45b2be105394c5d839bff0df554c9fe6f15862fd3bc8a51aaa8f26d73664d0b",
|
| 29 |
+
"status": "12/15 complete tasks; 5 planned trials unrun; not UI qualified"
|
| 30 |
+
}
|
| 31 |
+
},
|
| 32 |
+
"unqualified_cuda_continuation": {
|
| 33 |
+
"file": "cuda-continuation.tar.gz",
|
| 34 |
+
"bytes": 165653,
|
| 35 |
+
"sha256": "d84d6d0aaab5c86aea1f1fa64cdde403e68e6dba4a569a794731749e22705f1e"
|
| 36 |
+
},
|
| 37 |
+
"training_bundle": {
|
| 38 |
+
"file": "training-bundle.tar.gz",
|
| 39 |
+
"bytes": 8430820,
|
| 40 |
+
"sha256": "e34d097b6f9064f895aed1d1d46ae0e2170f8a26a3bbe867688a8e7e588c787b"
|
| 41 |
+
}
|
| 42 |
+
}
|
runtime-assets.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:53fab941dce55d0dba3272f009eb88e63bff4251eda7a4f7ba943073ff29cfa9
|
| 3 |
+
size 348116008
|
stable.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5cad89ef00ea4ce8d7368ca4b85c0b63ec7f77fc6be278c01c3447a4b3b47406
|
| 3 |
+
size 6318603
|
training-bundle.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e34d097b6f9064f895aed1d1d46ae0e2170f8a26a3bbe867688a8e7e588c787b
|
| 3 |
+
size 8430820
|