Update Project Mochi checkpoint model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,83 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- artificial-life
|
| 4 |
+
- embodied-ai
|
| 5 |
+
- mechanistic-interpretability
|
| 6 |
+
- babyllm
|
| 7 |
+
- pytorch
|
| 8 |
+
library_name: transformers
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Project Mochi — published bridge checkpoints
|
| 12 |
+
|
| 13 |
+
This repository contains **small Project Mochi bridge checkpoints**, not standalone language models.
|
| 14 |
+
|
| 15 |
+
A Mochling combines a frozen BabyLM ancestor with learned sensorimotor projection layers, action heads, a target-pointer head, episodic-memory projection, caretaker perception, and working interaction state. The bridge checkpoints here are intended to be loaded by the Project Mochi codebase.
|
| 16 |
+
|
| 17 |
+
## Upstream ancestor
|
| 18 |
+
|
| 19 |
+
Current published bridges target:
|
| 20 |
+
|
| 21 |
+
`qyxu1994/instanton-childes-heavy`
|
| 22 |
+
|
| 23 |
+
The ancestral Transformer remains frozen during Project Mochi bridge training.
|
| 24 |
+
|
| 25 |
+
## Published artifacts
|
| 26 |
+
|
| 27 |
+
| Checkpoint | File | SHA-256 | Meaning |
|
| 28 |
+
|---|---|---|---|
|
| 29 |
+
| MVP-0.7b | `childes_mvp07b_bridge.pt` | `e23ea741d66170298dd16b78b823ceb9006311622d83a22d7364156d1d621235` | Working interaction state + episodic-memory sensorimotor bridge |
|
| 30 |
+
| MVP-0.10 | `childes_mvp010_bridge.pt` | `768e476750af3b449ab6739a9801883f29f66532535b6f8ccc9c1c7fc59cb922` | Caretaker embodiment + PUSH + language-conditioned motor control |
|
| 31 |
+
|
| 32 |
+
Not every experimental run is published. The policy is to publish checkpoints at scientifically meaningful milestone boundaries.
|
| 33 |
+
|
| 34 |
+
## Usage
|
| 35 |
+
|
| 36 |
+
The preferred path is through the Project Mochi launcher:
|
| 37 |
+
|
| 38 |
+
```bash
|
| 39 |
+
pip install -e .
|
| 40 |
+
mochi-terrarium
|
| 41 |
+
```
|
| 42 |
+
|
| 43 |
+
If the requested named checkpoint is not available locally, the launcher fetches the exact artifact from this repository and records a local SHA-256 provenance sidecar.
|
| 44 |
+
|
| 45 |
+
Explicit fetch:
|
| 46 |
+
|
| 47 |
+
```bash
|
| 48 |
+
python3 scripts/fetch_checkpoint.py --checkpoint-id mvp-0.10
|
| 49 |
+
```
|
| 50 |
+
|
| 51 |
+
Project source:
|
| 52 |
+
|
| 53 |
+
`https://github.com/anicka-net/mochlings`
|
| 54 |
+
|
| 55 |
+
## Scientific scope
|
| 56 |
+
|
| 57 |
+
### MVP-0.10 language result
|
| 58 |
+
|
| 59 |
+
MVP-0.10 includes supervised **language-conditioned motor grounding**: matched referential text such as colour words causally shifts the physical target-pointer distribution in held-out synthetic evaluations.
|
| 60 |
+
|
| 61 |
+
It does **not** yet include a supervised next-token speech objective. The current speech-generation path is an experimental ancestral BabyLM generation conditioned on grounded sensory prefixes and dialogue context. It should not be interpreted as a separately trained grounded speech policy.
|
| 62 |
+
|
| 63 |
+
### Caretaker embodiment
|
| 64 |
+
|
| 65 |
+
The caretaker is represented by an explicit structured percept rather than a hidden target override. Pointing, touch, and holding can enter the neural prefix as observable interaction signals.
|
| 66 |
+
|
| 67 |
+
## Architecture / provenance
|
| 68 |
+
|
| 69 |
+
The checkpoints contain Project Mochi bridge parameters only. They do **not** vendor the ~27M ancestral model weights.
|
| 70 |
+
|
| 71 |
+
See the source repository for:
|
| 72 |
+
|
| 73 |
+
- milestone reports and quantitative evaluation;
|
| 74 |
+
- architecture and perception-boundary invariants;
|
| 75 |
+
- checkpoint loader implementation;
|
| 76 |
+
- exact training curricula;
|
| 77 |
+
- third-party licence and dataset-provenance notes.
|
| 78 |
+
|
| 79 |
+
## Licensing and upstream-data note
|
| 80 |
+
|
| 81 |
+
Project Mochi source code and the upstream Instanton model code/weights are documented as MIT-licensed in the project provenance notes. However, the BabyLM training mixture includes upstream corpora with heterogeneous terms, including research/non-commercial restrictions. Do not assume the ancestral training corpus is commercially unencumbered or redistributable.
|
| 82 |
+
|
| 83 |
+
See `docs/licensing_third_party.md` in the Project Mochi source repository for the current provenance statement.
|