anicka commited on
Commit
1dd13cc
·
verified ·
1 Parent(s): 044c7f7

Update Project Mochi checkpoint model card

Browse files
Files changed (1) hide show
  1. README.md +83 -0
README.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - artificial-life
4
+ - embodied-ai
5
+ - mechanistic-interpretability
6
+ - babyllm
7
+ - pytorch
8
+ library_name: transformers
9
+ ---
10
+
11
+ # Project Mochi — published bridge checkpoints
12
+
13
+ This repository contains **small Project Mochi bridge checkpoints**, not standalone language models.
14
+
15
+ A Mochling combines a frozen BabyLM ancestor with learned sensorimotor projection layers, action heads, a target-pointer head, episodic-memory projection, caretaker perception, and working interaction state. The bridge checkpoints here are intended to be loaded by the Project Mochi codebase.
16
+
17
+ ## Upstream ancestor
18
+
19
+ Current published bridges target:
20
+
21
+ `qyxu1994/instanton-childes-heavy`
22
+
23
+ The ancestral Transformer remains frozen during Project Mochi bridge training.
24
+
25
+ ## Published artifacts
26
+
27
+ | Checkpoint | File | SHA-256 | Meaning |
28
+ |---|---|---|---|
29
+ | MVP-0.7b | `childes_mvp07b_bridge.pt` | `e23ea741d66170298dd16b78b823ceb9006311622d83a22d7364156d1d621235` | Working interaction state + episodic-memory sensorimotor bridge |
30
+ | MVP-0.10 | `childes_mvp010_bridge.pt` | `768e476750af3b449ab6739a9801883f29f66532535b6f8ccc9c1c7fc59cb922` | Caretaker embodiment + PUSH + language-conditioned motor control |
31
+
32
+ Not every experimental run is published. The policy is to publish checkpoints at scientifically meaningful milestone boundaries.
33
+
34
+ ## Usage
35
+
36
+ The preferred path is through the Project Mochi launcher:
37
+
38
+ ```bash
39
+ pip install -e .
40
+ mochi-terrarium
41
+ ```
42
+
43
+ If the requested named checkpoint is not available locally, the launcher fetches the exact artifact from this repository and records a local SHA-256 provenance sidecar.
44
+
45
+ Explicit fetch:
46
+
47
+ ```bash
48
+ python3 scripts/fetch_checkpoint.py --checkpoint-id mvp-0.10
49
+ ```
50
+
51
+ Project source:
52
+
53
+ `https://github.com/anicka-net/mochlings`
54
+
55
+ ## Scientific scope
56
+
57
+ ### MVP-0.10 language result
58
+
59
+ MVP-0.10 includes supervised **language-conditioned motor grounding**: matched referential text such as colour words causally shifts the physical target-pointer distribution in held-out synthetic evaluations.
60
+
61
+ It does **not** yet include a supervised next-token speech objective. The current speech-generation path is an experimental ancestral BabyLM generation conditioned on grounded sensory prefixes and dialogue context. It should not be interpreted as a separately trained grounded speech policy.
62
+
63
+ ### Caretaker embodiment
64
+
65
+ The caretaker is represented by an explicit structured percept rather than a hidden target override. Pointing, touch, and holding can enter the neural prefix as observable interaction signals.
66
+
67
+ ## Architecture / provenance
68
+
69
+ The checkpoints contain Project Mochi bridge parameters only. They do **not** vendor the ~27M ancestral model weights.
70
+
71
+ See the source repository for:
72
+
73
+ - milestone reports and quantitative evaluation;
74
+ - architecture and perception-boundary invariants;
75
+ - checkpoint loader implementation;
76
+ - exact training curricula;
77
+ - third-party licence and dataset-provenance notes.
78
+
79
+ ## Licensing and upstream-data note
80
+
81
+ Project Mochi source code and the upstream Instanton model code/weights are documented as MIT-licensed in the project provenance notes. However, the BabyLM training mixture includes upstream corpora with heterogeneous terms, including research/non-commercial restrictions. Do not assume the ancestral training corpus is commercially unencumbered or redistributable.
82
+
83
+ See `docs/licensing_third_party.md` in the Project Mochi source repository for the current provenance statement.