ehartford commited on
Commit
6330780
·
verified ·
1 Parent(s): 10f8f4d

Model card: lead with fly-llm-hf and the high-level differences

Browse files
Files changed (1) hide show
  1. README.md +20 -4
README.md CHANGED
@@ -10,6 +10,24 @@ The **MaleCNS v1.0** connectome, the complete wiring diagram of an adult male *D
10
  nervous system (brain, optic lobes, and ventral nerve cord), packaged as Hugging Face `safetensors` so it loads as
11
  PyTorch tensors with `AutoModel.from_pretrained(..., trust_remote_code=True)`.
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  > **A lossless packaging of the MaleCNS connectivity tables. It imposes no neuron model, no neurotransmitter sign
14
  > convention, no normalization, no rounding, no initialization, and no language-model architecture.**
15
 
@@ -32,11 +50,9 @@ weights (sign, scale, normalization, random re-initialization) is a downstream m
32
  The release also ships a traced-only connectivity file. It is not packaged separately because it is exactly this table
33
  restricted to bodies with `status == Traced`; the build script checks that equality edge by edge.
34
 
35
- ## How this differs from `ngxson/fly-llm-hf`
36
 
37
- MaleCNS is already on the Hub in [ngxson/fly-llm-hf](https://huggingface.co/ngxson/fly-llm-hf), so this is not the
38
- first packaging. It is a different layer of the stack: that repository is a **derived language model**; this one is
39
- the **source connectome**, unmodified. Facts about fly-llm-hf below are taken from its model card.
40
 
41
  | | this repository | `ngxson/fly-llm-hf` |
42
  |---|---|---|
 
10
  nervous system (brain, optic lobes, and ventral nerve cord), packaged as Hugging Face `safetensors` so it loads as
11
  PyTorch tensors with `AutoModel.from_pretrained(..., trust_remote_code=True)`.
12
 
13
+ **Why this exists.** MaleCNS reached the Hub through [ngxson/fly-llm-hf](https://huggingface.co/ngxson/fly-llm-hf),
14
+ a fun demonstration that the fly's central brain can serve as a frozen echo-state reservoir for a TinyStories language
15
+ model. That repository is a *model*: it keeps 49,393 central-brain neurons, assigns each synapse a sign from the
16
+ presynaptic neuron's predicted neurotransmitter, rescales the whole matrix to a spectral radius of 0.99, and trains
17
+ projections, per-neuron gains, and a readout around it. Those are good modeling decisions for that project, but
18
+ they are baked into its weights, so anyone who wants the connectome for something else has to undo them or go back
19
+ to the raw release. This repository is the layer underneath: the **source connectome, unmodified**, so that
20
+ fly-llm-hf, [FlyGPT](https://github.com/QuixiAI/FlyGPT), graph-ML work, and simulations can all start from the same
21
+ lossless tensors. At a high level the differences are:
22
+
23
+ - **Whole nervous system, not a subset.** Every body in the release's connectivity file: brain, optic lobes, and
24
+ ventral nerve cord, with subsets available as masks rather than chosen for you.
25
+ - **Raw anatomical counts, not neural weights.** `synapse_count` is the release's `weight` column, untouched: no
26
+ sign convention, no spectral rescaling, no normalization, no bf16 rounding, no random initialization.
27
+ - **Neurotransmitter predictions kept separate.** Mirrored as their own tensors so a sign convention is something
28
+ you apply, not something you inherit.
29
+ - **Verified lossless.** The build reloads the saved tensors and checks them against the release table edge by edge.
30
+
31
  > **A lossless packaging of the MaleCNS connectivity tables. It imposes no neuron model, no neurotransmitter sign
32
  > convention, no normalization, no rounding, no initialization, and no language-model architecture.**
33
 
 
50
  The release also ships a traced-only connectivity file. It is not packaged separately because it is exactly this table
51
  restricted to bodies with `status == Traced`; the build script checks that equality edge by edge.
52
 
53
+ ## Side by side with `ngxson/fly-llm-hf`
54
 
55
+ Facts about fly-llm-hf are taken from its model card.
 
 
56
 
57
  | | this repository | `ngxson/fly-llm-hf` |
58
  |---|---|---|