docs: mark superseded and point at the canonical repo
Browse files
README.md
CHANGED
|
@@ -1,32 +1,41 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
tags:
|
| 4 |
-
--
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
-
|
| 25 |
-
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- from-scratch
|
| 5 |
+
- opcode
|
| 6 |
+
- ternary
|
| 7 |
+
- trit
|
| 8 |
+
- execution-verified
|
| 9 |
+
- tiny
|
| 10 |
+
- superseded
|
| 11 |
+
---
|
| 12 |
+
<!-- scbe-status -->
|
| 13 |
+
> **Status: superseded.** Canonical coding model: [scbe-coding-agent-vtc-qwen15-v1-gguf](https://hf.co/issdandavis/scbe-coding-agent-vtc-qwen15-v1-gguf). Kept as research history.
|
| 14 |
+
|
| 15 |
+
# Binary-Trit Coder (Clay's opcode model)
|
| 16 |
+
|
| 17 |
+
A **from-scratch, 3.17M-param causal transformer** trained from *random init* on Issac's own opcode
|
| 18 |
+
substrate — a bijective ternary ("trit") op grammar: `join (+)`, `take (−)`, `weave (×)` over digit leaves,
|
| 19 |
+
prefix-notation, depth-2. No pretraining, no outside corpus.
|
| 20 |
+
|
| 21 |
+
## Honest benchmark — its OWN domain, not Python
|
| 22 |
+
The metric is **execution-verify rate**: sample a program, *run it for real*, check the model's answer.
|
| 23 |
+
| Test | Score |
|
| 24 |
+
|---|---|
|
| 25 |
+
| in-distribution (depth-2, fresh) | **98.6%** |
|
| 26 |
+
| OOD generalization (depth-3, never trained) | 47.0% |
|
| 27 |
+
|
| 28 |
+
**This is NOT a Python code-gen model.** It has an 18-token opcode vocab; it will score ~0 on
|
| 29 |
+
LiveCodeBench/SciCode (wrong domain). Its "learn from doing" signal is the verify-rate above.
|
| 30 |
+
|
| 31 |
+
## The chrysalis (capability layers, all execution-verified)
|
| 32 |
+
- variables/let-bindings (69.5% end-to-end; 100% with a calculator + show-work)
|
| 33 |
+
- ping-pong φ-lattice solver — recovers a hidden intermediate 100%
|
| 34 |
+
- calc-offload, dark-space inference, combustion candidate-spark
|
| 35 |
+
|
| 36 |
+
## Files
|
| 37 |
+
`scratch_coder.pt` (weights + vocab), `config.json`. Architecture + inference in
|
| 38 |
+
[github.com/issdandavis/loom](https://github.com/issdandavis/loom) `scratch_coder.py`.
|
| 39 |
+
|
| 40 |
+
*Thesis: coding is finite + bijective + execution-verifiable, so a small model from random init can MASTER
|
| 41 |
+
the mapping — proven here at 98.6%.*
|