jgalego commited on
Commit
4c47ec4
·
verified ·
1 Parent(s): 27e4c47

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. .gitattributes +1 -0
  2. README.md +4 -4
  3. assets/call.gif +3 -0
  4. assets/call.png +0 -0
  5. assets/conversation.png +0 -0
.gitattributes CHANGED
@@ -35,3 +35,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
  tokenizer_config.json filter=lfs diff=lfs merge=lfs -text
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
  tokenizer_config.json filter=lfs diff=lfs merge=lfs -text
38
+ assets/call.gif filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -24,7 +24,7 @@ It ports [Qwenputer](https://github.com/divagr18/qwenputer) (the same machine in
24
 
25
  ## How it works
26
 
27
-
28
 
29
  - **The machine.** 256 KB of code ROM, 128 KB of read-only data and 32 KB of RAM, all held in the Gated DeltaNet layers' recurrent state; about 1.2 trace tokens per instruction. The firmware is a bignum calculator: `+ - * / // % **` and `gcd` on integers of up to 62 digits, exact fractions and decimals.
30
  - **The bridge.** The text OLMo writes inside `<function_calls>…</function_calls>` is copied into a buffer the firmware reads. At `</function_calls>` the circuit takes over: it runs the call and writes the environment turn, `<|im_end|>\n<|im_start|>environment\n…<|im_end|>\n<|im_start|>assistant\n`, then hands the stream back to OLMo.
@@ -35,9 +35,9 @@ It ports [Qwenputer](https://github.com/divagr18/qwenputer) (the same machine in
35
 
36
  ### A calc call
37
 
 
38
 
39
-
40
-
41
 
42
  ### Inside the chip layers
43
 
@@ -70,7 +70,7 @@ Each trace token runs once through the 11 chip layers. Their Gated DeltaNet head
70
 
71
  **Conversations.** OLMo answers questions with the calc tool; every circuit token is checked against the reference as it is generated, and the whole stream is then replayed through the circuit.
72
 
73
- Pending.
74
 
75
  ## Usage
76
 
 
24
 
25
  ## How it works
26
 
27
+ ![A calc call played out: OLMo writes the call, the CPU runs it, the result comes back as OLMo's own tokens](assets/call.gif)
28
 
29
  - **The machine.** 256 KB of code ROM, 128 KB of read-only data and 32 KB of RAM, all held in the Gated DeltaNet layers' recurrent state; about 1.2 trace tokens per instruction. The firmware is a bignum calculator: `+ - * / // % **` and `gcd` on integers of up to 62 digits, exact fractions and decimals.
30
  - **The bridge.** The text OLMo writes inside `<function_calls>…</function_calls>` is copied into a buffer the firmware reads. At `</function_calls>` the circuit takes over: it runs the call and writes the environment turn, `<|im_end|>\n<|im_start|>environment\n…<|im_end|>\n<|im_start|>assistant\n`, then hands the stream back to OLMo.
 
35
 
36
  ### A calc call
37
 
38
+ ![One calc call in four steps: the call, the hidden trace, the echo, the value](assets/call.png)
39
 
40
+ ![One conversation, each token filled by who wrote it](assets/conversation.png)
 
41
 
42
  ### Inside the chip layers
43
 
 
70
 
71
  **Conversations.** OLMo answers questions with the calc tool; every circuit token is checked against the reference as it is generated, and the whole stream is then replayed through the circuit.
72
 
73
+ 24/24 conversations clean.
74
 
75
  ## Usage
76
 
assets/call.gif ADDED

Git LFS Details

  • SHA256: a960bac8afa173ec0438698bb403c1c4c28ea5bce6be151f080cfc945fb9fbd8
  • Pointer size: 131 Bytes
  • Size of remote file: 100 kB
assets/call.png ADDED
assets/conversation.png ADDED