Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ datasets:
|
|
| 16 |
pipeline_tag: text-generation
|
| 17 |
---
|
| 18 |
|
| 19 |
-
Brought to you via @ContextReq
|
| 20 |
|
| 21 |
# Notio-3.7M-RNN-v1
|
| 22 |
|
|
@@ -25,9 +25,7 @@ Notio's core idea: the model learns **only the binary u8 token-id stream** — a
|
|
| 25 |
"english/symbols" rendering happens at runtime through a decoder that maps special tags
|
| 26 |
(`<spc>`, `<nwl>`, `<bos>`, `<eos>`...) to their effects and drops them from display.
|
| 27 |
|
| 28 |
-
> **Status:** v1 training in progress
|
| 29 |
-
> Milestone checkpoints uploaded: `notio1ksteps.pt`, `notio5k.pt`, `notio10k.pt`.
|
| 30 |
-
> Card reflects step ~11,000 and will be updated at completion.
|
| 31 |
|
| 32 |
## Design
|
| 33 |
|
|
@@ -72,7 +70,7 @@ The stack is modular: layer 0 (data) → layer 1 (embedding) → 2× layer 2 (GR
|
|
| 72 |
|
| 73 |
## Sample output
|
| 74 |
|
| 75 |
-
As of; step 18k (no max token, learning to end on <eos>, ended at tokenids total 606 & 608 respectively
|
| 76 |
|
| 77 |
Story 1
|
| 78 |
|
|
|
|
| 16 |
pipeline_tag: text-generation
|
| 17 |
---
|
| 18 |
|
| 19 |
+
Brought to you via @ContextReq - Built, tested and trained within 24 hours!
|
| 20 |
|
| 21 |
# Notio-3.7M-RNN-v1
|
| 22 |
|
|
|
|
| 25 |
"english/symbols" rendering happens at runtime through a decoder that maps special tags
|
| 26 |
(`<spc>`, `<nwl>`, `<bos>`, `<eos>`...) to their effects and drops them from display.
|
| 27 |
|
| 28 |
+
> **Status:** v1 training in progress.
|
|
|
|
|
|
|
| 29 |
|
| 30 |
## Design
|
| 31 |
|
|
|
|
| 70 |
|
| 71 |
## Sample output
|
| 72 |
|
| 73 |
+
As of; step 18k (no max token, learning to end on <eos>, ended at tokenids total 606 & 608 respectively) - Will update when decided run is complete to start on v2.
|
| 74 |
|
| 75 |
Story 1
|
| 76 |
|