Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -2,6 +2,7 @@
|
|
| 2 |
license: mit
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
tags:
|
| 7 |
- cpu
|
|
@@ -24,10 +25,6 @@ tags:
|
|
| 24 |
- NoeSA
|
| 25 |
- Ntarra-DnA
|
| 26 |
model_type: iknn
|
| 27 |
-
datasets:
|
| 28 |
-
- deeprcurs/IKNN-Rl1-Dataset
|
| 29 |
-
base_model:
|
| 30 |
-
- deeprcurs/IKNN-Rl1-A1
|
| 31 |
---
|
| 32 |
|
| 33 |
# IKNN-Rl1-A1
|
|
@@ -53,7 +50,7 @@ This is an early prototype of the architecture that will underpin larger IKNN mo
|
|
| 53 |
- **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
|
| 54 |
- **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β 338KB) vs -80% target, 96% in full pipeline.
|
| 55 |
- **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ16β1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
|
| 56 |
-
- **Agentic Researcher Focus:** Not an ordinary chatbot. Dataset V1 6000 examples + V2 10k hard β 2000 each logic, reasoning, coding, research, 1000 math, 1000 science β generated via frontier
|
| 57 |
|
| 58 |
For more details, see `docs/IKNN_SPEC.md`.
|
| 59 |
|
|
@@ -224,9 +221,12 @@ deepRcurs Labs β deeprcurs/IKNN-Rl1-A1 β Model IKNN-Rl1-A1 β OFFICIAL
|
|
| 224 |
βββ src/ # Prototype components β 150M, router, SIWF, etc.
|
| 225 |
βββ scripts/
|
| 226 |
β βββ generate_agentic_dataset.py # Agentic dataset β logic/reasoning/coding/research/math/science
|
| 227 |
-
β βββ
|
|
|
|
|
|
|
|
|
|
| 228 |
β βββ publish.sh # Publish to HF β org deepRcurs Labs β repo deeprcurs/IKNN-Rl1-A1 β .iknn only
|
| 229 |
-
βββ internal/ # PRIVATE β not published β 2.0MB β
|
| 230 |
```
|
| 231 |
|
| 232 |
- `internal/` 2.0MB private β NOT published β per publish rule
|
|
@@ -243,7 +243,7 @@ IKNN-Rl1-A1 is for **agentic task and researcher agent** β :
|
|
| 243 |
- **Math:** Compute a*b + a<<2 for Ntarra phase, shift 2 = *4 PHI1, steps
|
| 244 |
- **Science:** Why Hadamard preserves L2 norm H^T H = I, ||H x||_2 = ||x||_2, randomized D H, outlier 10β5.07 flattened, norm diff 9.5e-07 PASS
|
| 245 |
|
| 246 |
-
Iteration 1 shows learning (loss down),
|
| 247 |
|
| 248 |
## Publishing
|
| 249 |
|
|
@@ -291,4 +291,4 @@ MIT for code (`iknn.cpp`, `kernels/`), Apache 2.0 for model weights when release
|
|
| 291 |
**Training:** Agentic 150M β 6000 examples logic/reasoning/coding/research/math/science β loss 7.08β0.41 β LLM trains IKNN
|
| 292 |
**Image:** docs/IKNN-Rl1-A1-architecture-dark.png β dark BG
|
| 293 |
**HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1
|
| 294 |
-
**Timestamp:** 2026-09-03T20:00:00+07:00
|
|
|
|
| 2 |
license: mit
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
+
library_name: custom
|
| 6 |
pipeline_tag: text-generation
|
| 7 |
tags:
|
| 8 |
- cpu
|
|
|
|
| 25 |
- NoeSA
|
| 26 |
- Ntarra-DnA
|
| 27 |
model_type: iknn
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
---
|
| 29 |
|
| 30 |
# IKNN-Rl1-A1
|
|
|
|
| 50 |
- **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
|
| 51 |
- **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β 338KB) vs -80% target, 96% in full pipeline.
|
| 52 |
- **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ16β1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
|
| 53 |
+
- **Agentic Researcher Focus β Clean Mining:** Not an ordinary chatbot. Dataset V1 6000 examples + V2 10k hard β 2000 each logic, reasoning, coding, research, 1000 math, 1000 science β generated via **Clean Mining** β anonymous frontier synthesis β pointer: CM-V2-20260903-##51pct β see internal/protocol/CLEAN_MINING_PROTOCOL.md for mapping. Training V1 loss 7.08β0.41 val 6.59β0.50, V2 loss 7.01β0.20 val 6.44β0.20 improvement 51% β grad stable 1.0, no explosion. Designed for agentic tasks and researcher agents. Checkpoint `.pt` 21MB saved in `checkpoints/` on HF without affecting workspace snapshot (`.cache/` excluded β no interference). Datasets published to separate repos `deeprcurs/IKNN-Rl1-Dataset-*` per jenis β IKNN-Rl1-Dataset-(jenis) β no snapshot interference.
|
| 54 |
|
| 55 |
For more details, see `docs/IKNN_SPEC.md`.
|
| 56 |
|
|
|
|
| 221 |
βββ src/ # Prototype components β 150M, router, SIWF, etc.
|
| 222 |
βββ scripts/
|
| 223 |
β βββ generate_agentic_dataset.py # Agentic dataset β logic/reasoning/coding/research/math/science
|
| 224 |
+
β βββ generate_agentic_dataset_v2.py # Agentic dataset V2 10k hard β Clean Mining β pointer: CM-V2-20260903-##51pct
|
| 225 |
+
β βββ train_iknn_agentic.py # Train IKNN 150M β Clean Mining β anonymous β pointer: CM-V2-20260903-##51pct
|
| 226 |
+
β βββ train_iknn_agentic_v2.py # Train V2 500 steps β loss 0.20 β Clean Mining
|
| 227 |
+
β βββ publish_all_v2.py # One-click publish β checkpoint .pt + dataset per jenis + (check)-## marker β no snapshot interference
|
| 228 |
β βββ publish.sh # Publish to HF β org deepRcurs Labs β repo deeprcurs/IKNN-Rl1-A1 β .iknn only
|
| 229 |
+
βββ internal/ # PRIVATE β not published β 2.0MB β protocols: CLEAN_MINING, COMMENT_SANITIZATION, CHECKPOINT_DATASET_PUBLISH β hard rules
|
| 230 |
```
|
| 231 |
|
| 232 |
- `internal/` 2.0MB private β NOT published β per publish rule
|
|
|
|
| 243 |
- **Math:** Compute a*b + a<<2 for Ntarra phase, shift 2 = *4 PHI1, steps
|
| 244 |
- **Science:** Why Hadamard preserves L2 norm H^T H = I, ||H x||_2 = ||x||_2, randomized D H, outlier 10β5.07 flattened, norm diff 9.5e-07 PASS
|
| 245 |
|
| 246 |
+
Iteration 1 shows learning (loss down), V2 shows improvement 51% loss 0.20 β needs iteration 3+ (20k data, 1000 steps) until truly answers correctly β **Clean Mining** methodology: anonymous frontier synthesis generates high-quality agentic dataset logic/reasoning/coding/research/math/science for CPU-first validation β pointer: CM-V2-20260903-##51pct β see internal/protocol/CLEAN_MINING_PROTOCOL.md for mapping β public term Clean Mining only per hard rule COMMENT_SANITIZATION_PROTOCOL.md β pointer: CM-V2-20260903-##51pct.
|
| 247 |
|
| 248 |
## Publishing
|
| 249 |
|
|
|
|
| 291 |
**Training:** Agentic 150M β 6000 examples logic/reasoning/coding/research/math/science β loss 7.08β0.41 β LLM trains IKNN
|
| 292 |
**Image:** docs/IKNN-Rl1-A1-architecture-dark.png β dark BG
|
| 293 |
**HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1
|
| 294 |
+
**Timestamp:** 2026-09-03T20:00:00+07:00
|