deeprcurs-staff commited on
Commit
dfac84f
Β·
verified Β·
1 Parent(s): ade868e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -2,6 +2,7 @@
2
  license: mit
3
  language:
4
  - en
 
5
  pipeline_tag: text-generation
6
  tags:
7
  - cpu
@@ -24,10 +25,6 @@ tags:
24
  - NoeSA
25
  - Ntarra-DnA
26
  model_type: iknn
27
- datasets:
28
- - deeprcurs/IKNN-Rl1-Dataset
29
- base_model:
30
- - deeprcurs/IKNN-Rl1-A1
31
  ---
32
 
33
  # IKNN-Rl1-A1
@@ -53,7 +50,7 @@ This is an early prototype of the architecture that will underpin larger IKNN mo
53
  - **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β†’ 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
54
  - **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β†’ 338KB) vs -80% target, 96% in full pipeline.
55
  - **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ†’16β†’1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
56
- - **Agentic Researcher Focus:** Not an ordinary chatbot. Dataset V1 6000 examples + V2 10k hard β€” 2000 each logic, reasoning, coding, research, 1000 math, 1000 science β€” generated via frontier LLM. Training V1 loss 7.08β†’0.41 val 6.59β†’0.50, V2 loss 7.01β†’0.20 val 6.44β†’0.20 improvement 51% β€” grad stable 1.0, no explosion. Designed for agentic tasks and researcher agents. Checkpoint `.pt` 21MB saved in `checkpoints/` on HF without affecting workspace snapshot (`.cache/` excluded). Datasets published to separate repos `deeprcurs/IKNN-Rl1-Dataset-*` per jenis.
57
 
58
  For more details, see `docs/IKNN_SPEC.md`.
59
 
@@ -224,9 +221,12 @@ deepRcurs Labs β€” deeprcurs/IKNN-Rl1-A1 β€” Model IKNN-Rl1-A1 β€” OFFICIAL
224
  β”œβ”€β”€ src/ # Prototype components β€” 150M, router, SIWF, etc.
225
  β”œβ”€β”€ scripts/
226
  β”‚ β”œβ”€β”€ generate_agentic_dataset.py # Agentic dataset β€” logic/reasoning/coding/research/math/science
227
- β”‚ β”œβ”€β”€ train_iknn_agentic.py # Train IKNN 150M mandiri β€” frontier LLM trains IKNN
 
 
 
228
  β”‚ └── publish.sh # Publish to HF β€” org deepRcurs Labs β€” repo deeprcurs/IKNN-Rl1-A1 β€” .iknn only
229
- └── internal/ # PRIVATE β€” not published β€” 2.0MB β€” whitepaper drafts, ops, glossary
230
  ```
231
 
232
  - `internal/` 2.0MB private β€” NOT published β€” per publish rule
@@ -243,7 +243,7 @@ IKNN-Rl1-A1 is for **agentic task and researcher agent** β€” :
243
  - **Math:** Compute a*b + a<<2 for Ntarra phase, shift 2 = *4 PHI1, steps
244
  - **Science:** Why Hadamard preserves L2 norm H^T H = I, ||H x||_2 = ||x||_2, randomized D H, outlier 10β†’5.07 flattened, norm diff 9.5e-07 PASS
245
 
246
- Iteration 1 shows learning (loss down), but needs iteration 2+ (10k/20k data, 500/1000 steps) until truly answers correctly β€” frontier LLM can generate dataset, train, correct, iterate.
247
 
248
  ## Publishing
249
 
@@ -291,4 +291,4 @@ MIT for code (`iknn.cpp`, `kernels/`), Apache 2.0 for model weights when release
291
  **Training:** Agentic 150M β€” 6000 examples logic/reasoning/coding/research/math/science β€” loss 7.08β†’0.41 β€” LLM trains IKNN
292
  **Image:** docs/IKNN-Rl1-A1-architecture-dark.png β€” dark BG
293
  **HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1
294
- **Timestamp:** 2026-09-03T20:00:00+07:00
 
2
  license: mit
3
  language:
4
  - en
5
+ library_name: custom
6
  pipeline_tag: text-generation
7
  tags:
8
  - cpu
 
25
  - NoeSA
26
  - Ntarra-DnA
27
  model_type: iknn
 
 
 
 
28
  ---
29
 
30
  # IKNN-Rl1-A1
 
50
  - **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β†’ 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
51
  - **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β†’ 338KB) vs -80% target, 96% in full pipeline.
52
  - **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ†’16β†’1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
53
+ - **Agentic Researcher Focus β€” Clean Mining:** Not an ordinary chatbot. Dataset V1 6000 examples + V2 10k hard β€” 2000 each logic, reasoning, coding, research, 1000 math, 1000 science β€” generated via **Clean Mining** β€” anonymous frontier synthesis β€” pointer: CM-V2-20260903-##51pct β€” see internal/protocol/CLEAN_MINING_PROTOCOL.md for mapping. Training V1 loss 7.08β†’0.41 val 6.59β†’0.50, V2 loss 7.01β†’0.20 val 6.44β†’0.20 improvement 51% β€” grad stable 1.0, no explosion. Designed for agentic tasks and researcher agents. Checkpoint `.pt` 21MB saved in `checkpoints/` on HF without affecting workspace snapshot (`.cache/` excluded β€” no interference). Datasets published to separate repos `deeprcurs/IKNN-Rl1-Dataset-*` per jenis β€” IKNN-Rl1-Dataset-(jenis) β€” no snapshot interference.
54
 
55
  For more details, see `docs/IKNN_SPEC.md`.
56
 
 
221
  β”œβ”€β”€ src/ # Prototype components β€” 150M, router, SIWF, etc.
222
  β”œβ”€β”€ scripts/
223
  β”‚ β”œβ”€β”€ generate_agentic_dataset.py # Agentic dataset β€” logic/reasoning/coding/research/math/science
224
+ β”‚ β”œβ”€β”€ generate_agentic_dataset_v2.py # Agentic dataset V2 10k hard β€” Clean Mining β€” pointer: CM-V2-20260903-##51pct
225
+ β”‚ β”œβ”€β”€ train_iknn_agentic.py # Train IKNN 150M β€” Clean Mining β€” anonymous β€” pointer: CM-V2-20260903-##51pct
226
+ β”‚ β”œβ”€β”€ train_iknn_agentic_v2.py # Train V2 500 steps β€” loss 0.20 β€” Clean Mining
227
+ β”‚ β”œβ”€β”€ publish_all_v2.py # One-click publish β€” checkpoint .pt + dataset per jenis + (check)-## marker β€” no snapshot interference
228
  β”‚ └── publish.sh # Publish to HF β€” org deepRcurs Labs β€” repo deeprcurs/IKNN-Rl1-A1 β€” .iknn only
229
+ └── internal/ # PRIVATE β€” not published β€” 2.0MB β€” protocols: CLEAN_MINING, COMMENT_SANITIZATION, CHECKPOINT_DATASET_PUBLISH β€” hard rules
230
  ```
231
 
232
  - `internal/` 2.0MB private β€” NOT published β€” per publish rule
 
243
  - **Math:** Compute a*b + a<<2 for Ntarra phase, shift 2 = *4 PHI1, steps
244
  - **Science:** Why Hadamard preserves L2 norm H^T H = I, ||H x||_2 = ||x||_2, randomized D H, outlier 10β†’5.07 flattened, norm diff 9.5e-07 PASS
245
 
246
+ Iteration 1 shows learning (loss down), V2 shows improvement 51% loss 0.20 β€” needs iteration 3+ (20k data, 1000 steps) until truly answers correctly β€” **Clean Mining** methodology: anonymous frontier synthesis generates high-quality agentic dataset logic/reasoning/coding/research/math/science for CPU-first validation β€” pointer: CM-V2-20260903-##51pct β€” see internal/protocol/CLEAN_MINING_PROTOCOL.md for mapping β€” public term Clean Mining only per hard rule COMMENT_SANITIZATION_PROTOCOL.md β€” pointer: CM-V2-20260903-##51pct.
247
 
248
  ## Publishing
249
 
 
291
  **Training:** Agentic 150M β€” 6000 examples logic/reasoning/coding/research/math/science β€” loss 7.08β†’0.41 β€” LLM trains IKNN
292
  **Image:** docs/IKNN-Rl1-A1-architecture-dark.png β€” dark BG
293
  **HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1
294
+ **Timestamp:** 2026-09-03T20:00:00+07:00