feat: step-1 priority queue integration for real Indian history & cricket shards

docs/PROGRESS.md

@@ -568,3 +568,27 @@ Kaggle par manual file upload se version mismatch hota hai (v1 tokenizer wala ca
   - **In-Flight Blake2b Deduplication**: Audited 191,442 candidate records -> **50,058 duplicates dropped**; **141,384 UNIQUE authentic records** packaged into 3 dedicated ZSTD Parquet shards (`domains/train-frontier_deduped_real_cricket-00000.parquet` to `...-00002.parquet`).
   - **Hub Footprint**: Repository `ViuAI/viu-mini-raw-pretrain` expanded to **2,091 Parquet files (~213.9 GB compressed, ~232.3M rows, ~117–127B tokens)**.
   - **Zero-Loss Verification**: `scratch/verify_zero_exclusions.py` confirmed exactly **2,091 out of 2,091 Parquet shards (100.0%)** are actively streamed into `train.py` with **0 exclusions**.
+
+- [x] 2026-09-29 PRIORITY PRETRAINING QUEUE INTEGRATION FOR REAL INDIAN HISTORY & CRICKET (STEP 1 IMMEDIATE INGESTION):
+  - **User Directive**: "apne new data jo abhi add kiya hai usko traing me add kro" — Immediately integrate the newly uploaded Indian History, PIB, and Cricket shards into active pretraining so they train right from Step 1.
+  - **Queue Priority Engine Enhancement**:
+    - Enhanced the category round-robin interleaver in `model/scripts/train.py` across both repositories (`Viu-1.5B-MoE` and `ViuMini-MoE-242M`).
+    - Configured `PRIORITY_PATTERNS = ("real_indian_history_pib", "real_cricket", "real_industrial_qms", "conversational")`.
+    - Placed all 7 `real_indian_history_pib` shards and all 3 `real_cricket` shards directly at the head of the `domains/` bucket before round-robin interleaving across all 18 categories.
+  - **Queue Position Audit**:
+    - Out of 2,091 total Parquet shards across 18 categories:
+      - Queue Position #3: `domains/train-frontier_deduped_real_indian_history_pib-00002.parquet`
+      - Queue Position #21: `domains/train-frontier_deduped_real_indian_history_pib-00001.parquet`
+      - Queue Position #37: `domains/train-frontier_deduped_real_indian_history_pib-00000.parquet`
+      - Queue Position #52: `domains/train-frontier_deduped_real_indian_history_pib-00005.parquet`
+      - Queue Position #65: `domains/train-frontier_deduped_real_cricket-00001.parquet`
+      - Queue Position #76: `domains/train-frontier_deduped_real_indian_history_pib-00006.parquet`
+      - Queue Position #87: `domains/train-frontier_deduped_real_indian_history_pib-00004.parquet`
+      - Queue Position #98: `domains/train-frontier_deduped_real_indian_history_pib-00003.parquet`
+      - Queue Position #108: `domains/train-frontier_deduped_real_cricket-00000.parquet`
+      - Queue Position #118: `domains/train-frontier_deduped_real_cricket-00002.parquet`
+    - All 10 newly added shards (454,179 authentic records) are guaranteed to load within the initial prefetch buffer (`max_blocks=50000` $\approx$ 180,000 blocks) and are actively trained from Step 1.
+  - **Verification & Hub Sync**:
+    - Smoke tests executed cleanly with Exit Code 0 on both `Viu-1.5B-MoE` and `ViuMini-MoE-242M`.
+    - Synced to Hugging Face Hub `ViuAI/Viu-1.5B-MoE` and `ViuAI/ViuMini-MoE-242M`.
+