Vectorize MoE dispatch (argsort+bincount): eliminate 2,688 CUDA kernel launches per pass

Add live elapsed time counter (fmt_duration) and step pace (s/step, step/h) to console logs

Optimize chunk_size to 2048 on 24GB+ GPUs (cuts head projections from 64 to 8 per micro-batch)

Fix MoE Muon lag: route 4032 sparse expert weights to PagedAdamW8bit (eliminates 68,000 matmuls per step, 15x faster)

RTX 3090 Max Speed: Zero-sync GPU loss accum, pinned-memory batch slicing, Muon in VRAM, 262k tok/step curriculum

RTX 3090 Max Speed: Zero-sync GPU loss accum, pinned-memory batch slicing, Muon in VRAM, 262k tok/step curriculum

Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm

Sync model/scripts/train.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/train.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/viu_moe.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/viu_moe.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/viu_moe.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/train.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/verify_arch.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/viu_moe.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/train.py after full codebase audit, retry hardening, and token security fixes

Sync model/scripts/train.py with adult erotica stories priority integration

Sync model/scripts/train.py with adult erotica stories priority integration

feat: step-1 priority queue integration for real Indian history & cricket shards

feat: 100% zero-exclusion streaming architecture (2,081 shards) and updated docs

feat: include toxicity & hate_speech tweets via native tweet adapter in pretraining

feat: unlock 8.55M vortex instruction rows and add corrupted text filter

feat: dynamic streaming buffer refill for continuous 105B pretraining & frozen val benchmark

Sync train.py with language tag normalization & category round-robin interleaving

Unlock all 1,874 Parquet files including all 33 legal shards (model/scripts/train.py)

Unlock 1,841 valid Parquet files in streaming engine (model/scripts/train.py)

Unlock 26M Samanantar parallel translation stream in train.py (model/scripts/train.py)

Sync full-scale uncapped pretraining dataset updates (model/scripts/train.py)

Decouple muon_weight_decay: 0.01 from AdamW weight_decay in model/scripts/train.py

Audit fix (grad_ckpt, 1392 comments, smoke experts, tokenizer mask) model/scripts/train.py

Audit fix (grad_ckpt, 1392 comments, smoke experts, tokenizer mask) model/scripts/train.py

Audit fix (grad_ckpt, 1392 comments, smoke experts, tokenizer mask) model/scripts/viu_moe.py

Upgrade to Frontier Viu-Transformer (MLA + 1218 MoE + Softcapping) model/scripts/verify_arch.py

Upgrade to Frontier Viu-Transformer (MLA + 1218 MoE + Softcapping) model/scripts/viu_moe.py

Upgrade to Frontier Viu-Transformer (MLA + 1218 MoE + Softcapping) model/scripts/verify_arch.py

Upgrade to Frontier Viu-Transformer (MLA + 1218 MoE + Softcapping) model/scripts/train.py

Upgrade to Frontier Viu-Transformer (MLA + 1218 MoE + Softcapping) model/scripts/viu_moe.py

Update Viu-Transformer 42L neural network implementation

Add model/scripts/verify_arch.py

Add model/scripts/train.py

Add model/scripts/viu_moe.py