-
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening
-
Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm
-
Sync data/scripts/ingest_large_cinema_mythology.py with massive Mythology and Bollywood Cinema corpora expansion
-
feat: wipe-proof HF persistence (full ckpt + live log + newest-2 cleanup)
-
fix: exclude non-5col schema paths from HF stream (wikipedia/grammar/gsm8k CastError on shuffle)
-
fix: probe OOM reserve 4GB + expandable_segments + natural-mode stream shuffle (Hindi-only trap)
-
sync local: enforce_mix sampler, tokenizer v2 (mask fix + 35/30/35), mix optional docs, repair scripts
-
feat: 100% overnight-resilient batch repair with 999 retries and persistent rate-limit handling
-
feat: batch upload shards (10 at once) in 1 commit to permanently bypass 128 commits/hr rate limit
-
fix: add smart 429 rate limit backoff and retry to repair scripts
-
refactor: clean repo, fix cross-platform paths, update progress
-
docs: add official comprehensive data audit report (145.93GB/105.1B tokens - 100% PASS)
-
docs & scripts: add dedicated grammar stream milestone (145.93GB/105.1B tokens)
-
docs & scripts: add full-scale 5-domain milestone (145.93GB/105B tokens)
-
docs & scripts: add dedicated science stream milestone (128.75GB/92B tokens)
-
docs & scripts: add dictionary, expanded stories, and massive uncensored datasets milestone (117GB/83B tokens)
-
feat/docs: sync stories & uncensored scripts & docs for data/scripts/add_stories_and_uncensored.py
-
feat/docs: sync open-source toxicity datasets & docs for data/scripts/add_open_source_toxicity.py
-
feat/docs: sync dedicated toxicity folder script & docs for data/scripts/generate_toxicity_lexicon.py
-
docs/feat: sync translation & hinglish expansion for data/scripts/add_curated_hinglish.py
-
docs/feat: sync translation & hinglish expansion for data/scripts/add_samanantar.py
-
docs/feat: sync deep domains, wikipedia ingestion & docs for data/scripts/add_wikipedia.py
-
docs/feat: sync deep domains, wikipedia ingestion & docs for data/scripts/generate_deep_domains.py
-
feat: add Google Colab userdata secrets support to collector
-
fix: Hinglish column key mapping and streamline stream execution order
-
feat: upgrade collector to 1GB shards with smart auto-resume
-
Add Single-Cell All-in-One Cloud Ingestion runner to Kaggle runbook
-
Add Pillar 26 Grammar & Language Mechanics (Hindi Vyakaran, English Grammar, Hinglish Syntax)
-
Add 25 Pillars: Stories, Movie Plots, Songs, Mobile Tech, Jokes & Street Roasts
-
Add Pillar 21 Translation & Global Cuisines expansion to data pipeline
-
Add Step 4 30B-50B+ Kaggle data collection suite & 20-pillar knowledge matrix
-
feat: SDPA FlashAttention, language tags conditioning, probe safety, slim checkpoints, and streaming clean
-
step4: clean_dedup.py + pull status
-
init: 28L MoE 241M audit-fixed, smoke pass