ViuAI
/

ViuMini-Dense-360M

Text Generation

Model card Files Files and versions

ViuMini-Dense-360M

58.6 MB

Ctrl+K

Ctrl+K

2 contributors

History: 320 commits

ViuAI's picture

refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening

3a5d3e5 verified 7 minutes ago

data
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
docs
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
logs
Remove diverged logs/train.jsonl for clean AdamW start about 4 hours ago
model
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
scratch
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
tokenizer
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
.gitattributes

290 Bytes
Fix CUDA OOM on T4: cast model to amp_dtype directly, batch_size=2, safe RMSNorm 2 days ago
.gitignore

177 Bytes
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
NOTES.md

43.1 kB
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
README.md

6.75 kB
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
RUN_ON_CLOUD.ipynb

11 kB
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago
basic_arithmetic_bodmas_tables.parquet

678 kB
xet

docs & scripts: add full-scale 5-domain milestone (145.93GB/105B tokens) 12 days ago
requirements.txt

317 Bytes
refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening 7 minutes ago