Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

ViuAI
/
ViuAI-1M

Text Generation
PyTorch
English
transformer
32-layers
deepseek-v4
kimi
mla
Mixture of Experts
muon-optimizer
hyper-connections
from-scratch
research
viuai
Model card Files Files and versions
xet
Community
ViuAI-1M / viuai
62.4 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 4 commits
ViuAI's picture
ViuAI
Upgrade: ViuAI-UltraDeep 32 Layers (8.96M Total / 4.25M Active / 52.6% Sparsity)
96a059a verified 4 days ago
  • inference
    Initial upload: ViuAI-1M architecture (1.18M params) 4 days ago
  • model
    Upgrade: ViuAI-UltraDeep 32 Layers (8.96M Total / 4.25M Active / 52.6% Sparsity) 4 days ago
  • tokenizer
    Initial upload: ViuAI-1M architecture (1.18M params) 4 days ago
  • training
    NextGen: DeepSeek-V4 MLA + Kimi Fine-Grained MoE + mHC + Muon Optimizer (1.58M Total / 0.98M Active) 4 days ago
  • __init__.py
    331 Bytes
    Initial upload: ViuAI-1M architecture (1.18M params) 4 days ago