metadata
license: apache-2.0
tags:
- nova-1
- language-model
- phase-1
Nova-1 Large — Phase 1 Checkpoint
Phase 1 pretrained weights for Nova-1 Large.
Files
nova1/
├── nova1_final_s0011211.safetensors # model weights
└── nova1_final_s0011211_config.json # architecture config
Architecture
| Param | Value |
|---|---|
| d_model | 2560 |
| n_layers | 32 |
| n_heads | 20 |
| n_kv_heads | 10 |
| max_len | 2048 |
| vocab_size | 50304 |
Trained by SmilyAI Labs.