Spaces:
Running
Running
File size: 2,820 Bytes
bf726a9 d53194a bf726a9 785abd9 c75be90 785abd9 c75be90 033b3dc c75be90 785abd9 c75be90 d53194a c75be90 d53194a c75be90 785abd9 c75be90 d53194a 785abd9 d53194a 785abd9 d53194a 785abd9 c75be90 785abd9 c75be90 785abd9 d53194a 785abd9 c75be90 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 | ---
title: README
emoji: 🚀
colorFrom: indigo
colorTo: purple
sdk: static
pinned: false
---
# 🚀 Novi AI
Novi AI is an experimental AI project focused on building **small, efficient language models** and exploring what can be achieved at the million-parameter scale.
## 🧠 Models
| Model | Parameters | Training Tokens | Status |
| -------------- | ---------: | --------------: | ---------- |
| **Novi-Nano** | 1M | 300M | ✅ Released |
| **Novi-Micro** | 5M | 1B | ✅ Released |
| Novi-Mini | 10M | 15B | 📋 Planned |
| Novi-Medium | 25M | 25B | 📋 Planned |
| Novi-Pro | 50M | 65B | 📋 Planned |
| Novi-Ultimate | 100M | 75B | 📋 Planned |
### ⭐ Novi-Micro
**Novi-Micro** is the latest released Novi base model and the next step after Novi-Nano.
With approximately **5.04 million parameters**, Novi-Micro was trained from scratch on **1 billion tokens** with a **2,048-token context window**.
* 🧠 ~5.04M parameters
* 📚 1B training tokens
* 🔤 16,384-token vocabulary
* 📏 2,048-token context
* 🌐 FineWeb-HQ
* ⚡ GPU-accelerated training
* 🏗️ Custom BananaMind 2-style architecture
* 💻 Designed for lightweight experimentation
Novi-Micro is a **base language model**, intended primarily for research, experimentation, and further training rather than instruction-following.
### 🔹 Novi-Nano
Novi-Nano was the **first released Novi model**, introducing the project at the million-parameter scale.
* 🧠 ~1.26M parameters
* 📚 300M training tokens
* 🔤 8,192-token vocabulary
* 📏 256-token context
* 🌐 FineWeb-Edu, FineWeb-HQ, and SmolLM-Cosmopedia
* ⚡ GPU-accelerated training
* 💻 Designed for lightweight experimentation
Novi-Nano remains available as an earlier-generation experimental model.
## 🧪 Experimental Projects
* **Novi-Code** — Compact text + code model
* **Yuki** — Image-generation research
* **Super-Novi** — Intentionally chaotic experiment
* **Hyper-Novi** — Experimental model exploring unconventional training data
These projects are experimental and may change, be renamed, or never be released.
## 🛠️ Project Kairo
**Project Kairo** is the development codename for the Novi project.
It encompasses the development and experimentation behind the Novi model series, including Novi-Micro and future models.
## 📜 Project History
### AppleMind
Before Novi, there was **AppleMind** — an earlier experimental language-model project.
AppleMind is now **retired**, with Novi becoming the primary project.
**AppleMind → Novi AI → Novi-Nano → Novi-Micro** 🚀
---
*Small models. Big experiments.*
*Novi AI 2026 — Project Kairo*
|