| # 🔥 Prometheus |
|
|
| > *Prometheus stole fire from the gods and gave it to humanity.* |
| > *I'm taking AI from corporations and giving it to everyone.* |
|
|
| ## The Story |
|
|
| My name is Ali. |
| I have no GPU. No money. No team. |
| Just a phone and Google Colab. |
|
|
| I decided to build my own AI from scratch. |
| Not a fine-tune. Not a wrapper. |
| My own architecture. My own training. My own weights. |
|
|
| This is Prometheus. My creation. |
|
|
| ## Current Status |
| Version: v0.0 — just born |
| Parameters: 25M |
| Steps: ~5000 |
| Loss: ~10.0 (falling every day) |
| Hardware: Google Colab T4 (free) |
| Data: Russian Wikipedia (streaming) |
| ## The Roadmap |
| v0.1 → 25M — learning language (now) |
| v0.2 → 85M — simple dialogue |
| v0.3 → 300M — GPT-2 level |
| v1.0 → 1B — real assistant |
| v2.0 → 10B — MoE, 5 experts |
| v4.0 → 60B — DeepSeek level |
| ## Why? |
|
|
| Because I believe one person with determination |
| can build what corporations build with millions. |
|
|
| Follow the journey. Watch Prometheus grow. |
|
|
| **Updates every month.** |
