Spaces:
Running
Running
File size: 1,500 Bytes
71a6a55 a42da37 71a6a55 a42da37 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 | ---
title: Train@home
emoji: π
colorFrom: blue
colorTo: blue
sdk: static
pinned: false
---
# Train@home
Community-owned AI training. Like Folding@home, but for neural networks.
## What is this?
A distributed, open-source project where volunteers contribute compute to train language models. Anyone with a GPU can participate. The model and knowledge banks are collectively owned by all contributors.
## How it works
1. **Contribute compute** β download a checkpoint, train on your assigned data shard, upload gradients
2. **Contribute knowledge** β process documents into facts, submit them to the shared knowledge bank
3. **Govern** β propose and vote on training objectives, data distribution, architecture changes
## Current status
π§ **Early stage** β Building the foundation. Architecture design, training infrastructure, and initial knowledge bank.
## Get involved
- Fork the main repo
- Run the setup script
- Join the discussions
- Start contributing
## Architecture
- **Processing core** β Recurrent architecture with adaptive computation and revision
- **Knowledge bank** β Hot-swappable, product-quantized fact store
- **Retrieval interface** β Always-on, integrated into the forward pass (not tool calling)
## Training cycle
Training runs happen every 2-3 months. Between runs, the community proposes changes via PRs, discusses tradeoffs, and prepares data. Config freezes 2 weeks before training starts.
---
*Built by the community, for the community.* |