File size: 663 Bytes
0f70803
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
---
pipeline_tag: text-generation
tags:
  - llama
  - safetensors
  - fineweb-edu
  - dclm-edu
---

# cosmo.0

`DedeProGames/cosmo.0` is a Llama-architecture language model with 34.6 million parameters.

## Architecture

| Property | Value |
| --- | --- |
| Architecture | Llama |
| Parameters | 34.6M |
| Weight format | Safetensors |

## Training

cosmo.0 was trained on **5 billion tokens** from **FineWeb-Edu** and **DCLM-Edu**.

## Limitations

At 34.6M parameters, cosmo.0 is a very small language model, with limited capacity for complex tasks compared with larger models.

## Repository

[DedeProGames/cosmo.0](https://huggingface.co/DedeProGames/cosmo.0)