Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ GPT-sZero is a text generation model meant to answer the question: "How strong o
|
|
| 13 |
|
| 14 |
### Model Description
|
| 15 |
GPT-sZero has 16 heads, 24 layers, and 1280 embeddings, similar to GPT2-Large, with a context window of 16,384 tokens. This maximized GPU VRAM while balancing size and functionality.
|
| 16 |
-
|
| 17 |
- **Developed by:** HDTenEightyP
|
| 18 |
- **Model type:** Large Language Model with cl100k_base
|
| 19 |
- **Language(s) (NLP):** English
|
|
|
|
| 13 |
|
| 14 |
### Model Description
|
| 15 |
GPT-sZero has 16 heads, 24 layers, and 1280 embeddings, similar to GPT2-Large, with a context window of 16,384 tokens. This maximized GPU VRAM while balancing size and functionality.
|
| 16 |
+
It was trained on a diverse corpus of over 17 billion tokens.
|
| 17 |
- **Developed by:** HDTenEightyP
|
| 18 |
- **Model type:** Large Language Model with cl100k_base
|
| 19 |
- **Language(s) (NLP):** English
|