readme change
Browse files
README.md
CHANGED
|
@@ -118,10 +118,6 @@ Primary references:
|
|
| 118 |
|
| 119 |
Common Pile v0.1 is an 8 TB collection of public-domain and openly licensed text from more than 30 sources. NeemSutra used a project-selected subset/organization of this broader collection.
|
| 120 |
|
| 121 |
-
One referenced source within Common Pile:
|
| 122 |
-
|
| 123 |
-
- Project Gutenberg: https://huggingface.co/datasets/common-pile/project_gutenberg
|
| 124 |
-
|
| 125 |
Base training: **~5.75B tokens**.
|
| 126 |
|
| 127 |
### First Python DAPT
|
|
|
|
| 118 |
|
| 119 |
Common Pile v0.1 is an 8 TB collection of public-domain and openly licensed text from more than 30 sources. NeemSutra used a project-selected subset/organization of this broader collection.
|
| 120 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 121 |
Base training: **~5.75B tokens**.
|
| 122 |
|
| 123 |
### First Python DAPT
|