Update README.md

README.md

@@ -21,12 +21,12 @@ It was trained on a set of Discord chat data, public domain books, and English B
 As the smallest DAT Byte model, this version was trained on less data than its larger family members.
 The training data was composed exclusively of the following sources:
 
-- [**Gutenberg English**](https://huggingface.co/datasets/sedthh/gutenberg_english) — English books in the public domain  
+- [**Gutenberg English**](https://huggingface.co/datasets/sedthh/gutenberg_english) — English books in the public domain (about 20GB total)
 - [**OpenDiscord**](https://huggingface.co/datasets/hudsongouge/Open-Discord) — Discord dumps in ChatML format  
 - Proprietary Discord dumps (similar structure and tone to OpenDiscord)  
 - A diverse set of public domain English Bible translations (~34MB total)
 
-Only the datasets listed above were used, and each was included in its entirety.
+Only the datasets listed above were used. Data was shuffled with Gutenberg English being used only around 35% of the time (average estimate).
 
 The Discord datasets (combined ~693MB) were formatted in **ChatML**, with usernames serving as speaker roles, enabling the model to learn natural dialogue structure and dynamics. Discord data included many diverse topics, especially code. Thus, the model understands basic syntax patterns of some common programming languages. However, due to its lack of training on large scale high quality code samples, generated code will likely not be reliable or production-quality.
 Larger models in the family received a larger and more diverse training set.