🔄 In a Training Loop
Daniel Gallagher
DanielGallagherIRE
AI & ML interests
NLP at the Institute for Applied Informatics in Leipzig, Germany.
Recent Activity
updated a collection 1 day ago
O3 updated a collection 1 day ago
O3 updated a model 4 days ago
DanielGallagherIRE/ModernBERT-O3-Shuffling-SENTOrganizations
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
-
DanielGallagherIRE/FineWeb-Edu-10B-Obfuscation
Viewer • Updated • 19.4M • 1.3k -
DanielGallagherIRE/FineWeb-Edu-10B-Nouns-Only
Viewer • Updated • 9.71M • 1.6k -
DanielGallagherIRE/FineWeb-Edu-10B-Shuffled
Viewer • Updated • 9.68M • 1.97k -
DanielGallagherIRE/FineWeb-Edu-10B-PMI-Filtered
Viewer • Updated • 9.71M • 2.6k
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
-
DanielGallagherIRE/FineWeb-Edu-10B-Obfuscation
Viewer • Updated • 19.4M • 1.3k -
DanielGallagherIRE/FineWeb-Edu-10B-Nouns-Only
Viewer • Updated • 9.71M • 1.6k -
DanielGallagherIRE/FineWeb-Edu-10B-Shuffled
Viewer • Updated • 9.68M • 1.97k -
DanielGallagherIRE/FineWeb-Edu-10B-PMI-Filtered
Viewer • Updated • 9.71M • 2.6k
Models pre-trained on various obfuscated versions of a sample of 10B tokens to analyse whether such obfuscated models are still performant.