🔄 In a Training Loop
Daniel Gallagher
DanielGallagherIRE
AI & ML interests
NLP at the Institute for Applied Informatics in Leipzig, Germany.
Recent Activity
updated a collection about 5 hours ago
Obfuscated ModernBERT updated a collection about 5 hours ago
Obfuscated ModernBERT updated a model about 5 hours ago
DanielGallagherIRE/ModernBERT-FWEdu-Dep-WeakOrganizations
Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.
Encoder models trained on obfuscated versions of the fineweb-edu-1B dataset, as part of the InfAI CORAL project.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-original
0.1B • Updated • 40 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-scramble-reverse-head
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-pos
0.1B • Updated -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-propn
0.1B • Updated • 1
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
-
DanielGallagherIRE/fineweb-edu-20B-obfuscation
Viewer • Updated • 19.4M • 242 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-POS-Removal
Viewer • Updated • 9.71M • 59 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Bag-of-Words
Preview • Updated • 630 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Mutual-Information
Viewer • Updated • 9.71M • 1.13k
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-10
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-7.5
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-5
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-2.5
0.1B • Updated • 3
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
-
DanielGallagherIRE/fineweb-edu-20B-obfuscation
Viewer • Updated • 19.4M • 242 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-POS-Removal
Viewer • Updated • 9.71M • 59 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Bag-of-Words
Preview • Updated • 630 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Mutual-Information
Viewer • Updated • 9.71M • 1.13k
Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-10
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-7.5
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-5
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-2.5
0.1B • Updated • 3
Encoder models trained on obfuscated versions of the fineweb-edu-1B dataset, as part of the InfAI CORAL project.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-original
0.1B • Updated • 40 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-scramble-reverse-head
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-pos
0.1B • Updated -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-propn
0.1B • Updated • 1