AI data curation for training and post-training: filtering, deduplication, quality scoring, decontamination and dataset selection. Collaboration: agenten@magenta.de
Generate a customized dataset curation plan
Assess dataset readiness and get a quality score
Build a tailored AI data curation pipeline