Barbados / bundle /source /config /data /fineweb_document.yaml
Vykos's picture
Release Barbados looped MoE research prototype
d5147ba verified
Raw History Blame Contribute Delete
280 Bytes
# FineWeb-Edu document Causal LM pack (DocumentDataset).
# Build with tools/pack_document_data.py, then pass data.path=<dir> (DATA_PATH in scripts/train.sh).
format: document
path: ??? # Override at CLI: data.path=/path/to/packed_data
val_path: null
target_only: false