diffusion_baseline / upstreams /mdlm /configs /data /openwebtext-split.yaml
jyliuAI's picture
Add files using upload-large-folder tool
069761e verified
Raw History Blame Contribute Delete
160 Bytes
train: openwebtext-train
valid: openwebtext-valid
tokenizer_name_or_path: gpt2
cache_dir: /share/kuleshov/ssahoo/textdiffusion/data
wrap: True
streaming: False