Ouzhang
/

hku_diffusion_dllm

Model card Files Files and versions

hku_diffusion_dllm / reference /code /flm /configs /data /openwebtext-split.yaml

Ouzhang's picture

Add files using upload-large-folder tool

31dc8dc verified 3 months ago

Raw History Blame Contribute Delete

206 Bytes

	train: openwebtext-train
	valid: openwebtext-valid
	tokenizer_name_or_path: gpt2
	cache_dir: ${hydra:runtime.cwd}/datasets/openwebtext
	wrap: True
	streaming: False
	insert_train_eos: True
	insert_valid_eos: True