Buckets:
| # Copyright 2025 Bytedance Ltd. and/or its affiliates. | |
| # SPDX-License-Identifier: Apache-2.0 | |
| # replace the variables with your own | |
| torchrun \ | |
| --nnodes=$num_nodes \ | |
| --node_rank=$node_rank \ | |
| --nproc_per_node=8 \ | |
| --master_addr=$master_addr \ | |
| --master_port=$master_port \ | |
| train/pretrain_unified_navit.py \ | |
| --dataset_config_file ./data/configs/text_reasoning.yaml \ | |
| --layer_module Qwen2MoTDecoderLayer \ | |
| --finetune_from_hf True \ | |
| --auto_resume True \ | |
| --finetune-from-ema True \ | |
| --resume_from $resume_from \ | |
| --results_dir $output_path \ | |
| --checkpoint_dir $ckpt_path \ | |
| --lr 1e-5 \ | |
| --num_worker 4 \ | |
| --max_latent_size 64 \ | |
| --max_num_tokens 10240 \ | |
| --visual_gen False \ | |
| --total_steps 3000 \ |
Xet Storage Details
- Size:
- 721 Bytes
- Xet hash:
- 78f72a39e3398f02f1270c21f866024b81101054528960b8c5e093039336a686
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.