Buckets:
| # Copyright 2025 Bytedance Ltd. and/or its affiliates. | |
| # SPDX-License-Identifier: Apache-2.0 | |
| # replace the variables with your own | |
| torchrun \ | |
| --nnodes=$num_nodes \ | |
| --node_rank=$node_rank \ | |
| --nproc_per_node=8 \ | |
| --master_addr=$master_addr \ | |
| --master_port=$master_port \ | |
| train/pretrain_unified_navit.py \ | |
| --dataset_config_file ./data/configs/interleaved_reasoning.yaml \ | |
| --layer_module Qwen2MoTDecoderLayer \ | |
| --finetune_from_hf True \ | |
| --auto_resume True \ | |
| --finetune-from-ema True \ | |
| --resume_from $resume_from \ | |
| --results_dir $output_path \ | |
| --checkpoint_dir $ckpt_path \ | |
| --lr 1e-5 \ | |
| --num_worker 4 \ | |
| --max_latent_size 64 \ | |
| --max_num_tokens 32768 \ | |
| --vit_cond_dropout_prob 0 \ | |
| --text_cond_dropout_prob 0 \ | |
| --mse_weight 1 \ | |
| --ce_weight 1 \ | |
| --total_steps 8000 \ |
Xet Storage Details
- Size:
- 803 Bytes
- Xet hash:
- e6083b720e73e968d866ed2d90945b25349a439cd63591e8d6ff3cf0a9228370
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.