Buckets:
| set -euo pipefail | |
| export TOTAL_STEPS=${TOTAL_STEPS:-8000} | |
| export STOP_AFTER_STEPS=${STOP_AFTER_STEPS:-20} | |
| export GRADIENT_ACCUMULATION_STEPS=${GRADIENT_ACCUMULATION_STEPS:-4} | |
| export EXPECTED_NUM_TOKENS=${EXPECTED_NUM_TOKENS:-32768} | |
| export MAX_NUM_TOKENS=${MAX_NUM_TOKENS:-32768} | |
| export MAX_NUM_TOKENS_PER_SAMPLE=${MAX_NUM_TOKENS_PER_SAMPLE:-16384} | |
| export NUM_WORKERS=${NUM_WORKERS:-4} | |
| export SAVE_EVERY=${SAVE_EVERY:-20} | |
| exec "$(dirname "${BASH_SOURCE[0]}")/train_thinkmorph_paper_4gpu.sh" | |
Xet Storage Details
- Size:
- 512 Bytes
- Xet hash:
- 7606d5917140e0db8f4f36268cf394ac1d41a585423a8c256aded4807295bf54
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.