Instructions to use KexuanShi/Megatron-LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use KexuanShi/Megatron-LM with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
Download examples/academic_paper_scripts/sc21/SBATCH.sh from KexuanShi/Megatron-LM: direct link, hf CLI and curl.
- Browser
- Download file 219 Bytes
-
https://huggingface.co/KexuanShi/Megatron-LM/resolve/main/examples/academic_paper_scripts/sc21/SBATCH.sh
- Command line
-
hf download hf://KexuanShi/Megatron-LM/examples/academic_paper_scripts/sc21/SBATCH.sh
-
curl -L -o SBATCH.sh https://huggingface.co/KexuanShi/Megatron-LM/resolve/main/examples/academic_paper_scripts/sc21/SBATCH.sh
219 Bytes
| sbatch -p ${SLURM_PARTITION} \ | |
| -A ${SLURM_ACCOUNT} \ | |
| --job-name=${JOB_NAME} \ | |
| --nodes=${NNODES} \ | |
| --export=MEGATRON_CODE_DIR,MEGATRON_PARAMS,DOCKER_MOUNT_DIR SRUN.sh | |
| exit 0 | |