After a Colab/Kaggle session dies mid-training, the user needs a fast way
to confirm what made it to the HF Hub before the crash and to pull the
latest checkpoint locally.
scripts/check_hub_checkpoints.py:
--hub-model-id noanya/zombiee # default action: list
--hub-model-id noanya/zombiee --info # show step / loss / lr
# from trainer_state.json
--hub-model-id noanya/zombiee --download DIR # snapshot the latest
--checkpoint N # operate on a specific step
Honors HUGGINGFACE_TOKEN / HF_TOKEN for private repos. Prints a ready-to-run
`python -m training.train --resume-from-checkpoint <path>` command after a
successful download so resume on the DGX is one paste away.
notebooks/README.md:
- "My Colab/Kaggle session died — did I lose anything?" section pointing
at the recovery script.
- Document scripts/dgx_autorun.sh's tunables (MIN_FREE_GB, MAX_JOBS,
POLL_INTERVAL,…