egolm-protocol-v2-code / HF_NOTES.md
po03087's picture
EgoLM baseline code (Ego3DLM snapshot, unmodified) + upload notes
3de4238 verified
|
Raw History Blame Contribute Delete
1.13 kB
# Notes on this upload
This is a snapshot of the Ego3DLM code (ECCV 2026; README.md is the authors' own) used for the **EgoLM**
baseline of protocol v2 (dataset: https://huggingface.co/datasets/po03087/nymeria-adt-protocol-v2, see its
`CLAUDE.md` and `PROTOCOL_v2.md`).
- The code is **unmodified**: the protocol-v2 changes to EgoLM (20 Hz motion with a retrained tokenizer, no 3D
scene, MPS device head input canonicalized by the observed head, a 44-way verb head on a placeholder token,
8 epochs of instruction tuning from GPT-2 medium, no validation loop) are not applied yet.
- `deps/t2m/` holds the T2M evaluators and GloVe files that `prepare/download_t2m_evaluators.sh` downloads.
- **Not included:** the SMPL / SMPL-H / MANO body models (their license forbids redistribution; get them
with `prepare/download_smpl_model.sh` / `prepare/smplh.sh` or from https://smpl.is.tue.mpg.de), model
checkpoints, datasets, `obstacle_labels/`, `flan-t5-base` (download from Hugging Face), experiment outputs.
- `checkpoints/`, `datasets/` and `deps/` are expected at the repository root (the original tree used symlinks).