egolm-protocol-v2-code / HF_NOTES.md
po03087's picture
EgoLM baseline code (Ego3DLM snapshot, unmodified) + upload notes
3de4238 verified
|
Raw History Blame Contribute Delete
1.13 kB

Notes on this upload

This is a snapshot of the Ego3DLM code (ECCV 2026; README.md is the authors' own) used for the EgoLM baseline of protocol v2 (dataset: https://huggingface.co/datasets/po03087/nymeria-adt-protocol-v2, see its CLAUDE.md and PROTOCOL_v2.md).

  • The code is unmodified: the protocol-v2 changes to EgoLM (20 Hz motion with a retrained tokenizer, no 3D scene, MPS device head input canonicalized by the observed head, a 44-way verb head on a placeholder token, 8 epochs of instruction tuning from GPT-2 medium, no validation loop) are not applied yet.
  • deps/t2m/ holds the T2M evaluators and GloVe files that prepare/download_t2m_evaluators.sh downloads.
  • Not included: the SMPL / SMPL-H / MANO body models (their license forbids redistribution; get them with prepare/download_smpl_model.sh / prepare/smplh.sh or from https://smpl.is.tue.mpg.de), model checkpoints, datasets, obstacle_labels/, flan-t5-base (download from Hugging Face), experiment outputs.
  • checkpoints/, datasets/ and deps/ are expected at the repository root (the original tree used symlinks).