You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

WE-Dream Latent-action Pretraining β€” 5k

This WE-Dream checkpoint was pretrained for 50,000 steps on approximately 5,000 hours of EgoDex, EgoVerse, and EgoWE egocentric video, supervised by 32-dimensional latent actions. It initializes robot post-training.

Property Value
Prediction horizon 24 steps
Routed-attention probability 0.5

Use

Follow the installation instructions to set up the training environment and download the base model files. Accept the access terms on this page, then download:

hf download we-dream/pretrain-latent-5kh \
  --local-dir checkpoints/we-dream-latent-5kh

Set PRETRAINED_MODEL_PATH=checkpoints/we-dream-latent-5kh when following the post-training guide.

License

Apache-2.0. Source revisions and file checksums are recorded in provenance.json.

Downloads last month
4
Safetensors
Model size
23B params
Tensor type
F32
Β·
BF16
Β·
Video Preview
loading

Collection including we-dream/pretrain-latent-5kh