You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

WE-Dream Action-free Pretraining β€” 2k

This action-free WE-Dream checkpoint was pretrained for 50,000 steps on approximately 2,000 hours of EgoDex and EgoVerse egocentric video, using video prediction without action supervision. It initializes robot post-training and provides a comparison with hand-pose and latent-action pretraining.

Property Value
Prediction horizon 24 steps
Routed-attention probability 0.5
Weights Safetensors, 19 shards, approximately 91.69 GB
Saved precision Primarily FP32

Use

Follow the installation instructions to set up the training environment and download the base model files. Accept the access terms on this page, then download:

hf download we-dream/pretrain-action-free-2kh \
  --local-dir checkpoints/we-dream-action-free-2kh

Set PRETRAINED_MODEL_PATH=checkpoints/we-dream-action-free-2kh when following the post-training guide.

Downloads last month
3
Safetensors
Model size
23B params
Tensor type
F32
Β·
BF16
Β·
Video Preview
loading

Collection including we-dream/pretrain-action-free-2kh