ReMind 5B

ReMind post-trains a causal video generator to preserve and evolve hidden world state through camera motion, occlusion, and illumination changes.

Project page · Paper · Code

Release status

Model Status
ReMind 5B Available in this repository
ReMind 1.3B Coming soon

This repository currently releases only the validated ReMind 5B weights. It does not contain ReMind 1.3B weights.

Files

File Size Purpose
ReMind-5b-teacher-forcing.safetensors 10.37 GiB Complete ReMind teacher-forcing generator
ReMind-5b-dmd-ema.safetensors 1.38 GiB Rank-128 SF-DMD EMA student LoRA

The DMD EMA file is not a standalone model. Load the official Wan-AI/Wan2.2-TI2V-5B model, overlay the ReMind teacher-forcing generator, cast it to BF16, and then merge the ReMind DMD EMA LoRA.

Only inference weights are included. Optimizer state, gradients, critics, raw student adapters, schedulers, and training-state checkpoints are excluded.

Setup

Clone and install the public ReMind code:

git clone https://github.com/Applied-Intuition-Open-Source/ReMind.git
cd ReMind
python -m venv .venv
source .venv/bin/activate
pip install -U pip
pip install -r requirements.txt
pip install -e .

Download the official Wan 2.2 TI2V 5B model in its original repository layout:

hf download Wan-AI/Wan2.2-TI2V-5B \
  --local-dir checkpoints/Wan2.2-TI2V-5B

Place the two ReMind files together, for example under checkpoints/ReMind-5B/, and run one of the seven bundled presets:

python inference.py \
  --preset examples/presets/01_latte_occluder_recovery.yaml \
  --config configs/model_5b.yaml \
  --model-folder checkpoints/Wan2.2-TI2V-5B \
  --base-checkpoint checkpoints/ReMind-5B/ReMind-5b-teacher-forcing.safetensors \
  --ema-checkpoint checkpoints/ReMind-5B/ReMind-5b-dmd-ema.safetensors \
  --output outputs/latte_occluder_recovery.mp4

The public inference recipe uses 81 frames at 832×480 and 16 fps, seven three-latent-frame chunks, and the shifted four-step schedule [1000, 937, 833, 625]. Camera examples use the bundled pair-fixed GT camera trajectories.

Checkpoint lineage and validation

  • Teacher-forcing generator: ReMind 5B pair-fixed 480p checkpoint 15000.
  • DMD EMA adapter: last complete SF-DMD checkpoint 2500.
  • The teacher-forcing checkpoint loads with 100% key coverage.
  • All seven public inference examples completed successfully. Both camera examples and all three clean-I2V examples reproduce the published project page videos byte-for-byte.

Integrity hashes are provided in SHA256SUMS.

Intended use

ReMind is a research artifact for studying dynamic memory, controlled camera motion, reversible visibility disturbances, and clean image-to-video generation. The bundled examples demonstrate representative inputs and controls; they are not a benchmark or a guarantee of behavior.

Limitations

  • Long or complex motion can accumulate autoregressive errors.
  • Camera control is approximate and may not follow every requested path.
  • Recovery depends on scene content, event timing, seed, and model size.
  • Outputs can contain physical, geometric, identity, lighting, and temporal artifacts.
  • The model should not be used for high-stakes decisions or to misrepresent generated media as real.

License

The two ReMind weight files are licensed under Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0). See LICENSE for the full legal code.

The upstream Wan model is not included and remains governed by its own terms. The public ReMind code and bundled third-party components are governed by the licenses and notices in the code repository.

Citation

@article{xu2026teaching,
  title={Teaching Video Generators to Remember: Eliciting Dynamic Memory for Out-of-Sight State Evolution},
  author={Xu, Tianshuo and Xie, Yichen and Meng, Depu and Peng, Chensheng and Herau, Quentin and Jiang, Bo and Hu, Yihan and Zhan, Wei},
  journal={arXiv preprint arXiv:2605.25333},
  year={2026}
}
Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AppliedIntuitionResearch/ReMind

Finetuned
(72)
this model

Paper for AppliedIntuitionResearch/ReMind