Instructions to use omnimem/self_forcing_from_ode_init with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use omnimem/self_forcing_from_ode_init with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("omnimem/self_forcing_from_ode_init", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - SelfForcing
How to use omnimem/self_forcing_from_ode_init with SelfForcing:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
File size: 1,643 Bytes
3b8f9ea | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 | ---
pipeline_tag: text-to-video
tags:
- omnimem
- wan
- video-generation
- self-forcing
---
# self_forcing_from_ode_init
OmniMem ordinary self-forcing checkpoint initialized from ODE-trained generator weights.
This release contains the **generator EMA weights at self-forcing training step 800**.
It is the shared initialization checkpoint used for the plain and prompt-switching rolling-training branches.
## Checkpoint lineage
ODE step-800 generator weights → ordinary self-forcing step-800 EMA → rolling-training branches.
The downstream releases are:
- [long_rolling_plain_from_ode_init](https://huggingface.co/omnimem/long_rolling_plain_from_ode_init)
- [long_rolling_switch_prompt_from_ode_init](https://huggingface.co/omnimem/long_rolling_switch_prompt_from_ode_init)
## Contents
- `config.json`
- Two `safetensors` weight shards and their index
- `SHA256SUMS` for payload integrity checking
The weights retain their original FP32 storage. The model configuration uses NSA top-12 block selection.
## Usage
Use compatible OmniMem code with `CausalWanNSAModel` and `CausalWanT2VPipeline`.
The Wan2.1 VAE, UMT5 text encoder, and tokenizer are separate required components.
```python
from omnimem.models.transformers.causal_wan_nsa_model import CausalWanNSAModel
model = CausalWanNSAModel.from_pretrained(
"omnimem/self_forcing_from_ode_init"
)
```
The original checkpoint configuration is preserved unchanged. Its saved class name
records the training wrapper, and `_name_or_path` records the upstream ODE initialization source.
The released payload is the **ordinary self-forcing step-800 EMA** checkpoint.
|