Instructions to use omnimem/long_rolling_plain_from_ode_init with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use omnimem/long_rolling_plain_from_ode_init with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("omnimem/long_rolling_plain_from_ode_init", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
|
Download README.md from omnimem/long_rolling_plain_from_ode_init: direct link, hf CLI and curl.
- Browser
- Download file 1.76 kB
-
https://huggingface.co/omnimem/long_rolling_plain_from_ode_init/resolve/main/README.md
- Command line
-
hf download hf://omnimem/long_rolling_plain_from_ode_init/README.md
-
curl -L -o README.md https://huggingface.co/omnimem/long_rolling_plain_from_ode_init/resolve/main/README.md
1.76 kB
| pipeline_tag: text-to-video | |
| tags: | |
| - omnimem | |
| - wan | |
| - video-generation | |
| - long-video | |
| # long_rolling_plain_from_ode_init | |
| OmniMem long rolling video generation with a fixed prompt, using an ODE-derived self-forcing initialization. | |
| This release contains the **EMA generator checkpoint at training step 1500**. | |
| The plain rolling-training run initialized from step-800 self-forcing EMA weights in the ODE lineage. | |
| ## Contents | |
| - `config.json` | |
| - Two `safetensors` weight shards and their index | |
| - `SHA256SUMS` for payload integrity checking | |
| The weights retain their original FP32 storage. The model configuration uses NSA top-12 block selection. | |
| ## Usage | |
| Use compatible OmniMem code with `CausalWanNSAModel` and `CausalWanT2VPipeline`. | |
| The Wan2.1 VAE, UMT5 text encoder, and tokenizer are separate required components. | |
| ```python | |
| from omnimem.models.transformers.causal_wan_nsa_model import CausalWanNSAModel | |
| model = CausalWanNSAModel.from_pretrained( | |
| "omnimem/long_rolling_plain_from_ode_init" | |
| ) | |
| ``` | |
| The original checkpoint configuration is preserved unchanged. Its saved class name | |
| records the training wrapper, and `_name_or_path` records the initialization source. | |
| The released weights are the **step-1500 EMA** weights. | |
| ## Training evaluation settings | |
| | Setting | Value | | |
| | --- | --- | | |
| | Prompt mode | Fixed prompt throughout each video | | |
| | Resolution | 832 × 480 | | |
| | Video duration | 60 seconds | | |
| | Frame rate | 16 FPS | | |
| | Exported frames | 960 (969 generated, tail cropped) | | |
| | Sampling steps | 4 | | |
| | Guidance scale | 1 | | |
| | Timestep shift | 5 | | |
| | Seed | 42 | | |
| | Frame block size | 3 | | |
| | KV history window | 3 | | |
| | KV cache LRU maximum | 7 | | |
| | VAE decode chunk size | 3 | | |
| Training evaluation uses five full-length static prompts. | |