Spaces:
Paused
Paused
Commit History
-
Add Orbis 2 hierarchical world model demo (app2.py)
Sudhanshu Mittal +1: Claude Opus 4.8Vendors the Orbis 2 inference code into orbis2/ and adds app2.py, a Gradio demo for the hierarchical L1-L2 model. Orbis 1 (app.py, orbis/) is untouched; the Space still boots app.py until app_file is switched. Unlike Orbis 1, the Orbis 2 rollout takes an mp4 directly and samples its own L1 (high-rate) and L2 (low-rate, further back) context windows, so app2.py re-encodes the upload to a constant 10 fps instead of extracting frames and writing a val config. - orbis2/evaluate/rollout_demo_v2.py: add --num_videos to roll out N futures from one context as a single minibatch (tiling context/steering before building condition_kwargs), and save each to fake_images/sequence_XXXX/, matching the layout app2.py reads. - orbis2/models/second_stage/fm_model_v2.py: label the rollout tqdm bars so the app can scrape progress from the child process. - app2.py: downloads the three models (L1 detail predictor, L2 abstract predictor, tokenizer) from sud0301/orbis2_test into the HF cache and po…a6cc5f0