Instructions to use easylearning/RoboImagine with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use easylearning/RoboImagine with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("easylearning/RoboImagine", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Download rt1--roboimagine_config.json from easylearning/RoboImagine: direct link, hf CLI and curl.
- Browser
- Download file 1.05 kB
-
https://huggingface.co/easylearning/RoboImagine/resolve/main/rt1--roboimagine_config.json
- Command line
-
hf download hf://easylearning/RoboImagine/rt1--roboimagine_config.json
-
curl -L -o rt1--roboimagine_config.json https://huggingface.co/easylearning/RoboImagine/resolve/main/rt1--roboimagine_config.json
1.05 kB
| { | |
| "schema_version": 1, | |
| "dataset": "rt1", | |
| "status": "released_inference", | |
| "codec": "rt1/codec", | |
| "action_ranges": "rt1/preprocessing/action_ranges.pt", | |
| "action_tokens_per_step": 13, | |
| "text_conditioning": { | |
| "enabled": true, | |
| "repo_id": "google-t5/t5-base", | |
| "revision": "a9723ea7f1b39c1eae772870f3b547bf6ef7e6c1", | |
| "layers": [ | |
| 3, | |
| 7, | |
| 11 | |
| ], | |
| "inner": 256, | |
| "width": 768, | |
| "max_tokens": 64, | |
| "bundled": false | |
| }, | |
| "initial_observations": 2, | |
| "memory": { | |
| "anchor_states": 1, | |
| "recent_states": 6, | |
| "ground_truth_refresh": false | |
| }, | |
| "evaluation": { | |
| "strategy": "per_frame_beam", | |
| "beam_width": 4, | |
| "horizon": 32, | |
| "visual_tokens_per_frame": 80, | |
| "valid_visual_vocab": 4375 | |
| }, | |
| "variants": { | |
| "sft": { | |
| "path": "rt1/models/sft", | |
| "method": "SFT", | |
| "updates": 50000, | |
| "text": true | |
| }, | |
| "main": { | |
| "path": "rt1/models/main", | |
| "method": "GDBS with semantic and visual feedback", | |
| "updates": 500, | |
| "text": true | |
| } | |
| } | |
| } | |