Instructions to use jalal06/model30 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use jalal06/model30 with LeRobot:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
|
Download README.md from jalal06/model30: direct link, hf CLI and curl.
- Browser
- Download file 1.5 kB
-
https://huggingface.co/jalal06/model30/resolve/main/README.md
- Command line
-
hf download hf://jalal06/model30/README.md
-
curl -L -o README.md https://huggingface.co/jalal06/model30/resolve/main/README.md
1.5 kB
| library_name: lerobot | |
| tags: [robotics, lerobot, franka, imitation-learning, dit_clip] | |
| # model30 | |
| DiT (CLIP ViT-B/16 + AdaLN-Zero diffusion transformer, DDPM 100 steps, epsilon prediction) policy for a real Franka Panda two-object insertion task: pick a yellow slotted cylinder and insert it into the | |
| round hole of a white board, then insert a green stepped block into the stepped square hole, then return home. | |
| - Training data: 73 SpaceMouse teleop demos (69 train / 4 val episodes, 101,675 train frames at 20 Hz), LeRobot v3 dataset `jalal06/real-franka-insertion` (not on the Hub yet). | |
| - Checkpoint: step 34,662 of run `dit_real73_b88_h18e16`, about 30 passes over the training frames (batch 88). | |
| - Inputs: `observation.state` = 7 joint positions (rad) + gripper width (m); `observation.images.main` and `observation.images.wrist` (400x224 RGB, resized to 224x224 inside the CLIP encoder); 2 observation frames. | |
| - Outputs: chunks of 18 actions, 16 executed per chunk; each action = 7 absolute joint-position targets (rad) + gripper command (-1 open, +1 close), for a joint-impedance controller at 20 Hz. | |
| - Normalization: saved LeRobot pre/post-processors (min-max stats from the train episodes). | |
| Loading needs LeRobot 0.5.2 and the `lerobot_policy_ebt` plugin (registers the `ebt` and `dit_clip` policy types). | |
| `config.json` points `clip_name` at a local copy of `openai/clip-vit-base-patch16`; set it to `openai/clip-vit-base-patch16` | |
| (or your local path) before loading on another machine. | |