Instructions to use tsangb34/smolvla_real_stack_red_blue_100 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use tsangb34/smolvla_real_stack_red_blue_100 with LeRobot:
# See https://github.com/huggingface/lerobot?tab=readme-ov-file#installation for more details git clone https://github.com/huggingface/lerobot.git cd lerobot pip install -e .[smolvla]
# Launch finetuning on your dataset python lerobot/scripts/train.py \ --policy.path=tsangb34/smolvla_real_stack_red_blue_100 \ --dataset.repo_id=lerobot/svla_so101_pickplace \ --batch_size=64 \ --steps=20000 \ --output_dir=outputs/train/my_smolvla \ --job_name=my_smolvla_training \ --policy.device=cuda \ --wandb.enable=true
# Run the policy using the record function python -m lerobot.record \ --robot.type=so101_follower \ --robot.port=/dev/ttyACM0 \ # <- Use your port --robot.id=my_blue_follower_arm \ # <- Use your robot id --robot.cameras="{ front: {type: opencv, index_or_path: 8, width: 640, height: 480, fps: 30}}" \ # <- Use your cameras --dataset.single_task="Grasp a lego block and put it in the bin." \ # <- Use the same task description you used in your dataset recording --dataset.repo_id=HF_USER/dataset_name \ # <- This will be the dataset name on HF Hub --dataset.episode_time_s=50 \ --dataset.num_episodes=10 \ --policy.path=tsangb34/smolvla_real_stack_red_blue_100 - Notebooks
- Google Colab
- Kaggle
smolvla_real_stack_red_blue_100
A SmolVLA policy for the SO-101 arm, fine-tuned from lerobot/smolvla_base. It was trained on the so101_real_stack_red_blue_100 dataset, which covers one task in the so101-libero-mini MuJoCo simulation.
- Task: Stack the red cube on the blue cube.
- Language instruction: "Put the red cube on top of the blue cube."
- Inputs:
observation.state(6-D joint state) and three 256×256 RGB cameras (camera1,camera2,camera3) - Output: 6-D action, predicted in chunks of 50
- Training: 100,000 steps, batch size 32, learning rate 0.0001, seed 1000
The weights at the root of this repo come from the final checkpoint (step 100,000).
Evaluation
The policy was run for 50 episodes per checkpoint in simulation. The 95% interval is a Wilson score interval.
| Checkpoint step | Successes | Success rate | Wilson 95% CI |
|---|---|---|---|
| 20,000 | 30/50 | 60% | [46.2%, 72.4%] |
| 40,000 | 39/50 | 78% | [64.8%, 87.2%] |
| 60,000 | 40/50 | 80% | [67.0%, 88.8%] |
| 80,000 | 43/50 | 86% | [73.8%, 93.0%] |
| 100,000 | 39/50 | 78% | [64.8%, 87.2%] |
Each checkpoint's full results (results.json, episodes.csv and rollout videos) are in eval/.
Usage
from lerobot.policies.smolvla.modeling_smolvla import SmolVLAPolicy
policy = SmolVLAPolicy.from_pretrained("tsangb34/smolvla_real_stack_red_blue_100")
- Downloads last month
- 26
Model tree for tsangb34/smolvla_real_stack_red_blue_100
Base model
HuggingFaceTB/SmolLM2-360M Quantized
HuggingFaceTB/SmolLM2-360M-Instruct Quantized
HuggingFaceTB/SmolVLM-500M-Instruct Finetuned
lerobot/smolvla_base