Instructions to use JerryYuu/BrickCraft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use JerryYuu/BrickCraft with LeRobot:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
File size: 3,131 Bytes
8636a56 174fa34 8636a56 174fa34 8636a56 174fa34 8636a56 174fa34 8636a56 174fa34 8636a56 174fa34 8636a56 174fa34 8636a56 174fa34 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 | ---
tags:
- brickcraft
- yolov8
- instance-segmentation
- diffusion-policy
- lerobot
- robotics
---
# BrickCraft model checkpoints
Brick Diffusion assembly policy and task-specific YOLOv8n-seg checkpoints for the single-arm BrickCraft assembly pipeline.
- [Project website](https://intelligent-control-lab.github.io/BrickCraft/)
- [Paper](https://arxiv.org/abs/2605.07605)
## Included checkpoints
| Path | Purpose | Class IDs |
| --- | --- | --- |
| `brickcraft_diffusion/pretrained_model/` | Predict end-effector pose and gripper actions for single-step assembly and the assembly skill in long-horizon execution | Not applicable |
| `yolo/seg_structure.pt` | Segment the assembled brick structure for scene alignment | `0: object` |
| `yolo/seg_brick_gripper.pt` | Segment the target brick and gripper | `0: brick`, `1: gripper` |
See [the YOLO checkpoint notes](yolo/README.md) for loading instructions and provenance. The checkpoint metadata records Ultralytics version `8.4.8`; packaging did not include a compatibility test with other versions.
See [the Brick Diffusion checkpoint notes](brickcraft_diffusion/README.md) for the policy's functionality, inputs, and outputs. Keep its saved preprocessing and postprocessing files with the weights.
## Download
```bash
hf download JerryYuu/BrickCraft --local-dir ./models/BrickCraft
```
From the BrickCraft code repository root, configure:
```json
{
"yolo_seg_structure_ckpt": "./models/BrickCraft/yolo/seg_structure.pt",
"yolo_seg_brick_gripper_ckpt": "./models/BrickCraft/yolo/seg_brick_gripper.pt"
}
```
For reproducibility, pin `--revision` to the model repository commit used in your experiment.
For policy inference, set the assembly controller's `pretrained_path` to `./models/BrickCraft/brickcraft_diffusion/pretrained_model`. See the [project website](https://intelligent-control-lab.github.io/BrickCraft/) for usage resources.
## Scope and verification
This repository contains the two YOLO checkpoints and the Brick Diffusion policy. SAM-2 is not included. These files alone do not provide the complete robot execution stack. The policy supplies the assembly skill; the long-horizon pipeline uses a separate scripted pick skill. Skill failures still require a human decision.
Policy weights, model configuration, processor files, and YOLO checkpoints are preserved without modification. The policy training configuration uses release names for its dataset path, output directory, and job name; other fields are unchanged. Unmodified policy files were compared with their source using SHA256, and their JSON configuration, processor state references, and safetensors headers were checked. The YOLO files retain their earlier ZIP archive integrity checks. `SHA256SUMS` covers the included files. Inference accuracy, CUDA execution, and physical robot operation were not tested during this packaging step.
## License
The YOLO checkpoints retain their AGPL-3.0 notice; see [LICENSE](yolo/LICENSE) and the [YOLO checkpoint notes](yolo/README.md). The Brick Diffusion checkpoint's saved configuration does not specify a model license (`license: null`).
|