Upload folder using huggingface_hub
Browse files- .gitattributes +1 -0
- README.md +64 -0
- norm_stats.json +90 -0
- pi05.gguf +3 -0
- tokenizer.model +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
pi05.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- pi0.5
|
| 5 |
+
- openpi
|
| 6 |
+
- gguf
|
| 7 |
+
- quantized
|
| 8 |
+
- vla
|
| 9 |
+
base_model: zestcode5/ur3-5task-v1
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# Pi 0.5 UR3 5-task — GGUF (Q8_0 LLM + Q4_K vision + Q5_K embed)
|
| 13 |
+
|
| 14 |
+
Quantized GGUF export of `zestcode5/ur3-5task-v1` (step 6000) for inference with
|
| 15 |
+
[OmniModel.cpp](https://github.com/) Pi 0.5 C++ runtime.
|
| 16 |
+
|
| 17 |
+
## Quantization
|
| 18 |
+
|
| 19 |
+
| Component | Quant | bpw |
|
| 20 |
+
|------------------|---------|-------|
|
| 21 |
+
| Vision (SigLIP) | Q4_K | 4.55 |
|
| 22 |
+
| Embedding | Q5_K | 5.50 |
|
| 23 |
+
| PaliGemma LLM | Q8_0 | 8.50 |
|
| 24 |
+
| Action expert | F16 | 16.0 |
|
| 25 |
+
| **Total file** | mixed | **8.47** |
|
| 26 |
+
|
| 27 |
+
File size: ~3.6 GB. V+LLM avg bpw: 7.38.
|
| 28 |
+
|
| 29 |
+
## Files
|
| 30 |
+
|
| 31 |
+
- `pi05.gguf` — unified GGUF (vision + projector + LLM + action expert + embedding + norm stats).
|
| 32 |
+
- `tokenizer.model` — SentencePiece tokenizer (PaliGemma).
|
| 33 |
+
- `norm_stats.json` — action/state mean/std/q01/q99 from the UR3 5-task dataset.
|
| 34 |
+
|
| 35 |
+
## Tasks
|
| 36 |
+
|
| 37 |
+
The base model was fine-tuned on `zestcode5/ur3-merged-5tasks-v1`. Calibration excluded
|
| 38 |
+
"open the pot by removing its lid". Supported task prompts:
|
| 39 |
+
|
| 40 |
+
- `pick up the pink cylinder and place it in the orange box`
|
| 41 |
+
- `pick up the white glass and put on a brown coaster`
|
| 42 |
+
- `Remove cup from nested cups`
|
| 43 |
+
- `Single-finger push to blue marker`
|
| 44 |
+
|
| 45 |
+
## Inference
|
| 46 |
+
|
| 47 |
+
CLI:
|
| 48 |
+
|
| 49 |
+
```
|
| 50 |
+
./bin/pi05 -m /path/to/this/dir -i frame.png -p "<task prompt>" -d CUDA -s 10
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
WebSocket policy server (with the modified `serve_policy.py`):
|
| 54 |
+
|
| 55 |
+
```
|
| 56 |
+
uv run scripts/serve_policy.py policy:gguf \
|
| 57 |
+
--policy.dir=/path/to/this/dir \
|
| 58 |
+
--policy.device=CUDA --policy.steps=10 --policy.action-dim=7 \
|
| 59 |
+
--port=8000
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
Robot client uses OpenPI's `WebsocketClientPolicy` and sends an obs dict with
|
| 63 |
+
keys `observation.images.fixed`, `observation.images.cam_wrist`,
|
| 64 |
+
`observation.state` (11-dim), and `prompt`.
|
norm_stats.json
ADDED
|
@@ -0,0 +1,90 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"action_mean": [
|
| 3 |
+
-0.005246817599982023,
|
| 4 |
+
0.004768399987369776,
|
| 5 |
+
-0.0033975655678659678,
|
| 6 |
+
0.00031026932992972434,
|
| 7 |
+
0.0036542159505188465,
|
| 8 |
+
0.0013612688053399324,
|
| 9 |
+
0.5895225405693054
|
| 10 |
+
],
|
| 11 |
+
"action_std": [
|
| 12 |
+
0.01949509233236313,
|
| 13 |
+
0.024492407217621803,
|
| 14 |
+
0.027331436052918434,
|
| 15 |
+
0.023165728896856308,
|
| 16 |
+
0.020561059936881065,
|
| 17 |
+
0.011431124061346054,
|
| 18 |
+
0.49192044138908386
|
| 19 |
+
],
|
| 20 |
+
"action_q01": [
|
| 21 |
+
-0.0656973347067833,
|
| 22 |
+
-0.056118402630090714,
|
| 23 |
+
-0.06477333605289459,
|
| 24 |
+
-0.074713334441185,
|
| 25 |
+
-0.05702666565775871,
|
| 26 |
+
-0.024755600839853287,
|
| 27 |
+
0.0
|
| 28 |
+
],
|
| 29 |
+
"action_q99": [
|
| 30 |
+
0.04932233318686485,
|
| 31 |
+
0.06897439807653427,
|
| 32 |
+
0.06892666965723038,
|
| 33 |
+
0.07499333471059799,
|
| 34 |
+
0.07797999680042267,
|
| 35 |
+
0.05098506435751915,
|
| 36 |
+
0.9998000264167786
|
| 37 |
+
],
|
| 38 |
+
"state_mean": [
|
| 39 |
+
-0.506586492061615,
|
| 40 |
+
-0.039292529225349426,
|
| 41 |
+
0.05756710097193718,
|
| 42 |
+
-0.02392731048166752,
|
| 43 |
+
0.9943657517433167,
|
| 44 |
+
0.007554864976555109,
|
| 45 |
+
0.9939017295837402,
|
| 46 |
+
0.02348460629582405,
|
| 47 |
+
-0.005922637414187193,
|
| 48 |
+
0.589560866355896,
|
| 49 |
+
0.589560866355896
|
| 50 |
+
],
|
| 51 |
+
"state_std": [
|
| 52 |
+
0.06114784628152847,
|
| 53 |
+
0.08564230799674988,
|
| 54 |
+
0.05101557821035385,
|
| 55 |
+
0.08927427232265472,
|
| 56 |
+
0.025002669543027878,
|
| 57 |
+
0.04485622048377991,
|
| 58 |
+
0.02506338618695736,
|
| 59 |
+
0.08926292508840561,
|
| 60 |
+
0.0545634850859642,
|
| 61 |
+
0.49191346764564514,
|
| 62 |
+
0.49191346764564514
|
| 63 |
+
],
|
| 64 |
+
"state_q01": [
|
| 65 |
+
-0.610533595085144,
|
| 66 |
+
-0.20357808470726013,
|
| 67 |
+
-0.01586146093904972,
|
| 68 |
+
-0.4883570969104767,
|
| 69 |
+
0.8538995385169983,
|
| 70 |
+
-0.10944235324859619,
|
| 71 |
+
0.855462372303009,
|
| 72 |
+
-0.2302708476781845,
|
| 73 |
+
-0.1939956247806549,
|
| 74 |
+
0.0,
|
| 75 |
+
0.0
|
| 76 |
+
],
|
| 77 |
+
"state_q99": [
|
| 78 |
+
-0.38722988963127136,
|
| 79 |
+
0.13152354955673218,
|
| 80 |
+
0.17774000763893127,
|
| 81 |
+
0.23073768615722656,
|
| 82 |
+
0.9999415874481201,
|
| 83 |
+
0.13705167174339294,
|
| 84 |
+
0.9999417066574097,
|
| 85 |
+
0.4878247380256653,
|
| 86 |
+
0.0853947103023529,
|
| 87 |
+
0.9998000264167786,
|
| 88 |
+
0.9998000264167786
|
| 89 |
+
]
|
| 90 |
+
}
|
pi05.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:49f77bca1d8b72e7f85fcb1c692e074d06993dbd7abc42cb708985109a3429d6
|
| 3 |
+
size 3587117824
|
tokenizer.model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8986bb4f423f07f8c7f70d0dbe3526fb2316056c17bae71b1ea975e77a168fc6
|
| 3 |
+
size 4264023
|