Add BitVLA LIBERO I2S GGUF components
Browse files- .gitattributes +4 -0
- README.md +54 -0
- bitvla-action-i2s.gguf +3 -0
- bitvla-llm-i2s.gguf +3 -0
- bitvla-proprio-i2s.gguf +3 -0
- bitvla-vision-i2s.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
bitvla-llm-i2s.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
bitvla-vision-i2s.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
bitvla-proprio-i2s.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
bitvla-action-i2s.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
base_model: hongyuw/ft-bitvla-bitsiglipL-224px-libero_spatial-bf16
|
| 4 |
+
tags:
|
| 5 |
+
- gguf
|
| 6 |
+
- robotics
|
| 7 |
+
- bitvla
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# BitVLA LIBERO-Spatial I2S for Robot.cpp
|
| 11 |
+
|
| 12 |
+
Four GGUF components for Robot.cpp's BitVLA runtime. The source is the author's
|
| 13 |
+
[BitVLA checkpoint](https://huggingface.co/hongyuw/ft-bitvla-bitsiglipL-224px-libero_spatial-bf16/tree/df6d27c4ad2ce10ce510c68a6fb18130752130c7),
|
| 14 |
+
revision `df6d27c4ad2ce10ce510c68a6fb18130752130c7`. This is the fine-tuned version without robotics pre-training.
|
| 15 |
+
The normalization key is `libero_spatial_no_noops`.
|
| 16 |
+
|
| 17 |
+
## Files and precision
|
| 18 |
+
|
| 19 |
+
- `bitvla-llm-i2s.gguf`
|
| 20 |
+
- `bitvla-vision-i2s.gguf`
|
| 21 |
+
- `bitvla-proprio-i2s.gguf`
|
| 22 |
+
- `bitvla-action-i2s.gguf`
|
| 23 |
+
|
| 24 |
+
The converter applies BitVLA WeightQuant in BF16, then packs 366 ternary matrices
|
| 25 |
+
as `i2s-matrix-v1`. Other tensors retain BF16/F32 storage. I2S is a Robot.cpp-specific
|
| 26 |
+
layout; these files require its patched gguf/ggml runtime, not a standalone llama.cpp CLI.
|
| 27 |
+
Use all four components from the same checkpoint.
|
| 28 |
+
|
| 29 |
+
## Run
|
| 30 |
+
|
| 31 |
+
Use [Robot.cpp with BitVLA support](https://github.com/Robot-cpp/robot.cpp/tree/cf0712c2751fdd8519de22f822b7baa1b08b5937) and apply its llama.cpp patches before building. Use a model-server binary built from this revision or a later compatible revision.
|
| 32 |
+
|
| 33 |
+
```bash
|
| 34 |
+
GGUF_DIR=/path/to/bitvla-libero-spatial-i2s
|
| 35 |
+
/path/to/model-server \
|
| 36 |
+
--model-type bitvla \
|
| 37 |
+
--llm "${GGUF_DIR}/bitvla-llm-i2s.gguf" \
|
| 38 |
+
--mmproj "${GGUF_DIR}/bitvla-vision-i2s.gguf" \
|
| 39 |
+
--state-proj "${GGUF_DIR}/bitvla-proprio-i2s.gguf" \
|
| 40 |
+
--action-expert "${GGUF_DIR}/bitvla-action-i2s.gguf" \
|
| 41 |
+
--threads 8 --host 127.0.0.1 --port 5555
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
For these LIBERO checkpoints, send two 224×224 HWC RGB uint8 images in the `full_image`, then `wrist_image` order,
|
| 45 |
+
eight raw proprio values, and a nonempty task instruction. Resize/crop images
|
| 46 |
+
according to the source checkpoint's evaluation preprocessing before sending them.
|
| 47 |
+
The runtime normalizes images/state and returns an 8×7 denormalized action chunk.
|
| 48 |
+
Robot-specific action postprocessing remains the client's responsibility.
|
| 49 |
+
|
| 50 |
+
## Validation
|
| 51 |
+
|
| 52 |
+
Release checks verify all four GGUF headers and SHA256 hashes. Uploaded file sizes
|
| 53 |
+
and SHA256 hashes are compared with the local conversion outputs. This model card
|
| 54 |
+
does not claim a new success-rate, numerical-equivalence, or latency result.
|
bitvla-action-i2s.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:63548221d4f79b6635ffd03de3569d366e0b68083be266e81920030876c3481a
|
| 3 |
+
size 118237952
|
bitvla-llm-i2s.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:473650a9499027709211971cd2eb3bcb781638b74b1e95612747dfd683fa8c0c
|
| 3 |
+
size 1187325312
|
bitvla-proprio-i2s.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b3a398f4aa7d7bc732323f358e2c5870f5973253e21a8c511fd9f42951668d52
|
| 3 |
+
size 13169536
|
bitvla-vision-i2s.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0deda233c8aa70a95ab38137d77173e0efe8f6042a66a0f1c54b41b9709a5f51
|
| 3 |
+
size 121491936
|