lxsy commited on
Commit
a8f42e7
·
verified ·
1 Parent(s): dc37f05

Add BitVLA LIBERO I2S GGUF components

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ bitvla-llm-i2s.gguf filter=lfs diff=lfs merge=lfs -text
37
+ bitvla-vision-i2s.gguf filter=lfs diff=lfs merge=lfs -text
38
+ bitvla-proprio-i2s.gguf filter=lfs diff=lfs merge=lfs -text
39
+ bitvla-action-i2s.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: hongyuw/ft-bitvla-bitsiglipL-224px-libero_spatial-bf16
4
+ tags:
5
+ - gguf
6
+ - robotics
7
+ - bitvla
8
+ ---
9
+
10
+ # BitVLA LIBERO-Spatial I2S for Robot.cpp
11
+
12
+ Four GGUF components for Robot.cpp's BitVLA runtime. The source is the author's
13
+ [BitVLA checkpoint](https://huggingface.co/hongyuw/ft-bitvla-bitsiglipL-224px-libero_spatial-bf16/tree/df6d27c4ad2ce10ce510c68a6fb18130752130c7),
14
+ revision `df6d27c4ad2ce10ce510c68a6fb18130752130c7`. This is the fine-tuned version without robotics pre-training.
15
+ The normalization key is `libero_spatial_no_noops`.
16
+
17
+ ## Files and precision
18
+
19
+ - `bitvla-llm-i2s.gguf`
20
+ - `bitvla-vision-i2s.gguf`
21
+ - `bitvla-proprio-i2s.gguf`
22
+ - `bitvla-action-i2s.gguf`
23
+
24
+ The converter applies BitVLA WeightQuant in BF16, then packs 366 ternary matrices
25
+ as `i2s-matrix-v1`. Other tensors retain BF16/F32 storage. I2S is a Robot.cpp-specific
26
+ layout; these files require its patched gguf/ggml runtime, not a standalone llama.cpp CLI.
27
+ Use all four components from the same checkpoint.
28
+
29
+ ## Run
30
+
31
+ Use [Robot.cpp with BitVLA support](https://github.com/Robot-cpp/robot.cpp/tree/cf0712c2751fdd8519de22f822b7baa1b08b5937) and apply its llama.cpp patches before building. Use a model-server binary built from this revision or a later compatible revision.
32
+
33
+ ```bash
34
+ GGUF_DIR=/path/to/bitvla-libero-spatial-i2s
35
+ /path/to/model-server \
36
+ --model-type bitvla \
37
+ --llm "${GGUF_DIR}/bitvla-llm-i2s.gguf" \
38
+ --mmproj "${GGUF_DIR}/bitvla-vision-i2s.gguf" \
39
+ --state-proj "${GGUF_DIR}/bitvla-proprio-i2s.gguf" \
40
+ --action-expert "${GGUF_DIR}/bitvla-action-i2s.gguf" \
41
+ --threads 8 --host 127.0.0.1 --port 5555
42
+ ```
43
+
44
+ For these LIBERO checkpoints, send two 224×224 HWC RGB uint8 images in the `full_image`, then `wrist_image` order,
45
+ eight raw proprio values, and a nonempty task instruction. Resize/crop images
46
+ according to the source checkpoint's evaluation preprocessing before sending them.
47
+ The runtime normalizes images/state and returns an 8×7 denormalized action chunk.
48
+ Robot-specific action postprocessing remains the client's responsibility.
49
+
50
+ ## Validation
51
+
52
+ Release checks verify all four GGUF headers and SHA256 hashes. Uploaded file sizes
53
+ and SHA256 hashes are compared with the local conversion outputs. This model card
54
+ does not claim a new success-rate, numerical-equivalence, or latency result.
bitvla-action-i2s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63548221d4f79b6635ffd03de3569d366e0b68083be266e81920030876c3481a
3
+ size 118237952
bitvla-llm-i2s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:473650a9499027709211971cd2eb3bcb781638b74b1e95612747dfd683fa8c0c
3
+ size 1187325312
bitvla-proprio-i2s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3a398f4aa7d7bc732323f358e2c5870f5973253e21a8c511fd9f42951668d52
3
+ size 13169536
bitvla-vision-i2s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0deda233c8aa70a95ab38137d77173e0efe8f6042a66a0f1c54b41b9709a5f51
3
+ size 121491936