Papers
arxiv:2609.24433

FoldQuantVLA: Native Low-Bit Quantization of Vision-Language-Action Models via Consistent Folding

Published on Sep 21
Authors:
,
,
,
,
,
,

Abstract

FoldQuantVLA accelerates vision-language-action inference via 4-bit quantization with selective 8-bit retention, improving robot task success and reducing latency on edge and desktop GPUs.

Low-bit vision-language-action inference must reduce observation-to-action latency while preserving robot behavior. We present FoldQuantVLA, a post-training quantization framework that carries a consistent activation representation through calibration, weight rounding, and native integer execution. It combines channel scaling and block Hadamard transforms with dynamic per-token quantization, without policy retraining. Custom TensorRT plugins execute projections in both the language backbone and iterative action expert with four-bit weights and activations (W4A4) on Ada GPUs and Jetson AGX Orin. Evaluation spans LIBERO, SimplerEnv, and two robot platforms. Across three GR00T checkpoints and π_{0.5}, W4A4 achieves 1.20 to 1.33times speedups over floating-point TensorRT on Orin and 1.25 to 1.52times on desktop. Retaining language attention-output and feed-forward down projections at eight bits (W8A8) improves held-out action fidelity on all four checkpoints. Across four real-robot tasks, this configuration raises observed GR00T N1.7 success from 80.0% with uniform W4A4 to 92.5% over 80 trials per configuration, with a measured additional Orin latency of 1 ms.

Community

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2609.24433
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2609.24433 in a model README.md to link it from this page.

Datasets citing this paper 1

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2609.24433 in a Space README.md to link it from this page.

Collections including this paper 1