Spatial Representation Distillation and Knowledge Routing for Vision-Language-Action Models
SPARK-VLA distils a frozen 3D expert into a LoRA visual branch beside the original one, and a small router passes only action-relevant tokens to a 0.5B LLM. No 3D input at inference; ~53M trainable parameters.SPARK-VLA 把冻结的 3D 专家蒸馏到与原视觉通路并行的 LoRA 分支，并用轻量路由器只把与动作相关的视觉 token 送入 0.5B 语言模型。推理时无需 3D 输入，可训练参数约 5300 万。
BibTeX
@misc{park2026spatial,
title = {{Spatial Representation Distillation and Knowledge Routing for Vision-Language-Action Models}},
author = {Jungin Park and Chaoran Zhu and Changjae Oh and Kwanghoon Sohn},
year = {2026},
eprint = {2611.10443},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.10443},
}