arXiv:2607.26807cs.RO2026-07被引 1

用动作轨迹的运动学特征指导专家路由,提升视觉语言模型在机器人任务中的表现。

Route by Kinematics, Act by Observation: Kinematics-Supervised Expert Routing in MoE-Augmented VLA

论文配图:Route by Kinematics, Act by Observation: Kinematics-Supervised Expert Routing in MoE-Augmented VLA
图 1 · 摘自论文原文
  • 基于动作轨迹的运动学聚类,为路由器提供真实标签进行训练。
  • 在两个平台测试中,性能比现有方法高出20%以上。
  • 推理时仅依赖视觉语言输入,无需运动学信号,适合实际部署。

虽然MoE通过专家专精增强了视觉语言模型(VLA)的能力,但路由器因任务间动作的运动学异质性而难以有效调度专家,且推理时缺乏运动学信号。本文发现,多数语义不同的操作任务可归约为少数运动学原型。受此启发,提出运动学监督显式路由(KinRT),将原本隐式的观测驱动路由改为显式的运动学引导调度。具体而言,在训练阶段对动作轨迹进行运动学聚类,生成若干运动学一致的组别,其编号作为路由器训练的真值标签;推理时,路由器仅使用视觉-语言观测进行专家调度,不依赖任何动作运动学信息。该方法建立了一种非对称桥接机制,将训练阶段从动作空间中提炼出的任务运动学知识,转移到推理阶段的观测空间中。为进一步评估跨平台泛化能力,我们用3D打印技术自主搭建了一个成本低于2000美元的自研机器人平台(DIYRobot)。大量实验表明,与密集型及MoE增强型VLA相比,KinRT在RoboTwin基准上提升超过23.26%,在自建的DIYRobot平台上提升达20.27%。代码与平台将开源。

原文摘要 · Abstract (English)

While MoE augments VLA via expert specialization, router suffers from ineffective expert routing owing to the kinematic heterogeneity of actions across manipulation tasks and, even worse, the unavailability of the kinematic signals at inference time. In this work, we first observe that most semantically distinct manipulation tasks reduce to multiple kinematic archetypes. Motivated by this finding, we propose Kinematics-supervised explicit routing (KinRT), a new paradigm that shifts from implicit, observation-driven expert routing to explicit, kinematics-guided expert dispatching. Specifically, we perform kinematic clustering on action trajectories into multiple kinematically coherent groups, whose IDs serve as ground truth to supervise the training of the router; at inference time, the router dispatches experts only using visual-language observations, without any reliance on action kinematics. KinRT actually introduces an asymmetric bridging mechanism that distills the task kinematics from the action space in training into the observation space at inference. In addition, to assess KinRT's cross-platform generalization, we build an economical, Do-It-Yourself robot (DIYRobot) platform from scratch using 3D-print technology ($<$ 2,000USD). Extensive experiments demonstrate KinRT's superiority over both dense and MoE-featured VLAs by more than 23.26% on RoboTwin benchmark and 20.27% on our introduced DIYRobot platform. Our code and DIYRobot platform will be open-sourced.

MoE机器人专家路由运动学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。