VLA模型在关节级故障下易失效,新方法可自适应校准动作提升鲁棒性。
Uncovering Vulnerability of Vision-Language-Action Models under Joint-Level Physical Faults

- 基于关节动态推断故障状态,用轻量残差校准器自适应修正动作
- 关节摩擦增大会导致任务成功率显著下降,即使动作仍物理可行
- 无需重新训练,适配真实机器人部署中的硬件退化场景
将视觉-语言-动作(VLA)模型部署于真实机器人系统时,需应对不仅限于语义与感知变化的本体侧故障,尤其是由执行器退化、硬件故障、安全限制、碰撞损伤或磨损引起的关节级变化。这些故障会改变策略的动作-运动接口,破坏命令动作、实际运动与后续观测间的闭环关系。本文研究真实关节级故障,揭示VLA模型在通过有缺陷机器人执行预测动作时存在脆弱性。分析显示故障影响具有关节依赖性,不同关节退化对任务成功率的影响差异显著。此外,性能下降并非仅因物理不可行——如增加关节摩擦等可行故障仍会大幅降低成功率并引发闭环执行偏差。为此,我们提出联合级物理故障感知残差校准器(J-PARC),该框架在冻结的VLA策略上构建,通过近期关节动力学推断潜在故障模式,并以该模式为条件激活共享残差校准器,实现对故障关节的自适应动作修正。实验表明,J-PARC在保持无故障环境性能的同时,显著提升了关节级故障下的鲁棒性。
原文摘要 · Abstract (English)
Deploying Vision-Language-Action (VLA) models in real robotic systems requires robustness not only to semantic and perceptual variations, but also to embodiment-side faults that change how actions are physically realized. Real robots can experience joint-level changes caused by actuator degradation, hardware faults, safety limits, collision damage, or wear-induced friction. These faults are critical because they alter the action-to-motion interface of a policy, disrupting the learned closed-loop relationship between commanded actions, realized motion, and subsequent observations. In this work, we study realistic joint-level physical faults and show that VLA models are vulnerable when predicted actions are executed through a perturbed robot body. Our analysis reveals joint-dependent effects, with heterogeneous degradation in task success across affected joints. We also show that performance drops cannot be attributed solely to physical infeasibility, since feasible faults such as increased joint friction can still substantially reduce success rates and induce closed-loop execution mismatch. Motivated by these findings, we propose Joint-level Physical-fault Aware Residual Calibrator (J-PARC), a lightweight residual calibration framework built on top of a frozen VLA policy. J-PARC infers a latent joint-fault regime from recent joint dynamics and conditions a shared residual calibrator on this regime, enabling adaptive action correction across faulty joints. Experiments show that J-PARC improves robustness under joint-level faults while preserving fault-free environment performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。