arXiv:2606.00053cs.RO2026-06

用智能体生成失败数据,自动修复视觉语言动作模型

VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis

论文配图:VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
图 1 · 摘自论文原文
  • 通过距离感知测试暴露多样失败场景,构建紧凑测试集
  • 将失败轨迹转为可执行修复动作,合成新训练数据
  • 在仿真和真实机器人上分别提升成功率49%和57.5%

视觉语言动作(VLA)模型依赖训练数据覆盖,部署后易在边缘案例中失效。为降低风险,需暴露高质量失败模式并转化为监督数据以增强模型。现有方法仅止于失败检测,缺乏修复机制。本文提出VLAMotor,首个面向VLA增强的分析框架,结合距离感知模型测试与基于智能体的数据合成。首先,基于输入与训练样本的距离估计不确定性,通过不确定性排序与冗余消除构建紧凑测试集,暴露多样化失败。随后,将失败轨迹抽象为结构化语义表示,规划参数化修复技能序列,并通过逆运动学与动作执行实现为可执行轨迹。成功轨迹自动标注后用于微调原始VLA模型,获得增强版本。在四个典型机器人操作任务上评估显示,VLAMotor生成的92.33%仿真测试用例触发VLA失败,相比现有工具提升测试覆盖率18.93%;利用失败案例合成数据微调后,整体成功率提升49.25%。在真实硬件部署中,仿真增强模型成功率相较原模型提升57.50%,验证了该方法有效且低成本。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models follow a data-driven paradigm and are constrained by the coverage of training data, making them prone to failure on edge-case configurations after deployment. To mitigate such risks, it is essential to expose high-quality failure modes and convert the resulting failures into supervisory data for model enhancement. Existing studies largely stop at failure detection and lack a mechanism for leveraging discovered failures for model repair. We propose VLAMotor, the first analysis framework for VLA enhancement, which integrates distance-aware model testing for failure exposure and agent-based data synthesis for model finetunning. First, VLAMotor estimates input uncertainty based on the distance to training samples, and combines uncertainty ranking with redundancy elimination to build compact test sets that expose diverse failures. Then, VLAMotor abstracts failure trajectories into structured semantic representations, and plans parameterized repair-skill sequences, which are then realized as executable trajectories through inverse kinematics and motion execution. The resulting successful trajectories are automatically labeled and used to fine-tune the original VLA model, yielding an enhanced VLA model. Evaluation on four representative robotic manipulation tasks shows that 92.33% of the in-simulation test cases generated by VLAMotor trigger VLA failures, and VLAMotor improves test coverage over the state-of-the-art tool by 18.93%. By fine-tuning VLA models with synthetic data derived from failed test cases, VLAMotor further enhances the overall success rate of VLA models by 49.25%. When deployed on real hardware, the simulation-enhanced models improve the success rate over the original VLA models by 57.50%, demonstrating an effective and low-cost direction for VLA enhancement.

机器人VLA模型数据增强智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。