EvoVLA让机器人任务执行更可靠,解决虚假进展问题。
EvoVLA: Self-Evolving Vision-Language-Action Model
- 用分阶段奖励和难例对比学习避免视觉捷径
- 成功率达69.2%,比最强基线高10.2个百分点
- 适合需要长时序决策的机器人操控研究
尽管视觉-语言-动作(VLA)模型在零样本泛化和仿真到现实迁移方面取得进展,长时序机器人操作仍具挑战性。当前VLA模型存在阶段幻觉问题,即代理利用粗略评估信号绕过多步任务,报告高进展但未真正完成。我们提出EvoVLA,一个自监督VLA框架,包含三个互补组件:阶段对齐奖励(SAR),通过Gemini生成的硬负样本进行三元组对比学习以防止视觉捷径;基于位姿的对象探索(POE),将好奇心建立在物体与机械臂的相对位姿而非原始像素上;长时程记忆,通过选择性上下文保留和门控融合稳定内在激励。在包含三个多阶段任务的Discoverse-L基准测试中,EvoVLA相比最强基线OpenVLA-OFT平均任务成功率提升10.2个百分点,达69.2%。样本效率提高1.5倍,阶段幻觉率从38.5%降至14.8%。物理机器人实测平均成功率为54.6%,优于OpenVLA-OFT 11个百分点,验证了有效的仿真到现实迁移与强泛化能力。
原文摘要 · Abstract (English)
Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination, where agents exploit coarse evaluation signals to shortcut multi-step tasks, reporting high progress without truly completing them. We present EvoVLA, a self-supervised VLA framework that addresses this issue through three complementary components: Stage-Aligned Reward (SAR), which uses triplet contrastive learning with Gemini-generated hard negatives to prevent visual shortcuts; Pose-Based Object Exploration (POE), which grounds curiosity in relative object-gripper pose instead of raw pixels; and Long-Horizon Memory, which uses selective context retention and gated fusion to stabilize intrinsic shaping during extended rollouts. Extensive evaluations on Discoverse-L, a long-horizon manipulation benchmark with three multi-stage tasks, show that EvoVLA improves average task success by 10.2 percentage points over the strongest baseline (OpenVLA-OFT), reaching 69.2 percent. EvoVLA also achieves one-and-a-half times better sample efficiency and reduces stage hallucination from 38.5 percent to 14.8 percent. Real-world deployment on physical robots reaches an average success rate of 54.6 percent across four manipulation tasks, outperforming OpenVLA-OFT by 11 points, demonstrating effective sim-to-real transfer and strong generalization. Code: https://github.com/AIGeeksGroup/EvoVLA. Website: https://aigeeksgroup.github.io/EvoVLA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。