arXiv:2602.21633cs.ROcs.AI2026-02被引 2

通过稀疏想象实现动作在线修正,提升机器人操作的自适应能力。

Self-Correcting VLA: Online Action Refinement via Sparse World Imagination

  • 用辅助预测头构建稀疏世界想象,约束策略编码短期物理演化。
  • 在线动作修正模块基于预测状态调整轨迹方向,提升任务成功率。
  • 在仿真与真实场景中均表现最优,减少16%操作步数,成功率达9%以上。

标准视觉-语言-动作(VLA)模型依赖统计数据先验,难以深入理解物理动态。强化学习虽增强物理感知,但依赖外部奖励信号,与内部状态脱节。世界动作模型融合想象与控制,实现预测规划,但依赖隐式上下文建模,缺乏显式自我改进机制。为此,我们提出自校正VLA(SC-VLA),通过稀疏想象内在引导动作优化。首先设计稀疏世界想象,引入辅助预测头以预估当前任务进展与未来轨迹趋势,从而约束策略编码短期物理演化。随后引入在线动作修正模块,重构依赖进度的密集奖励,根据预测的稀疏未来状态调整轨迹方向。在仿真基准与真实场景的复杂机器人操作任务上评估表明,SC-VLA达到最先进性能,任务吞吐量最高,比最优基线减少16%操作步数,成功率提升9%,真实实验中更获得14%的性能增益。代码已公开于 https://github.com/Kisaragi0/SC-VLA。

原文摘要 · Abstract (English)

Standard vision-language-action (VLA) models rely on fitting statistical data priors, limiting their robust understanding of underlying physical dynamics. Reinforcement learning enhances physical grounding through exploration yet typically relies on external reward signals that remain isolated from the agent's internal states. World action models have emerged as a promising paradigm that integrates imagination and control to enable predictive planning. However, they rely on implicit context modeling, lacking explicit mechanisms for self-improvement. To solve these problems, we propose Self-Correcting VLA (SC-VLA), which achieve self-improvement by intrinsically guiding action refinement through sparse imagination. We first design sparse world imagination by integrating auxiliary predictive heads to forecast current task progress and future trajectory trends, thereby constraining the policy to encode short-term physical evolution. Then we introduce the online action refinement module to reshape progress-dependent dense rewards, adjusting trajectory orientation based on the predicted sparse future states. Evaluations on challenging robot manipulation tasks from simulation benchmarks and real-world settings demonstrate that SC-VLA achieve state-of-the-art performance, yielding the highest task throughput with 16% fewer steps and a 9% higher success rate than the best-performing baselines, alongside a 14% gain in real-world experiments. Code is available at https://github.com/Kisaragi0/SC-VLA.

机器人操作自校正稀疏想象在线优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。