arXiv:2605.01191cs.RO2026-05被引 9

Sentinel-VLA通过实时监控实现动态推理与错误自修复,提升机器人任务成功率超30%。

Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery

论文配图:Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery
图 1 · 摘自论文原文
  • 引入哨兵模块实时监控执行状态,仅在需要时触发动态推理或纠错
  • 在44个任务上自动生成260万条数据,任务成功率比SOTA模型高30%以上
  • 适合需要长期自主运行的机器人系统,尤其关注可靠性和自我进化能力

视觉-语言-动作(VLA)模型通过利用广泛的世界知识和强泛化能力,推动了具身操作的发展。然而,现有VLA模型仍面临推理能力有限、缺乏状态监控和难以自我修正等挑战。本文提出 extbf{Sentinel-VLA},一种具备元认知能力的VLA模型,配备主动“哨兵”模块以实时监控执行状态。仅在初始规划或检测到错误时,模型才会触发动态推理或制定错误恢复方案。这种按需推理机制在保证决策鲁棒性的同时,显著降低计算开销。所有训练数据(涵盖44项任务及超过260万次状态转移)均通过设计的自动化流水线生成与标注。我们还提出自演化持续学习(SECL)算法,使模型能识别自身能力边界并自动收集扩展数据,结合正交持续适配器(OC-Adapter)将参数更新限制在正交空间,有效防止灾难性遗忘。真实世界实验表明,Sentinel-VLA相比当前最优模型PI0,任务成功率提升超过30%。代码、权重及数据生成流水线将全部开源。

原文摘要 · Abstract (English)

Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning capability, lack of status monitoring, and difficulty in self-correction. In this paper, we introduce \textbf{Sentinel-VLA}, a metacognitive VLA model equipped with an active ``sentinel'' module to monitor real-time execution status. Only when necessary, such as during initial planning or upon detecting an error, the model triggers a dynamic reasoning or formulate error recovery solutions. This on-demand reasoning mechanism ensures robust decision-making while minimizing computational overhead. Notably, all training data (spanning 44 tasks and over 2.6 million transitions) is automatically generated and annotated through our designed pipeline. We also propose the Self-Evolving Continual Learning (SECL) algorithm, which allows Sentinel-VLA to identify its capability boundaries and automatically collect data for expansion, paired with Orthogonal Continual Adapter (OC-Adapter) to constrain parameter updates to an orthogonal space, thereby preventing catastrophic forgetting. Real-world experiments demonstrate that Sentinel-VLA boosts the task success rate by over 30\% compared to the SOTA model, PI0. We will open-source all the code, weights, and data generation pipeline.

机器人元认知自修复持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。