arXiv:2605.12620cs.AI2026-05被引 2

让智能体先验证再行动,提升复杂任务中的可靠性。

Think Twice, Act Once: Verifier-Guided Action Selection For Embodied Agents

论文配图:Think Twice, Act Once: Verifier-Guided Action Selection For Embodied Agents
图 1 · 摘自论文原文
  • 推理时采样多个动作,用生成式验证器选最优解。
  • 在复杂任务上相比强基线提升最高36%的性能。
  • 适合需要高鲁棒性的机器人决策场景。

构建能解决复杂现实任务的通用具身智能体仍是人工智能的核心挑战。多模态大语言模型(MLLM)通过强大的视觉-语言知识和思维链(CoT)推理显著提升了智能体的推理能力,但在面对分布外的挑战性场景时仍显脆弱。为此,我们提出验证器引导的动作选择(VeGAS)框架,在测试阶段通过显式验证步骤增强基于MLLM的具身智能体的鲁棒性。推理时,不直接执行单一解码动作,而是采样一组候选动作,并利用生成式验证器识别最可靠的选项,无需修改底层策略。关键发现是:直接使用现成的MLLM作为验证器无法带来提升,因此我们提出由大语言模型驱动的数据合成策略,自动构建多样化的失败案例课程,使验证器在训练阶段接触丰富多样的潜在错误分布。在Habitat与ALFRED环境的多个具身推理基准测试中,VeGAS持续提升泛化能力,在最复杂的多物体、长序列任务上,相对于强基线实现高达36%的相对性能提升。

原文摘要 · Abstract (English)

Building generalist embodied agents capable of solving complex real-world tasks remains a fundamental challenge in AI. Multimodal Large Language Models (MLLMs) have significantly advanced the reasoning capabilities of such agents through strong vision-language knowledge and chain-of-thought (CoT) reasoning, yet remain brittle when faced with challenging out-of-distribution scenarios. To address this, we propose Verifier-Guided Action Selection (VegAS), a test-time framework designed to improve the robustness of MLLM-based embodied agents through an explicit verification step. At inference time, rather than committing to a single decoded action, VeGAS samples an ensemble of candidate actions and uses a generative verifier to identify the most reliable choice, without modifying the underlying policy. Crucially, we find that using an MLLM off-the-shelf as a verifier yields no improvement, motivating our LLM-driven data synthesis strategy, which automatically constructs a diverse curriculum of failure cases to expose the verifier to a rich distribution of potential errors at training time. Across embodied reasoning benchmarks spanning the Habitat and ALFRED environments, VeGAS consistently improves generalization, achieving up to a 36% relative performance gain over strong CoT baselines on the most challenging multi-object, long-horizon tasks.

具身智能推理优化验证机制多模态模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。