arXiv:2608.08523cs.AI2026-08

通过多样性优化发现多种规划策略,提升多模态智能体的适应性和容错能力。

Discovering Diverse Planning Policies for Multimodal Embodied Agents with Quality-Diversity Optimization

论文配图:Discovering Diverse Planning Policies for Multimodal Embodied Agents with Quality-Diversity Optimization
图 1 · 摘自论文原文
  • 用质量-多样性框架演化多种规划策略,避免单一模式失效
  • 在ThreeDWorld任务中成功率提升,交互效率更高
  • 适合需要在线纠错和长期任务的复杂智能体系统

多模态具身智能体需整合视觉、文本目标与交互历史,在闭环决策中完成长周期任务。然而现有基于大模型的规划器通常依赖单一主导规划风格,一旦失效便持续停滞,反复无效交互。本文提出一种质量-多样性(QD)框架,将规划策略模板视为可进化个体,构建行为索引档案而非单一提示风格。离线阶段,通过回放轨迹生成结构化成功与失败经验,指导策略重组与经验引导突变;策略映射到由交互强度与目标导向性定义的行为空间,每类行为保留最高质量策略。在线阶段,智能体逐个执行策略并监测进展,检测到持续停滞时回滚至最近检查点,切换至行为差异化的档案策略继续执行。在ThreeDWorld运输基准测试中,该框架显著提升任务成功率与交互效率,表明探索多样策略组合是支持自适应规划与在线故障恢复的有效路径。

原文摘要 · Abstract (English)

Multimodal embodied agents are increasingly required to solve long-horizon tasks by integrating visual observations, textual goals, and interaction history into closed-loop decision making. However, state-of-the-art large-model-based planners often rely on a single dominant planning style during execution. Once this execution mode becomes ineffective, the agent may remain stalled for many steps, repeatedly interacting with the environment without making meaningful progress. We address this limitation by proposing a Quality-Diversity (QD) framework for discovering diverse planning policies for multimodal embodied agents. The proposed method treats planning-policy templates as evolvable individuals and organizes them into a behavior-indexed archive rather than collapsing search to a single prompt style. In the offline stage, rollout trajectories are summarized into structured success and failure experiences, which guide policy variation through recombination and experience-guided mutation. The resulting policies are mapped into a behavior space defined by interaction intensity and goal-directedness, and the highest-quality policy in each niche is retained in the archive. In the online stage, the agent executes one policy at a time while monitoring task progress. When persistent stall is detected, the system rolls back to the latest checkpoint and switches to a behaviorally distinct archive policy to resume execution. Experiments on the ThreeDWorld transport benchmark show that the proposed framework improves both task success and interaction efficiency over representative baseline planners. These results suggest that discovering diverse policy repertoires is an effective way to support adaptive multimodal planning and online failure recovery.

具身智能体规划多样性质量-多样性任务容错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。