arXiv:2507.12846cs.ROcs.AI2025-07被引 20

让机器人像人一样用记忆宫殿存取经验,主动找答案。

Enter the Mind Palace: Reasoning and Planning for Long-term Active Embodied Question Answering

  • 用场景图结构存储记忆,支持精准回忆和导航规划
  • 通过信息价值判断何时停止探索,提升回答准确率
  • 适合长期工作的机器人系统,尤其在复杂环境需持续学习

随着机器人在数日、数周乃至数月的长时间任务中愈发成熟,它们需积累环境知识并据此更有效地辅助人类。本文提出长时主动具身问答(LA-EQA)任务,要求机器人结合过往经历与主动探索,回答具有时间锚定的复杂问题。不同于传统问答仅关注当前环境或单一历史记录,LA-EQA需推理过去、现在及未来可能状态,并决策何时探索、何时调用记忆、何时给出最终答案。现有基于大模型的方法因上下文窗口有限、缺乏持久记忆、无法融合记忆与探索而表现不佳。为此,我们受认知科学中‘记忆宫殿’启发,构建结构化记忆系统:将情景经验编码为基于场景图的世界实例,形成可支持目标记忆检索与引导导航的推理规划算法。为平衡探索与回忆,引入基于信息价值的停止标准,判断是否已获取足够信息。我们在真实世界实验中评估方法,并构建新基准涵盖主流仿真环境与实际工业场所。结果表明,该方法显著优于当前最佳基线,在答案准确率与探索效率上均有大幅提升。

原文摘要 · Abstract (English)

As robots become increasingly capable of operating over extended periods -- spanning days, weeks, and even months -- they are expected to accumulate knowledge of their environments and leverage this experience to assist humans more effectively. This paper studies the problem of Long-term Active Embodied Question Answering (LA-EQA), a new task in which a robot must both recall past experiences and actively explore its environment to answer complex, temporally-grounded questions. Unlike traditional EQA settings, which typically focus either on understanding the present environment alone or on recalling a single past observation, LA-EQA challenges an agent to reason over past, present, and possible future states, deciding when to explore, when to consult its memory, and when to stop gathering observations and provide a final answer. Standard EQA approaches based on large models struggle in this setting due to limited context windows, absence of persistent memory, and an inability to combine memory recall with active exploration. To address this, we propose a structured memory system for robots, inspired by the mind palace method from cognitive science. Our method encodes episodic experiences as scene-graph-based world instances, forming a reasoning and planning algorithm that enables targeted memory retrieval and guided navigation. To balance the exploration-recall trade-off, we introduce value-of-information-based stopping criteria that determines when the agent has gathered sufficient information. We evaluate our method on real-world experiments and introduce a new benchmark that spans popular simulation environments and actual industrial sites. Our approach significantly outperforms state-of-the-art baselines, yielding substantial gains in both answer accuracy and exploration efficiency.

具身智能长期记忆主动探索机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。