arXiv:2503.11117cs.CV2025-03ICCV被引 34

新基准让机器人更会探索,回答问题更准。

Beyond the Destination: A Novel Benchmark for Exploration-Aware Embodied Question Answering

  • 融合前沿探索与目标导向,提升环境探索效率
  • 构建777条轨迹、2044个问答对的大型评测集
  • 提出新评估指标,确保回答与探索一致

具身问答(EQA)是具身智能中的挑战性任务,要求智能体在3D环境中动态探索、主动获取视觉信息并进行多步推理以回答问题。然而现有方法在探索效率、数据集设计和评估指标方面存在严重局限。现有数据集常引入偏见或先验知识,导致非具身推理;基于前沿的探索策略在复杂环境中表现不佳,难以实现对任务相关区域的细粒度探索。为此,我们构建了专门用于评估探索与推理能力的大型基准数据集——EXPRESS-Bench,包含777条探索轨迹和2,044个问题-轨迹配对。为提升探索效率,我们提出Fine-EQA,一种结合前沿探索与目标导向导航的混合模型,更有效地引导智能体前往任务相关区域。此外,我们引入新颖的评估指标——探索-答案一致性(EAC),通过衡量答案定位与探索可靠性的一致性,实现更真实的评估。与先进EQA模型的大量实验对比表明,EXPRESS-Bench能有效推动具身探索与问答推理的发展。

原文摘要 · Abstract (English)

Embodied Question Answering (EQA) is a challenging task in embodied intelligence that requires agents to dynamically explore 3D environments, actively gather visual information, and perform multi-step reasoning to answer questions. However, current EQA approaches suffer from critical limitations in exploration efficiency, dataset design, and evaluation metrics. Moreover, existing datasets often introduce biases or prior knowledge, leading to disembodied reasoning, while frontier-based exploration strategies struggle in cluttered environments and fail to ensure fine-grained exploration of task-relevant areas. To address these challenges, we construct the EXPloration-awaRe Embodied queStion anSwering Benchmark (EXPRESS-Bench), the largest dataset designed specifically to evaluate both exploration and reasoning capabilities. EXPRESS-Bench consists of 777 exploration trajectories and 2,044 question-trajectory pairs. To improve exploration efficiency, we propose Fine-EQA, a hybrid exploration model that integrates frontier-based and goal-oriented navigation to guide agents toward task-relevant regions more effectively. Additionally, we introduce a novel evaluation metric, Exploration-Answer Consistency (EAC), which ensures faithful assessment by measuring the alignment between answer grounding and exploration reliability. Extensive experimental comparisons with state-of-the-art EQA models demonstrate the effectiveness of our EXPRESS-Bench in advancing embodied exploration and question reasoning.

具身智能探索增强问答系统3D导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。