arXiv:2505.20640cs.CV2025-05NeurIPS被引 11

首个面向工业场景的具身问答基准,专为安全关键环境设计。

IndustryEQA: Pushing the Frontiers of Embodied Question Answering in Industrial Scenarios

  • 基于NVIDIA Isaac Sim构建高保真工业场景视频数据集
  • 包含971+373组问答对,覆盖设备/人员安全等六类标注
  • 适合研究工业级智能体感知与安全推理的学者使用

现有具身问答(EQA)基准多聚焦家庭环境,忽视了工业场景中的安全关键因素和推理需求,限制了智能体在真实工业应用中的评估。为此,我们提出IndustryEQA,首个专注于安全关键型仓库场景的EQA基准。该基准基于NVIDIA Isaac Sim平台,提供高保真情节记忆视频,涵盖多样工业资产、动态人类代理及依据真实安全规范设计的危险情境。数据集包含六类丰富标注:设备安全、人员安全、物体识别、属性识别、时序理解与空间理解,并在此基础上提供额外推理评估。共包含971个来自小型仓库和373个来自大型仓库的问答对,涵盖有无人员参与的场景。我们还提出了全面的评估框架,包含多种基线模型,以检验智能体在工业环境中的通用感知与推理能力。本基准旨在推动EQA研究向更鲁棒、更安全、更实用的工业级具身智能发展。基准与代码已开源。

原文摘要 · Abstract (English)

Existing Embodied Question Answering (EQA) benchmarks primarily focus on household environments, often overlooking safety-critical aspects and reasoning processes pertinent to industrial settings. This drawback limits the evaluation of agent readiness for real-world industrial applications. To bridge this, we introduce IndustryEQA, the first benchmark dedicated to evaluating embodied agent capabilities within safety-critical warehouse scenarios. Built upon the NVIDIA Isaac Sim platform, IndustryEQA provides high-fidelity episodic memory videos featuring diverse industrial assets, dynamic human agents, and carefully designed hazardous situations inspired by real-world safety guidelines. The benchmark includes rich annotations covering six categories: equipment safety, human safety, object recognition, attribute recognition, temporal understanding, and spatial understanding. Besides, it also provides extra reasoning evaluation based on these categories. Specifically, it comprises 971 question-answer pairs generated from small warehouse and 373 pairs from large ones, incorporating scenarios with and without human. We further propose a comprehensive evaluation framework, including various baseline models, to assess their general perception and reasoning abilities in industrial environments. IndustryEQA aims to steer EQA research towards developing more robust, safety-aware, and practically applicable embodied agents for complex industrial environments. Benchmark and codes are available.

具身问答工业智能安全推理仿真环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。