首个评估机器人主动遵守社会规范的基准,推动机器人从被动执行转向主动合规。
RobotEQ: Transitioning from Passive Intelligence to Active Intelligence in Embodied AI

- 构建1894张第一视角图像数据集,涵盖10类56子类场景
- 现有模型在空间定位任务上表现差,准确率不足60%
- 引入外部知识库可提升性能,适合研究人机协作与伦理智能
具身智能是学术界和产业界的重要研究方向。当前研究多基于用户明确指令完成任务,但要融入人类社会,机器人需在无明确指令时理解哪些行为可为、哪些不可为。本文提出主动智能概念,区分有指导的被动智能与无指导的主动智能。为此,我们构建了首个主动智能评测基准RobotEQ:首先创建RobotEQ-Data,包含1,894张第一视角图像,覆盖10个代表性具身类别与56个子类别,通过人工标注生成4,944个动作判断题和1,157个空间定位题,明确各类场景下的合理行为。其次建立RobotEQ-Bench,评估主流模型表现。实验表明,当前模型在空间定位等任务上仍显著不足,尤其难以可靠实现主动智能;而引入RAG技术整合外部社会规范知识库可普遍提升性能。本工作助力机器人从被动指令执行向主动社会合规演进。
原文摘要 · Abstract (English)
Embodied AI is a prominent research topic in both academia and industry. Current research centers on completing tasks based on explicit user instructions. However, for robots to integrate into human society, they must understand which actions are permissible and which are prohibited, even without explicit commands. We refer to the user-guided AI as passive intelligence and the unguided AI as active intelligence. This paper introduces RobotEQ, the first benchmark for active intelligence, aiming to assess whether existing models can comprehend and adhere to social norms in embodied scenarios. First, we construct RobotEQ-Data, a dataset consisting of 1,894 egocentric images, spanning 10 representative embodied categories and 56 subcategories. Through extensive manual annotation, we provide 4,944 action judgment questions and 1,157 spatial grounding questions, specifying appropriate robot actions across diverse scenarios. Furthermore, we establish RobotEQ-Bench to evaluate the performance of state-of-the-art models on this task. Experimental results demonstrate that current models still fall short in achieving reliable active intelligence, particularly in spatial grounding. Meanwhile, leveraging RAG techniques to incorporate external social norm knowledge bases can generally enhance performance. This work can facilitate the transition of robotics from user-guided passive manipulation to active social compliance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。