arXiv:2509.19843cs.CVcs.RO2025-09被引 3

构建首个个性化具身智能基准,让机器人学会找特定人的物品。

PersONAL: Towards a Comprehensive Benchmark for Personalized Embodied Agents

  • 设计新基准PersONAL,让机器人根据人名找私人物品
  • 覆盖30+真实家居场景,超2000个任务片段,含明确物主关联
  • 支持未知环境导航与已知场景定位,推动家庭助手机器人发展

具身人工智能近年取得进展,能完成复杂任务并适应多样环境。但在真实以人为中心的场景(如家庭)中部署仍具挑战,尤其难以建模个体偏好与行为。本文提出PersONAL(PERSonalized Object Navigation And Localization),一个全面的个性化具身智能评测基准。该基准要求智能体识别、取回并导航至与特定用户相关的物体,响应自然语言查询如“找Lily的背包”。PersONAL包含来自HM3D数据集的30多个照片级真实家居场景中的2000多个高质量任务片段,每段均配有明确标注物主关系的自然语言场景描述,要求智能体进行用户特定语义推理。基准支持两种评估模式:(1)在未见过环境中主动导航;(2)在已映射场景中进行物体定位。基于先进基线模型的实验显示,智能体表现与人类水平存在显著差距,凸显了具身智能体在感知、推理与记忆个性化信息方面的需求,为实现真实世界助手机器人铺平道路。

原文摘要 · Abstract (English)

Recent advances in Embodied AI have enabled agents to perform increasingly complex tasks and adapt to diverse environments. However, deploying such agents in realistic human-centered scenarios, such as domestic households, remains challenging, particularly due to the difficulty of modeling individual human preferences and behaviors. In this work, we introduce PersONAL (PERSonalized Object Navigation And Localization, a comprehensive benchmark designed to study personalization in Embodied AI. Agents must identify, retrieve, and navigate to objects associated with specific users, responding to natural-language queries such as "find Lily's backpack". PersONAL comprises over 2,000 high-quality episodes across 30+ photorealistic homes from the HM3D dataset. Each episode includes a natural-language scene description with explicit associations between objects and their owners, requiring agents to reason over user-specific semantics. The benchmark supports two evaluation modes: (1) active navigation in unseen environments, and (2) object grounding in previously mapped scenes. Experiments with state-of-the-art baselines reveal a substantial gap to human performance, highlighting the need for embodied agents capable of perceiving, reasoning, and memorizing over personalized information; paving the way towards real-world assistive robot.

具身智能个性化导航家庭机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。