arXiv:2410.03488cs.RO2024-10NeurIPS被引 12

提出细粒度属性探索机制,让机器人更智能地满足多重需求。

MO-DDN: A Coarse-to-Fine Attribute-based Exploration Agent for Multi-object Demand-driven Navigation

  • 分阶段利用属性信息,先粗后细规划搜索路径。
  • 在多目标场景下,定位准确率显著优于传统方法。
  • 适合研究具身智能与个性化任务的开发者参考。

满足日常需求是人类生活的基本部分。随着具身人工智能的发展,机器人越来越能完成人类需求。需求驱动导航(DDN)要求智能体根据指令如“我渴了”找到对应物品。以往研究通常假设每条指令仅需一个物品且忽略个人偏好,但真实需求可能涉及多个物品。本文提出多对象需求驱动导航(MO-DDN)基准,涵盖多目标搜索与个性化偏好,使任务更贴近真实场景。在此基础上,我们引入“属性”概念,但不同于端到端依赖属性特征的旧方法,提出一种模块化粗到精属性探索代理(C2FAgent)。实验表明,该分阶段策略在不同决策层级有效利用属性优势,性能超越基线方法。代码与视频见 https://sites.google.com/view/moddn。

原文摘要 · Abstract (English)

The process of satisfying daily demands is a fundamental aspect of humans' daily lives. With the advancement of embodied AI, robots are increasingly capable of satisfying human demands. Demand-driven navigation (DDN) is a task in which an agent must locate an object to satisfy a specified demand instruction, such as ``I am thirsty.'' The previous study typically assumes that each demand instruction requires only one object to be fulfilled and does not consider individual preferences. However, the realistic human demand may involve multiple objects. In this paper, we introduce the Multi-object Demand-driven Navigation (MO-DDN) benchmark, which addresses these nuanced aspects, including multi-object search and personal preferences, thus making the MO-DDN task more reflective of real-life scenarios compared to DDN. Building upon previous work, we employ the concept of ``attribute'' to tackle this new task. However, instead of solely relying on attribute features in an end-to-end manner like DDN, we propose a modular method that involves constructing a coarse-to-fine attribute-based exploration agent (C2FAgent). Our experimental results illustrate that this coarse-to-fine exploration strategy capitalizes on the advantages of attributes at various decision-making levels, resulting in superior performance compared to baseline methods. Code and video can be found at https://sites.google.com/view/moddn.

具身智能多目标导航属性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。