arXiv:2410.19656cs.RO2024-10CoRL被引 19

让家用机器人通过少量示范学习用户偏好并自动避障规划。

APRICOT: Active Preference Learning and Constraint-Aware Task Planning with LLMs

  • 用大模型结合主动提问,从少量示范中推断用户真实偏好。
  • 在真实场景中提升偏好满足率与计划可行性,显著优于基线方法。
  • 适合需要个性化服务的居家机器人研发与部署者参考。

家用机器人在执行个性化任务时需平衡用户偏好与环境限制。本文聚焦受限空间内的整理任务(如将物品放入冰箱),其中用户对摆放位置的偏好常与物理空间约束冲突。机器人需基于少量示范推断用户偏好,这比详尽定义所有需求更易操作。现有基于大语言模型(LLMs)的方法面临两大挑战:一是用户行为存在多重解释,难以确定真实偏好;二是并非所有偏好都可在现实环境中实现。为此,我们提出APRICOT,融合基于贝叶斯的主动偏好学习与约束感知任务规划。APRICOT通过主动向用户提问不断修正偏好假设,并动态调整计划以符合环境几何约束。我们在多样化组织任务数据集上评估该方法,实验证明其在真实场景中显著提升了偏好满足度与计划可行性。项目主页见https://portal-cornell.github.io/apricot/

原文摘要 · Abstract (English)

Home robots performing personalized tasks must adeptly balance user preferences with environmental affordances. We focus on organization tasks within constrained spaces, such as arranging items into a refrigerator, where preferences for placement collide with physical limitations. The robot must infer user preferences based on a small set of demonstrations, which is easier for users to provide than extensively defining all their requirements. While recent works use Large Language Models (LLMs) to learn preferences from user demonstrations, they encounter two fundamental challenges. First, there is inherent ambiguity in interpreting user actions, as multiple preferences can often explain a single observed behavior. Second, not all user preferences are practically feasible due to geometric constraints in the environment. To address these challenges, we introduce APRICOT, a novel approach that merges LLM-based Bayesian active preference learning with constraint-aware task planning. APRICOT refines its generated preferences by actively querying the user and dynamically adapts its plan to respect environmental constraints. We evaluate APRICOT on a dataset of diverse organization tasks and demonstrate its effectiveness in real-world scenarios, showing significant improvements in both preference satisfaction and plan feasibility. The project website is at https://portal-cornell.github.io/apricot/

机器人偏好学习大模型任务规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。