让机器人提前猜到主人意图,自动规划帮忙动作。
ProVox: Personalization and Proactive Planning for Situated Human-Robot Collaboration
- 用个性化提示让机器人理解用户偏好和意图
- 任务完成快38.7%,用户指令负担降31.9%
- 适合需要主动协作的居家服务场景
协作机器人需快速适应人类伙伴的意图与偏好,以主动识别有益行为。在情境化设置中,人类可通过示范持续教机器人新行为、视觉概念与物理技能,使机器人能力随合作不断增长。本文提出ProVox(主动语音)框架,使机器人能从早期互动中推断用户目标,并基于当前上下文与自身能力预判用户需求,主动规划行动,减少显式指令。通过大语言模型的常识先验与可引导性,设计元提示协议,让用户在交互前表达个人偏好与期望行为。系统据此生成个性化提示,驱动主动语言模型任务规划器,预测用户意图并建议帮助动作,显著降低用户负担。在家庭操作任务(如组装午餐袋)的用户研究中,结果表明:元提示与主动性均至关重要,相比非主动基线,任务完成时间缩短38.7%,用户负担减少31.9%。补充材料、代码与视频见https://provox-2025.github.io。
原文摘要 · Abstract (English)
Collaborative robots must quickly adapt to their partner's intent and preferences to proactively identify helpful actions. This is especially true in situated settings where human partners can continually teach robots new high-level behaviors, visual concepts, and physical skills (e.g., through demonstration), growing the robot's capabilities as the human-robot pair work together to accomplish diverse tasks. In this work, we argue that robots should be able to infer their partner's goals from early interactions and use this information to proactively plan behaviors ahead of explicit instructions from the user. Building from the strong commonsense priors and steerability of large language models, we introduce ProVox ("Proactive Voice"), a novel framework that enables robots to efficiently personalize and adapt to individual collaborators. We design a meta-prompting protocol that empowers users to communicate their distinct preferences, intent, and expected robot behaviors ahead of starting a physical interaction. ProVox then uses the personalized prompt to condition a proactive language model task planner that anticipates a user's intent from the current interaction context and robot capabilities to suggest helpful actions; in doing so, we alleviate user burden, minimizing the amount of time partners spend explicitly instructing and supervising the robot. We evaluate ProVox through user studies grounded in household manipulation tasks (e.g., assembling lunch bags) that measure the efficiency of the collaboration, as well as features such as perceived helpfulness, ease of use, and reliability. Our analysis suggests that both meta-prompting and proactivity are critical, resulting in 38.7% faster task completion times and 31.9% less user burden relative to non-active baselines. Supplementary material, code, and videos can be found at https://provox-2025.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。