让机器人根据任务难易动态调整沟通频率,提升人机协作效率。
Effect of Adaptive Communication Support on LLM-powered Human-Robot Collaboration
- 用大模型分层控制:协调者定战略,管理者给具体指令。
- 任务越难,越需频繁主动沟通;但过度沟通反而降低效率。
- 适合研究人机协作、智能机器人系统的开发者与研究人员。
高效的人机协作需要机器人根据人类需求、任务要求和复杂度动态调整角色与支持水平。传统人机协同常依赖预设的通信方案,限制了在复杂任务中的适应性。利用大语言模型(LLM)的强大沟通能力,我们提出多模态语言反馈的人机协同框架HRT-ML,通过调节语言反馈的频率与内容来增强交互。该框架包含两个核心模块:高层低频的协调者提供战略指导,子任务高频的管理者提供具体指令,实现与人类队友的被动与主动互动。我们在增强版Overcooked环境中进行实验,测试不同任务复杂度(简单、中等、困难)和反馈频率(无、被动、主动、超主动)下的表现。结果表明,当任务复杂度超过人类能力时,人类更偏好频繁主动支持的机器人;但当任务复杂度超出LLM处理能力时,超主动机器人的噪声和错误反馈会增加人类理解负担,导致团队性能下降。研究揭示了机器人应动态调节沟通水平与频率以实现无缝协作的通用原则。
原文摘要 · Abstract (English)
Effective human-robot collaboration requires robot to adopt their roles and levels of support based on human needs, task requirements, and complexity. Traditional human-robot teaming often relies on a pre-determined robot communication scheme, restricting teamwork adaptability in complex tasks. Leveraging strong communication capabilities of Large Language Models (LLMs), we propose a Human-Robot Teaming Framework with Multi-Modal Language feedback (HRT-ML), a framework designed to enhance human-robot interaction by adjusting the frequency and content of language-based feedback. HRT-ML framework includes two core modules: a Coordinator for high-level, low-frequency strategic guidance, and a Manager for subtask-specific, high-frequency instructions, enabling passive and active interactions with human teammates. To assess the impact of language feedback in collaborative scenarios, we conducted experiments in an enhanced Overcooked environment with varying levels of task complexity (easy, medium, hard) and feedback frequency (inactive, passive, active, superactive). Our results show that as task complexity increases relative to human capabilities, human teammates exhibited a stronger preference towards robotic agents that can offer frequent, proactive support. However, when task complexities exceed the LLM's capacity, noisy and inaccurate feedback from superactive robotic agents can instead hinder team performance, as it requires human teammates to increase their effort to interpret and respond to a large number of communications, with limited performance return. Our results offer a general principle for robotic agents to dynamically adjust their levels and frequencies of communications to work seamlessly with humans and achieve improved teaming performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。