对比脚本化与大模型增强的机器人交互,发现后者虽体验更好,但前者效率更高。
Evaluating Efficiency and Engagement in Scripted and LLM-Enhanced Human-Robot Interactions
- 用大模型增强机器人响应,提升用户主观体验
- 脚本化交互在任务效率和专注度上表现相当甚至更优
- 适合追求稳定低延迟的工业场景使用
为实现与人类自然直观的互动,人机交互框架结合了多种感知、意图传达、环境自适应导航与协作行动方法。但在面对人类不可预测行为或环境异常时,这些框架可能缺乏动态识别、自适应与恢复能力。大语言模型(LLMs)凭借其先进的推理与上下文记忆能力,有望提升机器人适应性。然而,这种潜力未必直接转化为更好的交互指标。本文研究了一种涉及接近、指令与物体操作的典型工业机器人交互,在两种条件下进行:(1) 完全脚本化,(2) 包含大模型增强响应。通过眼动追踪与问卷调查,评估参与者的任务效率、投入度与机器人感知。结果显示,大模型条件主观评价更高,但客观指标显示脚本化条件在效率与任务专注度上表现相当,尤其在简单任务中。此外,脚本化条件在响应延迟与能耗方面更具优势,尤其适用于重复性、低复杂度的交互场景。
原文摘要 · Abstract (English)
To achieve natural and intuitive interaction with people, HRI frameworks combine a wide array of methods for human perception, intention communication, human-aware navigation and collaborative action. In practice, when encountering unpredictable behavior of people or unexpected states of the environment, these frameworks may lack the ability to dynamically recognize such states, adapt and recover to resume the interaction. Large Language Models (LLMs), owing to their advanced reasoning capabilities and context retention, present a promising solution for enhancing robot adaptability. This potential, however, may not directly translate to improved interaction metrics. This paper considers a representative interaction with an industrial robot involving approach, instruction, and object manipulation, implemented in two conditions: (1) fully scripted and (2) including LLM-enhanced responses. We use gaze tracking and questionnaires to measure the participants' task efficiency, engagement, and robot perception. The results indicate higher subjective ratings for the LLM condition, but objective metrics show that the scripted condition performs comparably, particularly in efficiency and focus during simple tasks. We also note that the scripted condition may have an edge over LLM-enhanced responses in terms of response latency and energy consumption, especially for trivial and repetitive interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。