arXiv:2512.03991cs.HCcs.RO2025-12中稿 · publication at IEE…

用人体语言判断何时开场,让机器人更自然地开启对话。

When to Say "Hi" -- Learn to Open a Conversation with an in-the-wild Dataset

  • 通过用户肢体动作训练模型识别对话启动时机。
  • 基于201次真实场景交互数据,准确判断谁是对话发起者。
  • 适合研发人机互动机器人或服务型AI的团队参考。

社交互动智能体(SIA)的社会能力是实现用户与智能体间顺畅交互的关键。成功的交互开端是令人满意交互的重要因素。在信息服务任务中,如提供地点信息,掌握对话开场时机及识别对话发起者至关重要。本文研究如何利用用户身体语言作为机器学习输入,以训练对话启动能力,确保交互流畅开始。我们提出了交互启动系统(IIS),并使用真实环境数据集进行开发、训练与验证。在波恩德国博物馆的实地测试中,采用Furhat Robotics公司生产的Furhat机器人作为服务点,共收集了N = 201次单用户交互数据用于算法训练。实验表明,IIS具备准确识别问候阶段及对话发起者的能力,证明该系统可行。

原文摘要 · Abstract (English)

The social capabilities of socially interactive agents (SIA) are a key to successful and smooth interactions between the user and the SIA. A successful start of the interaction is one of the essential factors for satisfying SIA interactions. For a service and information task in which the SIA helps with information, e.g. about the location, it is an important skill to master the opening of the conversation and to recognize which interlocutor opens the conversation and when. We are therefore investigating the extent to which the opening of the conversation can be trained using the user's body language as an input for machine learning to ensure smooth conversation starts for the interaction. In this paper we propose the Interaction Initiation System (IIS) which we developed, trained and validated using an in-the-wild data set. In a field test at the Deutsches Museum Bonn, a Furhat robot from Furhat Robotics was used as a service and information point. Over the period of use we collected the data of \textit{N} = 201 single user interactions for the training of the algorithms. We can show that the IIS, achieves a performance that allows the conclusion that this system is able to determine the greeting period and the opener of the interaction.

人机交互对话系统肢体语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。