用身体姿态和表情自动判断用户对机器人满意度,无需人工打分。
Classification of User Satisfaction in HRI with Social Signals in the Wild
- 通过姿态、表情和距离的时序数据分类用户满意度
- 在46次真实场景交互中准确识别低满意度互动
- 适合需要实时反馈的机器人服务系统研发
社交互动代理(SIAs)正广泛应用于各类场景,接近实际部署。评估用户对SIA表现的满意度是设计人机交互的关键。当前主要依赖问卷或系统指标间接评估。本研究探索通过分析社会信号自动分类用户满意度,以提升人工与自主评估能力。在波恩德国博物馆的实地测试中,使用Furhat Robotics机器人作为服务信息枢纽,收集了46次单用户交互的“真实环境”数据集,包含问卷反馈与视频资料。方法基于时序分类,利用身体姿态、面部表情及物理距离的时序信号,对比三种特征工程策略在不同机器学习模型上的表现。结果表明,该方法可可靠识别低满意度交互,且无需人工标注数据。该方案为通过自动化反馈机制提升SIA性能与用户体验提供了重要潜力。
原文摘要 · Abstract (English)
Socially interactive agents (SIAs) are being used in various scenarios and are nearing productive deployment. Evaluating user satisfaction with SIAs' performance is a key factor in designing the interaction between the user and SIA. Currently, subjective user satisfaction is primarily assessed manually through questionnaires or indirectly via system metrics. This study examines the automatic classification of user satisfaction through analysis of social signals, aiming to enhance both manual and autonomous evaluation methods for SIAs. During a field trial at the Deutsches Museum Bonn, a Furhat Robotics head was employed as a service and information hub, collecting an "in-the-wild" dataset. This dataset comprises 46 single-user interactions, including questionnaire responses and video data. Our method focuses on automatically classifying user satisfaction based on time series classification. We use time series of social signal metrics derived from the body pose, time series of facial expressions, and physical distance. This study compares three feature engineering approaches on different machine learning models. The results confirm the method's effectiveness in reliably identifying interactions with low user satisfaction without the need for manually annotated datasets. This approach offers significant potential for enhancing SIA performance and user experience through automated feedback mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。