arXiv:2511.13530cs.ROcs.AI2025-11中稿 · the Workshop on Be…

构建社交焦虑人机交互多模态数据集,助力情感自适应机器人研究

Towards Affect-Adaptive Human-Robot Interaction: A Protocol for Multimodal Dataset Collection on Social Anxiety

  • 设计可控实验协议,采集70+参与者与机器人互动的音视频生理数据
  • 通过10分钟角色扮演任务获取多模态数据,按焦虑程度分组分析
  • 适合研究社交焦虑、情感计算与人机交互的学者与开发者使用

社交焦虑是一种常见障碍,影响人际互动与社会功能。人工智能与社交机器人的发展为在人机交互中研究社交焦虑提供了新可能。准确识别与社交焦虑相关的情感状态和行为,需依赖多模态数据,各模态信号可互补揭示其表现。然而此类数据仍稀缺,制约了研究与应用进展。为此,本文提出一种多模态数据采集协议,旨在反映人机交互中的社交焦虑。数据集将包含至少70名参与者的同步音频、视频与生理信号,这些参与者根据社交焦虑水平分组,在受控条件下与Furhat社交机器人进行约10分钟的“巫师奥兹”式角色扮演互动。除多模态数据外,还将加入情境信息以深化对个体差异的理解。该工作将支持情感自适应人机交互研究,推动社交焦虑的鲁棒多模态检测。

原文摘要 · Abstract (English)

Social anxiety is a prevalent condition that affects interpersonal interactions and social functioning. Recent advances in artificial intelligence and social robotics offer new opportunities to examine social anxiety in the human-robot interaction context. Accurate detection of affective states and behaviours associated with social anxiety requires multimodal datasets, where each signal modality provides complementary insights into its manifestations. However, such datasets remain scarce, limiting progress in both research and applications. To address this, this paper presents a protocol for multimodal dataset collection designed to reflect social anxiety in a human-robot interaction context. The dataset will consist of synchronised audio, video, and physiological recordings acquired from at least 70 participants, grouped according to their level of social anxiety, as they engage in approximately 10-minute interactive Wizard-of-Oz role-play scenarios with the Furhat social robot under controlled experimental conditions. In addition to multimodal data, the dataset will be enriched with contextual data providing deeper insight into individual variability in social anxiety responses. This work can contribute to research on affect-adaptive human-robot interaction by providing support for robust multimodal detection of social anxiety.

社交焦虑多模态数据人机交互情感计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。