arXiv:2509.22168cs.HCcs.AI2025-09

用全身动作与AI共舞,让情绪表达更包容、更自主。

Teaching AI to Feel: A Collaborative, Full-Body Exploration of Emotive Communication

  • 通过全身动作捕捉与AI实时反馈,实现情感共演
  • 采用多推荐系统动态分析情绪状态并生成视听响应
  • 适合交互设计、情感计算与人机协同研究者

Commonaiverse 是一个互动装置,通过全身动作追踪与实时AI反馈探索人类情感。参与者经历教学、探索与宇宙阶段,与系统共同表达和解读情绪。系统融合 MoveNet 实现精准动作捕捉,并使用多推荐器AI系统动态分析情绪状态,生成自适应音视频输出。相比传统的自上而下情绪分类,本研究转向由用户主导、文化多元的情感定义,为包容性、伦理化情感计算开辟新路径。该协作式、非典型范式推动多媒体研究从单用户面部分析迈向更具身体性与共创性的智能情感交互。同时反思此框架如何增强用户自主性、降低偏见,并拓展高级交互应用的可能。

原文摘要 · Abstract (English)

Commonaiverse is an interactive installation exploring human emotions through full-body motion tracking and real-time AI feedback. Participants engage in three phases: Teaching, Exploration and the Cosmos Phase, collaboratively expressing and interpreting emotions with the system. The installation integrates MoveNet for precise motion tracking and a multi-recommender AI system to analyze emotional states dynamically, responding with adaptive audiovisual outputs. By shifting from top-down emotion classification to participant-driven, culturally diverse definitions, we highlight new pathways for inclusive, ethical affective computing. We discuss how this collaborative, out-of-the-box approach pushes multimedia research beyond single-user facial analysis toward a more embodied, co-created paradigm of emotional AI. Furthermore, we reflect on how this reimagined framework fosters user agency, reduces bias, and opens avenues for advanced interactive applications.

情感计算人机交互全身追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。