arXiv:2507.18026cs.CV2025-07综述被引 8

用人体姿态识别情绪,更隐私且技术成熟

Emotion Recognition from Skeleton Data: A Comprehensive Survey

  • 按姿势和步态分类方法,提出四类技术范式
  • 梳理多个公开数据集,对比标注策略与采集方式
  • 适合关注行为分析、心理健康应用的研究者

通过身体运动识别情绪已成为一种有前景且保护隐私的替代方法,相较于依赖面部表情或生理信号的传统手段。3D骨骼数据获取技术和姿态估计算法的进步,极大提升了基于全身动作的情绪识别可行性。本综述系统性地回顾了基于骨骼数据的情绪识别技术:首先介绍情绪的心理学模型,探讨身体动作与情感表达的关系;其次总结公开可用的数据集,突出不同数据采集方式与情绪标注策略的差异;然后将现有方法分为基于姿势和基于步态的两类,从数据驱动和技术角度进行分析;特别提出一个统一分类体系,涵盖四大技术范式:传统方法、Feat2Net、FeatFusionNet 和 End2EndNet;对各类代表性工作进行评述与对比,并在常用数据集上提供基准测试结果;最后探讨情绪识别在心理健康评估中的扩展应用,如抑郁与自闭症检测,并讨论该领域当前面临的开放挑战与未来研究方向。

原文摘要 · Abstract (English)

Emotion recognition through body movements has emerged as a compelling and privacy-preserving alternative to traditional methods that rely on facial expressions or physiological signals. Recent advancements in 3D skeleton acquisition technologies and pose estimation algorithms have significantly enhanced the feasibility of emotion recognition based on full-body motion. This survey provides a comprehensive and systematic review of skeleton-based emotion recognition techniques. First, we introduce psychological models of emotion and examine the relationship between bodily movements and emotional expression. Next, we summarize publicly available datasets, highlighting the differences in data acquisition methods and emotion labeling strategies. We then categorize existing methods into posture-based and gait-based approaches, analyzing them from both data-driven and technical perspectives. In particular, we propose a unified taxonomy that encompasses four primary technical paradigms: Traditional approaches, Feat2Net, FeatFusionNet, and End2EndNet. Representative works within each category are reviewed and compared, with benchmarking results across commonly used datasets. Finally, we explore the extended applications of emotion recognition in mental health assessment, such as detecting depression and autism, and discuss the open challenges and future research directions in this rapidly evolving field.

情绪识别姿态分析心理健康综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。