arXiv:2411.13797cs.CV2024-11

构建首个儿童自闭症面部动作单元数据集,揭示其表情异常特征。

Hugging Rain Man: A Novel Facial Action Units Dataset for Analyzing Atypical Facial Expressions in Children with Autism Spectrum Disorder

  • 人工标注自闭症与正常儿童的22个面部动作单元和10个描述符
  • 发现自闭症儿童在相同情绪下动作模式更不规则、更多样
  • 适合自闭症早期筛查研究者及计算机视觉分析人员

自闭症谱系障碍(ASD)儿童常表现出非典型面部表情,但其客观面部特征尚不明确。本文提出新数据集Hugging Rain Man(HRM),包含由FACS专家标注的ASD与典型发育(TD)儿童的面部动作单元(AUs),涵盖约13万帧姿态与自发表情,共22个AUs、10个动作描述符(ADs)及非典型性评分。静态图像统计分析显示,相同情绪下ASD组在多个AUs和ADs上显著异于TD组,表明其表达模式更不规则、更多样化。进一步提出时序回归方法分析动态序列的非典型性,连接主观感知与客观特征。同时提供基准AU检测结果供后续研究参考。该工作深化了对自闭症面部表达特征的理解,并为早期筛查提供潜在工具。部分数据、特征及预训练模型可于https://github.com/Jonas-DL/Hugging-Rain-Man获取。

原文摘要 · Abstract (English)

Children with Autism Spectrum Disorder (ASD) often exhibit atypical facial expressions. However, the specific objective facial features that underlie this subjective perception remain unclear. In this paper, we introduce a novel dataset, Hugging Rain Man (HRM), which includes facial action units (AUs) manually annotated by FACS experts for both children with ASD and typical development (TD). The dataset comprises a rich collection of posed and spontaneous facial expressions, totaling approximately 130,000 frames, along with 22 AUs, 10 Action Descriptors (ADs), and atypicality ratings. A statistical analysis of static images from the HRM reveals significant differences between the ASD and TD groups across multiple AUs and ADs when displaying the same emotional expressions, confirming that participants with ASD tend to demonstrate more irregular and diverse expression patterns. Subsequently, a temporal regression method was presented to analyze atypicality of dynamic sequences, thereby bridging the gap between subjective perception and objective facial characteristics. Furthermore, baseline results for AU detection are provided for future research reference. This work not only contributes to our understanding of the unique facial expression characteristics associated with ASD but also provides potential tools for ASD early screening. Portions of the dataset, features, and pretrained models are accessible at: \url{https://github.com/Jonas-DL/Hugging-Rain-Man}.

自闭症面部动作数据集行为分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。