arXiv:2409.04598cs.CV2024-09被引 1

用视频数据提升自闭症儿童行为识别,低成本高效可行。

A Novel Dataset for Video-Based Neurodivergent Classification Leveraging Extra-Stimulatory Behavior

  • 基于视频帧与注意力图构建新数据集,捕捉神经多样性行为差异
  • 模型在儿童动作特征上表现良好,具备跨样本泛化能力
  • 适合关注行为分析、医疗辅助诊断的研究者使用

面部表情与动作对刺激的反应强度因人而异,尤其在神经多样性个体中更为明显,这些行为影响整体健康、沟通与感知处理。深度学习可被负责任地用于提升该任务的效率,帮助医疗专业人员更准确理解此类行为。本文提出 Video ASD 数据集,包含视频帧卷积特征与注意力图数据,旨在推动自闭症谱系障碍(ASD)分类研究进展。与依赖昂贵设备的近年脑成像(MRI)研究不同,本方法仅需标准计算机配置、普通摄像头和相对廉价的GPU即可完成推理。实验表明,模型能有效识别并理解儿童间动作差异,具备良好泛化性能。此外,我们测试了基础模型在此数据上的表现,揭示运动噪声对性能的影响,并强调需要更多数据与更复杂标签以提升模型可靠性。

原文摘要 · Abstract (English)

Facial expressions and actions differ among different individuals at varying degrees of intensity given responses to external stimuli, particularly among those that are neurodivergent. Such behaviors affect people in terms of overall health, communication, and sensory processing. Deep learning can be responsibly leveraged to improve productivity in addressing this task, and help medical professionals to accurately understand such behaviors. In this work, we introduce the Video ASD dataset-a dataset that contains video frame convolutional and attention map feature data-to foster further progress in the task of ASD classification. Unlike many recent studies in ASD classification with MRI data, which require expensive specialized equipment, our method utilizes a powerful but relatively affordable GPU, a standard computer setup, and a video camera for inference. Results show that our model effectively generalizes and understands key differences in the distinct movements of the children. Additionally, we test foundation models on this data to showcase how movement noise affects performance and the need for more data and more complex labels.

自闭症识别视频分析行为建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。