用大模型分析孩子行为文本,零样本诊断自闭症,准确率95%
Detecting Children with Autism Spectrum Disorder based on Script-Centric Behavior Understanding with Emotional Enhancement
- 将音视频转为结构化行为文本,结合情绪信息增强理解
- 2岁儿童自闭症诊断F1达95.24%,且可生成解释性理由
- 适合临床辅助诊断,尤其数据少或需解释的场景
自闭症谱系障碍(ASD)的早期诊断依赖于对儿童社交行为的系统观察。现有方法多采用监督学习,但面临诊断样本不足和结果不可解释两大挑战。本文提出一种基于脚本中心行为理解与情感增强的零样本检测框架,通过计算机视觉技术将音视频数据自动转化为结构化行为文本,利用大语言模型(LLMs)实现零样本/少样本诊断。核心贡献包括:(1)多模态脚本转录模块,将行为线索转为结构化文本表示;(2)情感文本化模块,将情绪动态编码为上下文特征以增强行为理解;(3)领域特定提示工程策略,将临床知识注入LLMs。该方法在平均年龄为两岁的儿童中实现95.24%的F1分数,并生成可解释的诊断依据。研究为利用大模型分析和理解自闭症相关人类行为提供了新路径,有助于提升辅助诊断准确性。
原文摘要 · Abstract (English)
The early diagnosis of autism spectrum disorder (ASD) is critically dependent on systematic observation and analysis of children's social behaviors. While current methodologies predominantly utilize supervised learning approaches, their clinical adoption faces two principal limitations: insufficient ASD diagnostic samples and inadequate interpretability of the detection outcomes. This paper presents a novel zero-shot ASD detection framework based on script-centric behavioral understanding with emotional enhancement, which is designed to overcome the aforementioned clinical constraints. The proposed pipeline automatically converts audio-visual data into structured behavioral text scripts through computer vision techniques, subsequently capitalizing on the generalization capabilities of large language models (LLMs) for zero-shot/few-shot ASD detection. Three core technical contributions are introduced: (1) A multimodal script transcription module transforming behavioral cues into structured textual representations. (2) An emotion textualization module encoding emotional dynamics as the contextual features to augment behavioral understanding. (3) A domain-specific prompt engineering strategy enables the injection of clinical knowledge into LLMs. Our method achieves an F1-score of 95.24\% in diagnosing ASD in children with an average age of two years while generating interpretable detection rationales. This work opens up new avenues for leveraging the power of LLMs in analyzing and understanding ASD-related human behavior, thereby enhancing the accuracy of assisted autism diagnosis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。