用物理规律辅助识别自闭症严重程度,提升诊断准确性。
Physics Augmented Tuple Transformer for Autism Severity Level Detection
- 引入物理法则约束骨骼运动预测,增强行为模式建模
- 在多个自闭症诊断数据集上达到顶尖性能
- 方法可扩展至跌倒预测等其他动作分析任务
自闭症谱系障碍(ASD)的早期诊断对改善患儿健康与福祉至关重要。传统人工诊断耗时费力、易受干扰因素影响。本文提出一种新型框架,利用物理规律进行自闭症严重程度识别。所提物理信息神经网络将基于骨架运动轨迹提取的受试者行为编码至高维潜在空间。设计两个解码器:物理驱动解码器在预测中融入骨骼序列的物理规律,非物理解码器则最小化预测与实际运动差异。分类器同样基于该潜在空间嵌入实现自闭症严重程度判别。双生成目标显式对比个体行为与符合物理规律的正常儿童行为,助力识别。该方法在多个自闭症诊断基准上表现优异,并在公开跌倒预测数据集上验证了其泛化能力。
原文摘要 · Abstract (English)
Early diagnosis of Autism Spectrum Disorder (ASD) is an effective and favorable step towards enhancing the health and well-being of children with ASD. Manual ASD diagnosis testing is labor-intensive, complex, and prone to human error due to several factors contaminating the results. This paper proposes a novel framework that exploits the laws of physics for ASD severity recognition. The proposed physics-informed neural network architecture encodes the behaviour of the subject extracted by observing a part of the skeleton-based motion trajectory in a higher dimensional latent space. Two decoders, namely physics-based and non-physics-based decoder, use this latent embedding and predict the future motion patterns. The physics branch leverages the laws of physics that apply to a skeleton sequence in the prediction process while the non-physics-based branch is optimised to minimise the difference between the predicted and actual motion of the subject. A classifier also leverages the same latent space embeddings to recognise the ASD severity. This dual generative objective explicitly forces the network to compare the actual behaviour of the subject with the general normal behaviour of children that are governed by the laws of physics, aiding the ASD recognition task. The proposed method attains state-of-the-art performance on multiple ASD diagnosis benchmarks. To illustrate the utility of the proposed framework beyond the task ASD diagnosis, we conduct a third experiment using a publicly available benchmark for the task of fall prediction and demonstrate the superiority of our model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。