用图模型分析画立方体动作,提升阿尔茨海默病早期筛查准确率
A Multimodal Approach to Alzheimer's Diagnosis: Geometric Insights from Cube Copying and Cognitive Assessments
- 将手绘立方体转为带几何拓扑信息的图结构,用图神经网络建模
- 图特征单独使用即优于传统像素模型,融合临床数据后分类准确率显著提升
- 识别出关键图结构模式,可解释患者画图变形的临床特征,适合医学筛查场景
阿尔茨海默病(AD)的早期可及性检测仍是重要临床挑战,而立方体复制任务能有效评估视觉空间功能。本文提出一种多模态框架,将手绘立方体草图转换为包含几何与拓扑属性的图结构表示,并融合年龄、教育程度及神经心理测试(NPT)分数进行AD分类。立方体被建模为图,节点特征包含空间坐标、基于图基元的局部拓扑和角度几何信息,经图神经网络处理后,与人口统计学和NPT特征在后期融合模型中整合。实验表明,基于图的表征已具备强单模态基准性能,显著优于基于像素的卷积模型;多模态融合进一步提升平衡分类表现与判别能力。基于SHAP的可解释性分析揭示,与角点完整性和边连续性相关的特定图基元是关键预测因子,与临床观察中AD患者画图失真的现象高度一致。这些发现确立了图基分析立方体复制行为作为可解释、非侵入且可扩展的阿尔茨海默病筛查新范式。
原文摘要 · Abstract (English)
Early and accessible detection of Alzheimer's disease (AD) remains a critical clinical challenge, and cube-copying tasks offer a simple yet informative assessment of visuospatial function. This work proposes a multimodal framework that converts hand-drawn cube sketches into graph-structured representations capturing geometric and topological properties, and integrates these features with demographic information and neuropsychological test (NPT) scores for AD classification. Cube drawings are modeled as graphs with node features encoding spatial coordinates, local graphlet-based topology, and angular geometry, which are processed using graph neural networks and fused with age, education, and NPT features in a late-fusion model. Experimental results show that graph-based representations provide a strong unimodal baseline and substantially outperform pixel-based convolutional models, while multimodal integration further improves balanced classification performance and discriminative ability. SHAP-based interpretability analysis identifies specific graphlet motifs associated with corner integrity and edge continuity as key predictors, closely aligning with clinical observations of distorted cube drawings in AD. Together, these findings establish graph-based analysis of cube-copying behavior as an interpretable, non-invasive, and scalable framework for Alzheimer's disease screening.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。