通过分析叙事话题演变与图文一致性,提升神经认知障碍早期检测精度。
Detecting Neurocognitive Disorders through Analyses of Topic Evolution and Cross-modal Consistency in Visual-Stimulated Narratives
- 用动态主题模型追踪话题随时间变化,捕捉高层认知线索。
- 图文时间对齐网络在三数据集上最高达0.8889的F1值。
- 话题变异率等宏观特征比词汇多样性更关键,适合临床研究者参考。
神经认知障碍(NCD)的早期检测对及时干预至关重要。语言障碍在NCD进展早期即显现,视觉刺激叙事(VSN)分析为此提供了有前景的途径。现有方法多关注词汇多样性等底层语言微结构,反映的是自下而上的认知过程;但反映自上而下概念驱动能力的高层语言宏结构(如话题发展)仍未被充分探索。为填补此空白,本文提出两种新方法:(1)动态主题模型(DTM)追踪话题演化,(2)文本-图像时间对齐网络(TITAN)度量叙事与视觉刺激间的跨模态一致性。实验表明,所提方法在三个数据集上均表现优异:ADReSS(F1=0.8889)、ADReSSo(F1=0.8504)、CU-MARVEL-RABBIT(F1=0.7238)。特征贡献分析显示,宏观特征(如话题变异性、话题变化率、话题一致性)是模型决策的主要依据,优于已考察的微结构特征。这些发现凸显了宏观结构分析在理解语言-认知交互中的价值。
原文摘要 · Abstract (English)
Early detection of neurocognitive disorders (NCDs) is crucial for timely intervention and disease management. Given that language impairments manifest early in NCD progression, visual-stimulated narrative (VSN)-based analysis offers a promising avenue for NCD detection. Current VSN-based NCD detection methods primarily focus on linguistic microstructures (e.g., lexical diversity) that are closely tied to bottom-up, stimulus-driven cognitive processes. While these features illuminate basic language abilities, the higher-order linguistic macrostructures (e.g., topic development) that may reflect top-down, concept-driven cognitive abilities remain underexplored. These macrostructural patterns are crucial for NCD detection, yet challenging to quantify due to their abstract and complex nature. To bridge this gap, we propose two novel macrostructural approaches: (1) a Dynamic Topic Model (DTM) to track topic evolution over time, and (2) a Text-Image Temporal Alignment Network (TITAN) to measure cross-modal consistency between narrative and visual stimuli. Experimental results show the effectiveness of the proposed approaches in NCD detection, with TITAN achieving superior performance across three corpora: ADReSS (F1=0.8889), ADReSSo (F1=0.8504), and CU-MARVEL-RABBIT (F1=0.7238). Feature contribution analysis reveals that macrostructural features (e.g., topic variability, topic change rate, and topic consistency) constitute the most significant contributors to the model's decision pathways, outperforming the investigated microstructural features. These findings underscore the value of macrostructural analysis for understanding linguistic-cognitive interactions associated with NCDs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。