arXiv:2502.01685cs.AIcs.CL2025-02被引 2

自动提取描述图的语义路径,识别认知障碍。

Automated Extraction of Spatio-Semantic Graphs for Identifying Cognitive Impairment

  • 用自动识别内容单元的方法构建视觉语义图。
  • 自动图能有效区分认知障碍与正常人群。
  • 效果接近人工标注,组间差异更明显。

现有分析图片描述语言内容评估认知语言障碍的方法常忽略参与者视觉叙事路径,而该路径通常需眼动追踪测量。空间语义图可仅从转录文本分析此路径,但受限于需人工标注内容信息单元(CIUs)。本文提出一种自动化方法,从常用认知语言分析的「饼干盗窃图」中自动提取CIUs,构建空间语义图。该方法实现描述过程的视觉语义路径自动表征。实验表明,自动构建的空间语义图能有效区分认知障碍与非障碍者。统计分析显示,自动方法提取特征的效果与人工方法相当,且在关注临床组间差异上表现更优。结果表明,该自动方法在开发认知障碍评估的临床语音模型中具有潜力。

原文摘要 · Abstract (English)

Existing methods for analyzing linguistic content from picture descriptions for assessment of cognitive-linguistic impairment often overlook the participant's visual narrative path, which typically requires eye tracking to assess. Spatio-semantic graphs are a useful tool for analyzing this narrative path from transcripts alone, however they are limited by the need for manual tagging of content information units (CIUs). In this paper, we propose an automated approach for estimation of spatio-semantic graphs (via automated extraction of CIUs) from the Cookie Theft picture commonly used in cognitive-linguistic analyses. The method enables the automatic characterization of the visual semantic path during picture description. Experiments demonstrate that the automatic spatio-semantic graphs effectively differentiate between cognitively impaired and unimpaired speakers. Statistical analyses reveal that the features derived by the automated method produce comparable results to the manual method, with even greater group differences between clinical groups of interest. These results highlight the potential of the automated approach for extracting spatio-semantic features in developing clinical speech models for cognitive impairment assessment.

认知评估语义图自动化分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。