arXiv:2505.13418cs.CLcs.LG2025-05EMNLP被引 3

对比人类与大模型对语言中痴呆迹象的感知差异。

Dementia Through Different Eyes: Explainable Modeling of Human and LLM Perceptions for Early Awareness

  • 用大模型提取专家指导的高层语言特征
  • 人类判断依赖少数误导性线索,大模型更贴近临床模式
  • 框架可帮助非专业人士识别关键语言信号

认知衰退常在确诊前数年通过语言表现出来。通常最先察觉变化的是患者身边非专业人员,甚至大模型在长期使用中也可能发现异常。本文研究非专业人士如何通过语言感知痴呆。我们向非专家人类和大模型展示图片描述文本,要求其直观判断文本是否由痴呆患者所写。提出一种可解释方法,利用大模型提取专家指导的高层特征,并用逻辑回归建模人类与大模型的感知,与临床诊断对比。分析显示,人类感知不一致,依赖狭窄且有时误导性的线索;而大模型则基于更丰富、更细微的特征,与临床模式更一致。但两者均存在漏诊倾向,常忽视痴呆病例。本研究通过可解释框架揭示关键洞察,助力非专业人士更好识别重要语言征兆。

原文摘要 · Abstract (English)

Cognitive decline often surfaces in language years before diagnosis. It is frequently non-experts, such as those closest to the patient, who first sense a change and raise concern. As LLMs become integrated into daily communication and used over prolonged periods, it may even be an LLM that notices something is off. But what exactly do they notice--and should be noticing--when making that judgment? This paper investigates how dementia is perceived through language by non-experts. We presented transcribed picture descriptions to non-expert humans and LLMs, asking them to intuitively judge whether each text was produced by someone healthy or with dementia. We introduce an explainable method that uses LLMs to extract high-level, expert-guided features representing these picture descriptions, and use logistic regression to model human and LLM perceptions and compare with clinical diagnoses. Our analysis reveals that human perception of dementia is inconsistent and relies on a narrow, and sometimes misleading, set of cues. LLMs, by contrast, draw on a richer, more nuanced feature set that aligns more closely with clinical patterns. Still, both groups show a tendency toward false negatives, frequently overlooking dementia cases. Through our interpretable framework and the insights it provides, we hope to help non-experts better recognize the linguistic signs that matter.

认知障碍大模型可解释性语言分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。