用停顿模式和语义连贯性联合预测精神分裂症思维障碍严重程度。
Reading Between the Lines: Combining Pause Dynamics and Semantic Coherence for Automated Assessment of Thought Disorder
- 融合说话停顿与语义连贯性,构建多模态评估框架。
- 停顿特征单独预测效果稳定,融合后相关系数提升至0.455。
- 适用于临床筛查,尤其适合大规模精神健康监测场景。
思维障碍(FTD)是精神分裂症谱系障碍的核心表现,常体现为言语不连贯,给临床评估带来挑战。传统量表虽经验证但耗时耗力,难以推广。自动语音识别(ASR)可客观量化语言与时间特征,提供可扩展的替代方案。此外,ASR生成的语句时间戳使停顿动态分析成为可能,而停顿被认为反映了言语产生的认知过程。然而其在语义之外的额外价值尚未充分探索。本研究评估了一种跨三个数据集的可扩展多模态框架:自然自录日记(AVH)、结构化图片描述(TOPSY)及梦境叙事(PsyCL)。通过支持向量回归,对比了停顿特征与已有连贯性指标对临床FTD评分的预测能力。仅使用停顿特征的模型在各数据集中均能稳健预测手动评分的FTD严重程度。将停顿特征与语义连贯性结合后,预测性能优于仅依赖语义的模型,晚期融合在所有数据集中表现最佳,平均斯皮尔曼相关系数从语义模型的0.413提升至0.455。该增益在不同情境下保持一致,尽管最具信息量的停顿模式因数据集而异。结果表明,停顿动态与语义连贯性分别反映思维混乱的不同侧面,具有互补性。
原文摘要 · Abstract (English)
Formal thought disorder (FTD), a hallmark of schizophrenia spectrum disorders, manifests as incoherent speech and poses challenges for clinical assessment. Traditional clinical rating scales, though validated, are resource-intensive and lack scalability. Automated speech recognition (ASR) allows for objective quantification of linguistic and temporal features of speech, offering scalable alternatives. Furthermore, ASR-derived utterance timestamps provide access to pause dynamics, which are thought to reflect the cognitive processes underlying speech production. Yet, their added value beyond semantic measures remains insufficiently explored. In this study, we evaluated a scalable multimodal framework that integrates pause features with semantic coherence metrics across three datasets: naturalistic self-recorded diaries (AVH), structured picture descriptions (TOPSY), and dream narratives (PsyCL). Pause-related features were evaluated alongside established coherence measures using support vector regression to predict clinical FTD scores. Models using pause features alone robustly predict manually rated FTD severity consistently across datasets. Integrating pause features with semantic coherence metrics enhanced predictive performance compared to coherence-only models, with late fusion yielding the most robust and consistent gains in all three datasets. On average across datasets, Spearman correlation increased from \r{ho} = 0.413 for semantic-only models to \r{ho} = 0.455 with late fusion. The performance gains from semantic and pause features integration held consistently across all contexts, though the nature of the most informative pause patterns was dataset-dependent. These findings suggest that both pause dynamics and semantic coherence reflect complementary aspects of thought disorganization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。