arXiv:2412.02006cs.CV2024-12中稿 · the Special Issue …被引 24

让自监督语音表征可解释,助力帕金森病智能诊断

Unveiling Interpretability in Self-Supervised Speech Representations for Parkinson's Diagnosis

  • 设计跨注意力机制,从嵌入与时间两个维度解析语音特征
  • 在5个公开数据集上实现媲美顶尖模型的诊断准确率
  • 可定位关键语音片段,适合临床医生理解模型决策

近期病理语音分析越来越多依赖强大的自监督语音表征,取得了良好效果。然而,这些表征的复杂黑箱特性及可解释性研究不足,严重制约其在临床诊断中的应用。为此,我们提出一种新型可解释框架,专为帕金森病(PD)诊断设计。通过设计简单有效的跨注意力机制,分别实现嵌入级与时间级分析,从两个互补视角提供可解释性。在五个主流帕金森病语音检测基准上的实验表明,该框架能有效识别自监督表征中具有意义的语音模式,适用于多种评估任务。细粒度时间分析进一步验证了其提升深度学习病理语音模型可解释性的潜力,推动更透明、可信、临床可用的计算机辅助诊断系统发展。此外,在分类准确率上,本方法表现优于或接近当前最优水平,并在跨语言场景下对自发语音表现出强鲁棒性。

原文摘要 · Abstract (English)

Recent works in pathological speech analysis have increasingly relied on powerful self-supervised speech representations, leading to promising results. However, the complex, black-box nature of these embeddings and the limited research on their interpretability significantly restrict their adoption for clinical diagnosis. To address this gap, we propose a novel, interpretable framework specifically designed to support Parkinson's Disease (PD) diagnosis. Through the design of simple yet effective cross-attention mechanisms for both embedding- and temporal-level analysis, the proposed framework offers interpretability from two distinct but complementary perspectives. Experimental findings across five well-established speech benchmarks for PD detection demonstrate the framework's capability to identify meaningful speech patterns within self-supervised representations for a wide range of assessment tasks. Fine-grained temporal analyses further underscore its potential to enhance the interpretability of deep-learning pathological speech models, paving the way for the development of more transparent, trustworthy, and clinically applicable computer-assisted diagnosis systems in this domain. Moreover, in terms of classification accuracy, our method achieves results competitive with state-of-the-art approaches, while also demonstrating robustness in cross-lingual scenarios when applied to spontaneous speech production.

可解释性帕金森病语音分析自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。