arXiv:2608.08976cs.LG2026-08

无需标注数据,仅用预训练模型从脸和声音筛查帕金森病。

Label-Free Parkinson's Disease Screening from Face and Voice through Mechanistic Interpretability

  • 用冻结的视觉与语音模型,通过异常检测和合成病变对比学习实现无标签筛查。
  • 语音模态准确率AUROC达0.765,融合后整体达到0.802(阴性预测值95%)。
  • 适合医疗筛查场景,尤其在标注数据难获取时使用。

帕金森病(PD)是第二大常见神经退行性疾病。传统机器学习筛查依赖带标签数据,但受限于隐私问题和专家标注成本。本文提出一种完全基于冻结预训练编码器的无标签面+声筛查方法——采用面部表情视觉变换器和HuBERT语音模型,训练全程不接触任何帕金森病标签,仅使用健康对照组作为参考。语音模态通过时间拉伸与气息化降质构建合成发音障碍对比激活方向(CAA);面部模态则利用到健康对照嵌入聚类的k近邻异常得分。引入对齐原则:当合成疾病方向与真实疾病方向的余弦相似度大于零时,CAA检测有效。在YouTubePD基准上,语音模态余弦相似度为+0.37(CAA有效,AUROC 0.765),面部为-0.48(CAA无效,异常检测有效,AUROC 0.751)。等权重晚期融合达到AUROC 0.802(95%置信区间[0.70,0.89]),阴性预测值0.95,支持排除性筛检。过拟合审计显示语音检测可良好迁移,而面部及融合结果可能因内部验证存在乐观偏差,有待外部验证。

原文摘要 · Abstract (English)

Parkinson's disease (PD) is the second most common neurodegenerative disorder. Typical machine learning screening methods require PD labels, but the available data is limited by privacy concerns and the need for expert annotation. We propose a label-free face-plus-voice PD screen built entirely on frozen pretrained encoders--a face-expression Vision Transformer and HuBERT--in which no PD label touches any fit; the reference is training controls only. The voice modality uses a synthetic-dysarthria contrastive activation addition (CAA) direction built from time-stretch and breathy degradation of healthy speech; the face modality uses a k-nearest-neighbor anomaly score to the control embedding cluster. We introduce the alignment principle, a post-hoc analysis showing that a synthetic-degradation CAA detector works when the cosine similarity between the synthetic and real disease directions exceeds zero. Measured on the YouTubePD benchmark, this cosine is +0.37 for voice (CAA works, AUROC 0.765) and -0.48 for face (CAA fails; anomaly succeeds, AUROC 0.751). Equal-weight late fusion reaches AUROC 0.802 (95% CI [0.70,0.89]) with NPV 0.95, supporting a rule-out triage interpretation. An overfitting audit shows the voice detector transfers cleanly, while the face-side--and thus fused--AUROC is potentially optimistic pending external validation.

帕金森病无标签筛查多模态可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。