首个针对菲律宾语和英语混用语音的痴呆检测研究,验证多语言训练关键性
Forgotten Words: Benchmarking NeoBERT for Dementia Detection in Low-Resource Conversational Filipino and English Speech

- 构建4000条双语对照语料,保留认知衰退的语篇特征
- 跨语言迁移性能差,英语模型在菲律宾语上F1仅0.455
- 多语言联合微调使所有模型达到0.97以上准确率
从自发性语音中检测痴呆具有可扩展的认知筛查潜力,但现有自然语言处理系统仍以英语为主。这一局限在菲律宾尤为突出,当地普遍存在菲律宾语-英语混用,且此前无相关研究。本文首次系统评估基于Transformer的菲律宾语痴呆检测,并首次在临床NLP场景中测试NeoBERT。为分离语言与领域影响,我们构建了4000条源自DementiaBank的双语语料,菲律宾语翻译由人工完成,以保留认知衰退的语篇标记。在单语、零样本跨语言及双语微调设置下评估五类模型:TF-IDF+LogReg、BERT、NeoBERT、XLM-R和RoBERTa-Tagalog。结果显示,域内性能无法跨语言迁移,英语训练的BERT在菲律宾语上宏观F1降至0.455;单纯架构现代化无法提升鲁棒性。而双语微调则消除所有模型的跨语言退化,收敛至0.969–0.973的宏观F1。表明多语言临床NLP表现主要由训练中的语言覆盖度决定,而非模型规模或架构。
原文摘要 · Abstract (English)
Dementia detection from spontaneous speech offers a scalable approach to cognitive screening, yet NLP systems remain predominantly English-centric. This limitation is especially acute in the Philippines, where Filipino-English code-switching is pervasive and no prior work has addressed NLP-based dementia detection. We present the first systematic evaluation of transformer-based dementia detection in Filipino speech and the first assessment of NeoBERT in a clinical NLP setting. To separate language from domain effects, we construct a parallel bilingual dataset of 4,000 DementiaBank-derived transcripts, with Filipino translations produced manually to preserve discourse-level markers of cognitive decline. We evaluate five model families, TF-IDF + LogReg, BERT, NeoBERT, XLM-R, and RoBERTa-Tagalog, under monolingual, zero-shot cross-lingual, and bilingual fine-tuning settings. We find that in-domain performance does not transfer across languages, with English-trained BERT dropping to Macro-F1 = 0.455 on Filipino, and that architectural modernization alone does not improve robustness. Bilingual fine-tuning, however, eliminates cross-lingual degradation across all transformer models, converging to Macro-F1 = 0.969-0.973. These results suggest that multilingual clinical NLP performance is driven primarily by linguistic coverage during training rather than model scale or architecture.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。