arXiv:2602.11177cs.CLcs.AI2026-02

用大模型分析阿尔茨海默病文本,提升早期检测准确率

What Do LLMs Know About Alzheimer's Disease? Multi-loss Fine-Tuning and Probing for AD Detection

  • 用多任务微调让BERT、T5和Llama-1B适应阿尔茨海默病文本数据
  • 在三个数据集上均达新最优,Llama-1B表现媲美主流模型
  • 揭示微调后词向量变化与疾病信号的关联,适合医疗文本研究者

阿尔茨海默病(AD)的可靠早期检测极具挑战性,尤其受限于标注数据稀缺。尽管大语言模型(LLMs)在跨领域迁移中表现出色,但通过监督微调将其适配至AD领域的研究仍较少。本文在三个异构转录语料库(Pitt、CCC、ADRC)上实证评估多种模型架构,探究其在基于文本的AD检测中的有效性,并分析任务相关信号如何编码于模型内部表示中。据我们所知,微调后的BERT和T5在Pitt和CCC数据集上达到新状态,同时在ADRC上表现强劲。此外,解码器仅有的Llama-1B在所有三个数据集中均取得高度竞争性结果,凸显其在AD检测中的有效性。我们进一步对Llama-1B主干进行综合评估,包括跨语料库迁移能力、最优输入块大小粒度及临床转录标记的影响。通过线性探针实证显示,微调会改变单个词元(语言标记与内容词)的表示,使其反映与AD相关的信号。

原文摘要 · Abstract (English)

Reliable early detection of Alzheimer's disease (AD) is challenging, particularly due to the limited availability of labeled data. While large language models (LLMs) have shown strong transfer capabilities across do mains, adapting them to the AD domain through supervised fine-tuning remains largely unexplored. In this work, we empirically evaluate various model architectures across three heterogeneous transcript corpora (Pitt, CCC, ADRC) to investigate their effectiveness for text-based AD detection and analyze how task-relevant information is encoded within their internal representations. To the best of our knowledge, our fine-tuned BERT and T5 models establish a new state-of-the-art on the Pitt and CCC datasets, while achieving strong performance on ADRC. In parallel, the decoder-only Llama-1B achieves highly competitive results comparable to BERT and T5 across all three corpora, highlighting its effectiveness for AD detection. We further conduct a comprehensive evaluation of the Llama-1B backbone, analyzing cross-corpus transferability, optimal input chunk-size granularity, and the impact of clinical transcript markers. Also, we use linear probing to empirically show that fine-tuning shifts the representations of individual tokens, both linguistic markers and content words, in ways that reflect AD-related signal.

阿尔茨海默病大模型应用文本检测医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。