用表格大模型实现小样本阿尔茨海默病精准诊断
Enabling Few-Shot Alzheimer's Disease Diagnosis on Biomarker Data with Tabular LLMs
- 构建基于上下文学习的表格提示,适配医疗数据小样本场景
- 在少量病例上达到优于通用大模型的分类准确率
- 适合临床医生和生物信息研究者快速验证新指标
阿尔茨海默病(AD)是一种复杂的神经退行性疾病,早期准确诊断需分析多种异构生物标志物(如神经影像、遗传风险因素、认知测试和脑脊液蛋白),这些数据通常以表格形式呈现。大型语言模型(LLM)具备灵活的少样本推理能力、多模态融合能力和自然语言可解释性,为结构化生物医学数据预测提供了全新机遇。我们提出TAP-GPT框架,将原本用于商业智能任务的多模态表格专用大模型TableGPT2,适配至小样本结构化生物标志物数据的AD诊断任务。该方法通过从生物医学数据中构建上下文学习示例来生成少样本表格提示,并使用参数高效的qLoRA对TableGPT2进行微调,完成临床二分类任务(AD vs. 认知正常)。TAP-GPT利用TableGPT2强大的表格理解能力及模型内嵌的先验知识,在性能上超越更先进的通用大模型与专为预测任务设计的表格基础模型(TFM)。据我们所知,这是首个将大模型应用于表格型生物标志物预测的任务,为未来生物信息学中的大模型驱动多智能体框架铺平道路。
原文摘要 · Abstract (English)
Early and accurate diagnosis of Alzheimer's disease (AD), a complex neurodegenerative disorder, requires analysis of heterogeneous biomarkers (e.g., neuroimaging, genetic risk factors, cognitive tests, and cerebrospinal fluid proteins) typically represented in a tabular format. With flexible few-shot reasoning, multimodal integration, and natural-language-based interpretability, large language models (LLMs) offer unprecedented opportunities for prediction with structured biomedical data. We propose a novel framework called TAP-GPT, Tabular Alzheimer's Prediction GPT, that adapts TableGPT2, a multimodal tabular-specialized LLM originally developed for business intelligence tasks, for AD diagnosis using structured biomarker data with small sample sizes. Our approach constructs few-shot tabular prompts using in-context learning examples from structured biomedical data and finetunes TableGPT2 using the parameter-efficient qLoRA adaption for a clinical binary classification task of AD or cognitively normal (CN). The TAP-GPT framework harnesses the powerful tabular understanding ability of TableGPT2 and the encoded prior knowledge of LLMs to outperform more advanced general-purpose LLMs and a tabular foundation model (TFM) developed for prediction tasks. To our knowledge, this is the first application of LLMs to the prediction task using tabular biomarker data, paving the way for future LLM-driven multi-agent frameworks in biomedical informatics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。