用结构化知识提升大模型对阿尔茨海默病的早期检测能力
Explicit Knowledge-Guided In-Context Learning for Early Detection of Alzheimer's Disease
- 引入信心分数、解析特征和标签词替换三类显式知识增强推理
- 在三个数据集上超越主流微调与提示学习方法,提升显著
- 适合低资源临床场景下的疾病早期识别研究者使用
从叙述性转录文本中检测阿尔茨海默病(AD)对大语言模型(LLMs)仍是挑战,尤其在分布外(OOD)和数据稀缺条件下。尽管上下文学习(ICL)提供了无需微调的参数高效替代方案,但现有方法常因任务识别失败、示范选择不佳及标签词与任务目标不一致而表现欠佳,此类问题在临床领域尤为突出。本文提出显式知识引导的上下文学习框架(EK-ICL),通过融合三类结构化显式知识:由小语言模型(SLMs)生成的置信度分数以锚定任务相关模式,解析特征分数用于捕捉结构差异并优化示范选择,以及标签词替换以解决与LLM先验的语义偏差。此外,EK-ICL采用基于解析的检索策略与集成预测,缓解AD转录文本中语义同质性带来的影响。在三个AD数据集上的实验表明,EK-ICL显著优于当前最优的微调与ICL基线。进一步分析显示,ICL在AD检测中的性能高度依赖标签语义与任务上下文的一致性,凸显了在低资源临床推理中引入显式知识的重要性。
原文摘要 · Abstract (English)
Detecting Alzheimer's Disease (AD) from narrative transcripts remains a challenging task for large language models (LLMs), particularly under out-of-distribution (OOD) and data-scarce conditions. While in-context learning (ICL) provides a parameter-efficient alternative to fine-tuning, existing ICL approaches often suffer from task recognition failure, suboptimal demonstration selection, and misalignment between label words and task objectives, issues that are amplified in clinical domains like AD detection. We propose Explicit Knowledge In-Context Learners (EK-ICL), a novel framework that integrates structured explicit knowledge to enhance reasoning stability and task alignment in ICL. EK-ICL incorporates three knowledge components: confidence scores derived from small language models (SLMs) to ground predictions in task-relevant patterns, parsing feature scores to capture structural differences and improve demo selection, and label word replacement to resolve semantic misalignment with LLM priors. In addition, EK-ICL employs a parsing-based retrieval strategy and ensemble prediction to mitigate the effects of semantic homogeneity in AD transcripts. Extensive experiments across three AD datasets demonstrate that EK-ICL significantly outperforms state-of-the-art fine-tuning and ICL baselines. Further analysis reveals that ICL performance in AD detection is highly sensitive to the alignment of label semantics and task-specific context, underscoring the importance of explicit knowledge in clinical reasoning under low-resource conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。