arXiv:2511.06826cs.CLcs.AI2025-11AAAI

用多样且对比的示范,提升大模型对阿尔茨海默病的细微识别能力。

Beyond Plain Demos: A Demo-centric Anchoring Paradigm for In-Context Learning in Alzheimer's Disease Detection

  • 通过多样检索与投影锚定,增强示范上下文的广度与深度
  • 在三个阿尔茨海默病数据集上显著超越传统提示学习和任务向量方法
  • 适合低资源、分布外的医疗文本诊断场景

从叙述性转录文本中检测阿尔茨海默病(AD)挑战大型语言模型(LLM):预训练极少覆盖此类分布外任务,且所有示范文本描述相同场景,导致上下文高度同质化。这削弱了模型的任务认知能力与捕捉细微分类线索的上下文感知能力。由于认知能力在预训练后固定,提升面向AD检测的上下文学习(ICL)关键在于优化感知。我们发现标准ICL迅速饱和,示范缺乏多样性(上下文宽度)且无法传递细粒度信号(上下文深度);尽管近期任务向量(TV)方法通过注入隐藏状态改善任务泛化,但其注入粒度、强度与位置与AD检测不匹配。为此,我们提出DA4ICL——一种以示范为中心的锚定框架,通过‘多样对比检索’(DCR)扩展上下文宽度,并在每个Transformer层应用‘投影向量锚定’(PVA)深化每个示范信号。在三个AD基准上,DA4ICL相比ICL与TV基线取得显著且稳定的性能提升,为细粒度、分布外、低资源的LLM适配开辟新范式。

原文摘要 · Abstract (English)

Detecting Alzheimer's disease (AD) from narrative transcripts challenges large language models (LLMs): pre-training rarely covers this out-of-distribution task, and all transcript demos describe the same scene, producing highly homogeneous contexts. These factors cripple both the model's built-in task knowledge (\textbf{task cognition}) and its ability to surface subtle, class-discriminative cues (\textbf{contextual perception}). Because cognition is fixed after pre-training, improving in-context learning (ICL) for AD detection hinges on enriching perception through better demonstration (demo) sets. We demonstrate that standard ICL quickly saturates, its demos lack diversity (context width) and fail to convey fine-grained signals (context depth), and that recent task vector (TV) approaches improve broad task adaptation by injecting TV into the LLMs' hidden states (HSs), they are ill-suited for AD detection due to the mismatch of injection granularity, strength and position. To address these bottlenecks, we introduce \textbf{DA4ICL}, a demo-centric anchoring framework that jointly expands context width via \emph{\textbf{Diverse and Contrastive Retrieval}} (DCR) and deepens each demo's signal via \emph{\textbf{Projected Vector Anchoring}} (PVA) at every Transformer layer. Across three AD benchmarks, DA4ICL achieves large, stable gains over both ICL and TV baselines, charting a new paradigm for fine-grained, OOD and low-resource LLM adaptation.

阿尔茨海默病上下文学习示范优化医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。