用张量分解与几何变换,让小样本下阿尔茨海默病诊断更高效。
GLT-PEFT: Gated Lie-Tucker Parameter-Efficient Fine-Tuning for Alzheimer's Disease Diagnosis with Hippocampal Segmentation Pretraining

- 基于张量分解与李群变换,实现3D卷积核的结构保持更新。
- 参数量减少显著,分类准确率达91.7%,优于传统微调方法。
- 适合医疗影像中小样本场景下的模型高效适配,如脑部疾病诊断。
参数高效微调(PEFT)在数据有限条件下成为适配预训练模型的有力范式。然而,现有方法多针对矩阵结构参数设计,不适用于医学影像中高维卷积核,且通常依赖加性更新,缺乏对预训练参数几何结构的保留能力;而乘性(几何感知)更新难以融入统一框架。为此,本文提出GLT-PEFT,一种用于阿尔茨海默病(AD)诊断的门控李-塔克参数高效微调框架。该方法将海马体分割预训练模型迁移至下游分类任务。塔克分解实现3D卷积核的张量感知低秩适配,李群变换提供结构保持的乘性更新。门控机制进一步协调加性与乘性更新形式,形成统一且更稳定的微调策略。大量实验表明,GLT-PEFT实现了有效的跨任务迁移,显著减少可训练参数,凸显其在医学影像模型中高效稳健适配的潜力。
原文摘要 · Abstract (English)
Parameter-efficient fine-tuning (PEFT) has emerged as a promising paradigm for adapting pretrained models under limited data conditions. However, most existing PEFT methods are designed for matrix-structured parameters and are not well suited for high-dimensional convolutional kernels in medical imaging models. Moreover, they typically rely on additive updates and lack mechanisms to preserve the geometric structure of pretrained parameters, while multiplicative (geometry-aware) updates are difficult to integrate within a unified framework. To address this issue, this paper proposes GLT-PEFT, a gated Lie-Tucker parameter-efficient fine-tuning framework for Alzheimer's disease (AD) diagnosis. The proposed approach transfers a hippocampal segmentation pretrained model to a downstream classification task. Tucker decomposition enables tensor-aware low-rank adaptation of 3D convolutional kernels, while Lie group-based transformations provide structure-preserving multiplicative updates. A gating mechanism further reconciles additive and multiplicative update forms, resulting in a unified and more stable fine-tuning strategy. Extensive experiments demonstrate that GLT-PEFT achieves effective cross-task transfer while significantly reducing trainable parameters, highlighting its effectiveness for efficient and robust adaptation in medical imaging models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。