用低秩方法提升脑出血分割模型迁移效率,效果优于传统微调。
LoRA-based methods on Unet for transfer learning in Subarachnoid Hematoma Segmentation
- 基于张量分解设计新型CP-LoRA,实现参数高效迁移。
- 在30例蛛网膜下腔出血数据上,性能优于标准微调和现有LoRA方法。
- 适合医疗图像分割中数据少、需高效迁移的场景。
动脉瘤性蛛网膜下腔出血(SAH)是致死率超30%的神经急症。利用相关血肿类型进行迁移学习具有潜力但未被充分探索。尽管Unet在小样本医学图像分割中仍是黄金标准,但针对卷积神经网络的低秩适应(LoRA)方法在医学影像中应用较少。本研究在124例创伤性脑损伤患者的CT数据上预训练Unet,再在密歇根大学医疗系统30例动脉瘤性SAH患者数据上使用三折交叉验证进行微调。提出基于张量CP分解的新型CP-LoRA方法,并引入DoRA变体(DoRA-C、convDoRA、CP-DoRA),将权重矩阵分解为幅度与方向成分。对比多种方法在多视图Unet不同模块的表现。结果表明,所有LoRA方法均优于标准微调;大体积血肿情况下性能更优。CP-LoRA达到相当性能且参数量显著减少;高秩过参数化始终优于严格低秩。研究证明血肿类型间迁移可行,且LoRA方法显著优于传统微调。
原文摘要 · Abstract (English)
Aneurysmal subarachnoid hemorrhage (SAH) is a life-threatening neurological emergency with mortality rates exceeding 30%. Transfer learning from related hematoma types represents a potentially valuable but underexplored approach. Although Unet architectures remain the gold standard for medical image segmentation due to their effectiveness on limited datasets, Low-Rank Adaptation (LoRA) methods for parameter-efficient transfer learning have been rarely applied to convolutional neural networks in medical imaging contexts. We implemented a Unet architecture pre-trained on computed tomography scans from 124 traumatic brain injury patients across multiple institutions, then fine-tuned on 30 aneurysmal SAH patients from the University of Michigan Health System using 3-fold cross-validation. We developed a novel CP-LoRA method based on tensor CP-decomposition and introduced DoRA variants (DoRA-C, convDoRA, CP-DoRA) that decompose weight matrices into magnitude and directional components. We compared these approaches against existing LoRA methods (LoRA-C, convLoRA) and standard fine-tuning strategies across different modules on a multi-view Unet model. LoRA-based methods consistently outperformed standard Unet fine-tuning. Performance varied by hemorrhage volume, with all methods showing improved accuracy for larger volumes. CP-LoRA achieved comparable performance to existing methods while using significantly fewer parameters. Over-parameterization with higher ranks consistently yielded better performance than strictly low-rank adaptations. This study demonstrates that transfer learning between hematoma types is feasible and that LoRA-based methods significantly outperform conventional Unet fine-tuning for aneurysmal SAH segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。