arXiv:2608.26531cs.CV2026-08

FAN-LoRA通过分离频域特征,提升医学影像分割在跨模态下的适应能力。

FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation

论文配图:FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation
图 1 · 摘自论文原文
  • 分频域设计:用B样条低通分支对齐整体结构,傅里叶高通分支补偿局部纹理。
  • 在三个跨模态/跨中心数据集上,平均Dice得分更高,边界误差显著降低。
  • 模块轻量高效,适合医疗图像领域中参数受限的模型微调场景。

视觉基础模型(如分割一切模型SAM)在自然图像分割中取得显著进展,但其直接迁移至医学影像仍受严重域偏移(如跨模态、跨中心)制约。现有参数高效微调(PEFT)方法虽可适配SAM至医学领域,但在极端分布偏移下常出现性能下降。这主要源于异质频率成分在共享低秩子空间中的隐式纠缠,导致结构对齐不佳与边界模糊。为此,本文提出傅里叶自适应非线性低秩适配器(FAN-LoRA),一种新型频域解耦微调架构。FAN-LoRA通过B样条驱动的低通分支实现全局结构对齐,协同离散傅里叶高通分支完成局部纹理补偿。在三个具有挑战性的跨模态与跨中心基准上的实验表明,FAN-LoRA持续优于当前最优的PEFT基线,在平均Dice分数上取得一致提升,并显著降低边界误差,同时保持紧凑模块尺寸且不牺牲计算效率。

原文摘要 · Abstract (English)

The advent of vision foundation models, notably the Segment Anything Model (SAM), has catalyzed significant advancements in natural image segmentation. However, their direct transfer to medical imaging remains severely bottlenecked by profound domain gaps, such as cross-modality and cross-center shifts. Existing Parameter-Efficient Fine-Tuning (PEFT) methods facilitate the adaptation of SAM to medical domains; nevertheless, they frequently suffer from performance degradation under severe distribution shifts. This vulnerability primarily stems from the implicit entanglement of heterogeneous frequency components within a shared low-rank subspace, which directly exacerbates sub-optimal structural alignment and localized boundary blurring. To overcome this representational bottleneck, we propose the Fourier-Adaptive Nonlinear Low-Rank Adaptor (FAN-LoRA), a novel frequency-decoupled fine-tuning architecture. FAN-LoRA explicitly separates the optimization space by employing a B-spline-driven low-pass branch for global structural alignment, synergistically coupled with a discrete Fourier high-pass branch for local textural compensation. Extensive experiments across three challenging cross-modality and cross-center benchmarks demonstrate that FAN-LoRA consistently outperforms state-of-the-art PEFT baselines. Compared to the strongest competitors, our method achieves consistent improvements in average Dice scores and notable reductions in boundary errors, while maintaining a compact module size without compromising computational efficiency.

医学影像低秩微调频域分解分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。