用视觉先验重构特征,提升医学病灶分割精度
Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation

- 引入隐式先验网络与双域特征重配置机制
- 在ETIS数据集上比SOTA提升7.2%的Dice分数
- 适合需要高精度病灶分割的医疗影像研究者
医学图像中的病灶分割对临床诊断和治疗规划至关重要。尽管进展显著,仍受复杂背景干扰和病灶形态多变两大因素制约。现有编码器-解码器方法多关注特征提取或解码策略优化,但缺乏编码阶段的早期先验引导与特征重配置,限制了性能。为此,提出FreNet框架,在编码前进行像素级重配置,编码过程中进行特征级重配置。通过隐式先验神经网络(IPNN)建模连续空间场,利用SAM的视觉先验在编码前重配置输入图像以抑制背景响应;设计双域特征重配置(DFR)模块,在编码过程中逐步重配置主干特征。其中频率解耦模块(FDM)在频域解耦特征以增强前景-背景区分性,空间定位模块(SLM)在频域解耦后重新定位特征,提升空间稳定性。在三种成像模态下的9个医学图像分割基准测试中,FreNet显著优于当前最优方法。在挑战性的ETIS数据集上,相比SOTA方法提升5.0%的Dice分数,相比SAM提升7.2%。
原文摘要 · Abstract (English)
Lesion segmentation in medical images plays a critical role in clinical diagnosis and treatment planning. Despite significant advances, lesion segmentation remains challenging due to two major factors: (1) complex background interference; (2) diverse lesion morphology. Existing encoder-decoder based methods mainly focus on enhancing feature extraction or redesigning decoding strategies. However, they lack early prior guidance and feature reconfiguration during the encoding stage, limiting their effectiveness in handling these challenges. To address these limitations, we propose FreNet, a feature reconfiguration framework with visual priors, which performs pixel-level reconfiguration before encoding and feature-level reconfiguration during encoding for precise medical lesion segmentation. To suppress background responses, we propose an Implicit Prior Neural Network (IPNN), which models a continuous spatial field and leverages visual prior from SAM to reconfigure input image before encoding stage. To better handle diverse lesion morphology, we design a Dual-domain Feature Reconfiguration (DFR) module to progressively reconfigure backbone features during encoding stage. Within DFR, the Frequency Decoupling Module (FDM) decouples backbone features in frequency domain to enhance foreground-background discriminability, while the Spatial Localization Module (SLM) spatially relocates and improving spatial stability after frequency decoupling. Extensive experiments on 9 medical image segmentation benchmarks across three imaging modalities demonstrate that FreNet significantly outperforms state-of-the-art (SOTA) methods. On the challenging ETIS dataset, our method achieves Dice improvements of 5.0% over SOTA method and 7.2% over SAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。