arXiv:2508.02281cs.CVcs.LG2025-08

用边缘增强数据预训练,可显著提升医学图像分割性能。

Do Edges Matter? Investigating Edge-Enhanced Pre-Training for Medical Image Segmentation

  • 用边缘检测核处理图像,用于基础模型预训练
  • 跨模态分割性能平均提升16.42%至19.30%
  • 提出基于图像熵和标准差的智能选择策略

医学图像分割对疾病诊断与治疗规划至关重要,但构建鲁棒模型通常需大量计算资源和数据。现有研究显示,预训练-微调范式可提升分割性能,但图像预处理方式对不同模态的影响尚不明确。尤其是边缘——像素强度突变——作为物体边界的关键线索,尚未在基础模型预训练中系统研究。本文探究使用高效边缘核(如Kirsch)处理数据进行预训练,是否能提升基础模型的跨模态分割能力。在皮肤镜、眼底、乳腺、显微、OCT、超声、X射线共7个医学领域进行系统实验,发现边缘预训练在部分模态提升性能,部分则下降,表明需选择性应用。为此,提出一种元学习策略:基于原始图像的标准差与熵,自动选择采用边缘增强或原始数据预训练的模型。实验表明,该策略使整体分割性能相比仅用边缘增强预训练的模型提升16.42%,相比仅用原始数据预训练的模型提升19.30%。

原文摘要 · Abstract (English)

Medical image segmentation is crucial for disease diagnosis and treatment planning, yet developing robust segmentation models often requires substantial computational resources and large datasets. Existing research shows that pre-trained and finetuned foundation models can boost segmentation performance. However, questions remain about how particular image preprocessing steps may influence segmentation performance across different medical imaging modalities. In particular, edges-abrupt transitions in pixel intensity-are widely acknowledged as vital cues for object boundaries but have not been systematically examined in the pre-training of foundation models. We address this gap by investigating to which extend pre-training with data processed using computationally efficient edge kernels, such as kirsch, can improve cross-modality segmentation capabilities of a foundation model. Two versions of a foundation model are first trained on either raw or edge-enhanced data across multiple medical imaging modalities, then finetuned on selected raw subsets tailored to specific medical modalities. After systematic investigation using the medical domains Dermoscopy, Fundus, Mammography, Microscopy, OCT, US, and XRay, we discover both increased and reduced segmentation performance across modalities using edge-focused pre-training, indicating the need for a selective application of this approach. To guide such selective applications, we propose a meta-learning strategy. It uses standard deviation and image entropy of the raw image to choose between a model pre-trained on edge-enhanced or on raw data for optimal performance. Our experiments show that integrating this meta-learning layer yields an overall segmentation performance improvement across diverse medical imaging tasks by 16.42% compared to models pre-trained on edge-enhanced data only and 19.30% compared to models pre-trained on raw data only.

医学图像分割边缘增强元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。