用风格迁移提升医学图像分割鲁棒性,无需目标域训练数据
Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentation
- 结合扩散模型与结构保持网络,实现单样本风格化
- 在肠镜和皮肤病变数据集上显著提升分割准确率
- 适合临床数据少、设备差异大的场景使用
精准的医学图像分割对诊断和治疗规划至关重要,但常受成像设备、采集条件及患者特征差异导致的领域偏移影响。传统领域泛化方法通常需在训练集中包含测试域部分数据,这在临床中难以实现。尽管扩散模型在图像生成与风格迁移中表现优异,却往往无法保留关键结构信息以支持精确医学分析。为此,本文提出一种新方法,结合扩散模型与结构保持网络,实现结构感知的一次性图像风格化。该方法将多源图像转换为统一风格,同时保持病灶的位置、大小与形状,确保在目标域未出现在训练数据时仍能实现稳健准确的分割。在结肠镜息肉分割与皮肤病变分割数据集上的实验表明,该方法显著提升了分割模型的鲁棒性与准确性,性能优于无风格迁移的基线模型。此结构感知风格化框架为跨多样领域的医学图像分割提供了实用解决方案,有助于提升临床诊断可靠性。
原文摘要 · Abstract (English)
Accurate medical image segmentation is essential for effective diagnosis and treatment planning but is often challenged by domain shifts caused by variations in imaging devices, acquisition conditions, and patient-specific attributes. Traditional domain generalization methods typically require inclusion of parts of the test domain within the training set, which is not always feasible in clinical settings with limited diverse data. Additionally, although diffusion models have demonstrated strong capabilities in image generation and style transfer, they often fail to preserve the critical structural information necessary for precise medical analysis. To address these issues, we propose a novel medical image segmentation method that combines diffusion models and Structure-Preserving Network for structure-aware one-shot image stylization. Our approach effectively mitigates domain shifts by transforming images from various sources into a consistent style while maintaining the location, size, and shape of lesions. This ensures robust and accurate segmentation even when the target domain is absent from the training data. Experimental evaluations on colonoscopy polyp segmentation and skin lesion segmentation datasets show that our method enhances the robustness and accuracy of segmentation models, achieving superior performance metrics compared to baseline models without style transfer. This structure-aware stylization framework offers a practical solution for improving medical image segmentation across diverse domains, facilitating more reliable clinical diagnoses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。