arXiv:2410.13822cs.CVcs.AI2024-10被引 2

用对抗攻击实现眼底病变分割风格自适应转换

Multi-style conversion for semantic segmentation of lesions in fundus images by adversarial attacks

  • 通过对抗攻击控制模型分割风格,自动适配不同数据集标注习惯
  • 在融合多源数据库时实现风格统一,提升模型泛化能力
  • 适合需要跨数据集训练与风格可控的医学图像分割场景

糖尿病视网膜病变的诊断依赖眼底图像,但全局分类方法缺乏透明性和可解释性。而基于分割的数据库获取成本高,且难以合并。本文提出一种新型对抗风格转换方法,解决不同数据库标注风格不统一的问题。通过在整合数据库上训练单一架构,模型能根据输入自动调整分割风格,实现多种标注风格间的转换。该方法在编码器特征中添加线性探测器以识别数据集来源,并利用对抗攻击调控模型的分割风格。实验表明,该方法在数据融合后显著提升定性和定量表现,为改善模型泛化性、不确定性估计及标注风格连续插值提供可能。本方法支持使用多样化数据库训练分割模型,同时控制并利用标注风格,提升糖尿病视网膜病变诊断效果。

原文摘要 · Abstract (English)

The diagnosis of diabetic retinopathy, which relies on fundus images, faces challenges in achieving transparency and interpretability when using a global classification approach. However, segmentation-based databases are significantly more expensive to acquire and combining them is often problematic. This paper introduces a novel method, termed adversarial style conversion, to address the lack of standardization in annotation styles across diverse databases. By training a single architecture on combined databases, the model spontaneously modifies its segmentation style depending on the input, demonstrating the ability to convert among different labeling styles. The proposed methodology adds a linear probe to detect dataset origin based on encoder features and employs adversarial attacks to condition the model's segmentation style. Results indicate significant qualitative and quantitative through dataset combination, offering avenues for improved model generalization, uncertainty estimation and continuous interpolation between annotation styles. Our approach enables training a segmentation model with diverse databases while controlling and leveraging annotation styles for improved retinopathy diagnosis.

医学图像风格转换分割对抗攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。