用生成模型自适应地增强手术图像分割数据,提升模型对不确定区域的泛化能力。
GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation
- 基于潜在扩散模型学习图像与掩码的联合表征,生成高质量配对数据。
- 在CaDISv2和CholecSeg8k上分别提升平均交并比1.6%和1.5%。
- 根据模型不确定性动态生成数据,适合小样本手术分割场景。
生成式数据增强为解决手术数据积累中的伦理、组织和监管难题提供了有前景的替代方案,但针对分割任务的(图像,掩码)成对合成仍鲜有研究。本文提出学习语义完备且紧凑的(图像,掩码)空间潜在表示,并联合建模于潜在扩散模型中。实验表明,该方法能有效生成具有显著语义一致性的未见高质量配对分割数据。传统生成增强多在预训练阶段固定生成样本以提升下游模型性能。为此,本文进一步提出生成自适应不确定性引导的扩散增强(GAUDA),利用贝叶斯下游模型的认知不确定性,在线动态生成样本。通过在训练中以高不确定性类别为条件,生成针对当前最不确定区域的额外未见样本。该方法可显著减少所需新增样本数量,并精准聚焦于关键区域。GAUDA在两个主流手术分割数据集上表现优异:在CaDISv2上平均提升绝对交并比1.6%,在CholecSeg8k上提升1.5%。
原文摘要 · Abstract (English)
Augmentation by generative modelling yields a promising alternative to the accumulation of surgical data, where ethical, organisational and regulatory aspects must be considered. Yet, the joint synthesis of (image, mask) pairs for segmentation, a major application in surgery, is rather unexplored. We propose to learn semantically comprehensive yet compact latent representations of the (image, mask) space, which we jointly model with a Latent Diffusion Model. We show that our approach can effectively synthesise unseen high-quality paired segmentation data of remarkable semantic coherence. Generative augmentation is typically applied pre-training by synthesising a fixed number of additional training samples to improve downstream task models. To enhance this approach, we further propose Generative Adaptive Uncertainty-guided Diffusion-based Augmentation (GAUDA), leveraging the epistemic uncertainty of a Bayesian downstream model for targeted online synthesis. We condition the generative model on classes with high estimated uncertainty during training to produce additional unseen samples for these classes. By adaptively utilising the generative model online, we can minimise the number of additional training samples and centre them around the currently most uncertain parts of the data distribution. GAUDA effectively improves downstream segmentation results over comparable methods by an average absolute IoU of 1.6% on CaDISv2 and 1.5% on CholecSeg8k, two prominent surgical datasets for semantic segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。