arXiv:2507.01387eess.IVcs.CV2025-07被引 2

用解剖约束生成逼真支气管镜图像,解决数据稀缺问题。

BronchoGAN: Anatomically consistent and domain-agnostic image-to-image translation for video bronchoscopy

  • 引入支气管开口匹配约束,确保解剖结构一致。
  • 通过基础模型生成深度图作为中间表示,跨域翻译效果提升。
  • 适合医学图像合成与数据增强,尤其缺真实支气管镜数据时。

支气管镜图像稀缺限制了深度学习模型训练。本文提出BronchoGAN,一种带解剖约束的条件GAN,强制输入与输出图像中的支气管开口对齐。通过基础模型生成的深度图作为中间表征,实现虚拟、模拟及体内/体外等多种数据域间的鲁棒图像转换,显著降低对特定训练集的依赖。该方法可便捷构建配对图像用于训练,实验表明不同来源输入(如虚拟支气管镜、模拟物)均能成功转换为具真实人呼吸道外观的图像。定量评估显示FID、SSIM和Dice系数均提升,其中合成图像的Dice系数最高改善0.43。利用公开CT数据生成大规模逼真支气管镜图像数据集,有效填补公共支气管镜图像空白。

原文摘要 · Abstract (English)

The limited availability of bronchoscopy images makes image synthesis particularly interesting for training deep learning models. Robust image translation across different domains -- virtual bronchoscopy, phantom as well as in-vivo and ex-vivo image data -- is pivotal for clinical applications. This paper proposes BronchoGAN introducing anatomical constraints for image-to-image translation being integrated into a conditional GAN. In particular, we force bronchial orifices to match across input and output images. We further propose to use foundation model-generated depth images as intermediate representation ensuring robustness across a variety of input domains establishing models with substantially less reliance on individual training datasets. Moreover our intermediate depth image representation allows to easily construct paired image data for training. Our experiments showed that input images from different domains (e.g. virtual bronchoscopy, phantoms) can be successfully translated to images mimicking realistic human airway appearance. We demonstrated that anatomical settings (i.e. bronchial orifices) can be robustly preserved with our approach which is shown qualitatively and quantitatively by means of improved FID, SSIM and dice coefficients scores. Our anatomical constraints enabled an improvement in the Dice coefficient of up to 0.43 for synthetic images. Through foundation models for intermediate depth representations, bronchial orifice segmentation integrated as anatomical constraints into conditional GANs we are able to robustly translate images from different bronchoscopy input domains. BronchoGAN allows to incorporate public CT scan data (virtual bronchoscopy) in order to generate large-scale bronchoscopy image datasets with realistic appearance. BronchoGAN enables to bridge the gap of missing public bronchoscopy images.

图像生成医学影像GAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。