arXiv:2503.14906eess.IVcs.CV2025-03被引 5

用解剖结构指导生成胎儿超声图像,支持正常与异常图像可控合成。

FetalFlex: Anatomy-Guided Diffusion Model for Flexible Control on Fetal Ultrasound Image Synthesis

  • 基于解剖结构和多模态信息实现跨视角可控生成
  • 无需异常数据即可生成分布内与分布外异常图像
  • 可生成像素级配对或反事实数据,适合异常模拟

胎儿超声检查需获取多个切面以评估发育状况并筛查先天畸形,但多平面标注的胎儿超声数据集难获,尤其对罕见或复杂畸形。这限制了新手放射科医生培训及鲁棒性AI模型的开发,尤其在异常胎儿检测方面。本文提出柔性胎儿超声图像生成框架FetalFlex,利用解剖结构与多模态信息,实现跨多种切面的可控图像合成。FetalFlex引入预对齐模块提升控制精度,并采用重绘策略保证纹理一致性;设计两阶段自适应采样策略,逐步优化图像质量。实验表明,FetalFlex是首个无需异常数据即可生成分布内正常与分布外异常胎儿超声图像的方法,在多中心数据集上达到最优图像质量指标;读者研究证实生成结果与专家评估高度一致。此外,合成图像显著提升六种典型深度模型在分类与异常检测任务中的性能。其解剖级别可控生成能力为异常模拟与像素级配对/反事实数据生成提供独特优势。演示地址:https://dyf1023.github.io/FetalFlex/

原文摘要 · Abstract (English)

Fetal ultrasound (US) examinations require the acquisition of multiple planes, each providing unique diagnostic information to evaluate fetal development and screening for congenital anomalies. However, obtaining a comprehensive, multi-plane annotated fetal US dataset remains challenging, particularly for rare or complex anomalies owing to their low incidence and numerous subtypes. This poses difficulties in training novice radiologists and developing robust AI models, especially for detecting abnormal fetuses. In this study, we introduce a Flexible Fetal US image generation framework (FetalFlex) to address these challenges, which leverages anatomical structures and multimodal information to enable controllable synthesis of fetal US images across diverse planes. Specifically, FetalFlex incorporates a pre-alignment module to enhance controllability and introduces a repaint strategy to ensure consistent texture and appearance. Moreover, a two-stage adaptive sampling strategy is developed to progressively refine image quality from coarse to fine levels. We believe that FetalFlex is the first method capable of generating both in-distribution normal and out-of-distribution abnormal fetal US images, without requiring any abnormal data. Experiments on multi-center datasets demonstrate that FetalFlex achieved state-of-the-art performance across multiple image quality metrics. A reader study further confirms the close alignment of the generated results with expert visual assessments. Furthermore, synthetic images by FetalFlex significantly improve the performance of six typical deep models in downstream classification and anomaly detection tasks. Lastly, FetalFlex's anatomy-level controllable generation offers a unique advantage for anomaly simulation and creating paired or counterfactual data at the pixel level. The demo is available at: https://dyf1023.github.io/FetalFlex/.

医学影像扩散模型可控生成胎儿超声

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。