MAMBO用扩散模型生成高分辨率乳腺钼靶图,提升癌症早期检测能力。
MAMBO: High-Resolution Generative Approach for Mammography Images
- 分块扩散模型融合局部与全局信息,生成3840x3840像素高清图像。
- 生成图像经放射科医生验证,真实感强且保留微小病灶细节。
- 适用于疾病分类与病灶分割,助力医疗AI训练与诊断优化。
乳腺钼靶检查是乳腺癌检测与诊断的金标准。人工智能辅助系统可显著提升放射科医生识别异常的能力,但其训练需大规模多样化数据集,常因隐私与伦理问题难以获取。为此,本文提出一种基于分块扩散的新型乳腺钼靶图像生成方法——MAMBO。扩散模型在真实图像生成上表现卓越,但针对乳腺钼靶图像的研究极少,且尚未实现满足细粒度病灶识别所需的高分辨率输出。MAMBO通过整合多个扩散模型,分别捕捉局部与图像级上下文信息,并将其注入最终生成模型,显著提升去噪效果。该设计使MAMBO能够生成高达3840×3840像素的高分辨率乳腺钼靶图像。实验表明,该方法不仅可用于图像生成与超分辨率重建,还可扩展至异常分割任务。数值评估与放射科医生盲评均验证了其生成图像的真实性和临床可用性,展现出提升乳腺钼靶分析精度与早期病变发现的潜力。相关源码已公开于:https://github.com/iai-rs/mambo。
原文摘要 · Abstract (English)
Mammography is the gold standard for the detection and diagnosis of breast cancer. This procedure can be significantly enhanced with Artificial Intelligence (AI)-based software, which assists radiologists in identifying abnormalities. However, training AI systems requires large and diverse datasets, which are often difficult to obtain due to privacy and ethical constraints. To address this issue, the paper introduces MAMmography ensemBle mOdel (MAMBO), a novel patch-based diffusion approach designed to generate full-resolution mammograms. Diffusion models have shown breakthrough results in realistic image generation, yet few studies have focused on mammograms, and none have successfully generated high-resolution outputs required to capture fine-grained features of small lesions. To achieve this, MAMBO integrates separate diffusion models to capture both local and global (image-level) contexts. The contextual information is then fed into the final model, significantly aiding the noise removal process. This design enables MAMBO to generate highly realistic mammograms of up to 3840x3840 pixels. Importantly, this approach can be used to enhance the training of classification models and extended to anomaly segmentation. Experiments, both numerical and radiologist validation, assess MAMBO's capabilities in image generation, super-resolution, and anomaly segmentation, highlighting its potential to enhance mammography analysis for more accurate diagnoses and earlier lesion detection. The source code used in this study is publicly available at: https://github.com/iai-rs/mambo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。