arXiv:2409.06035eess.IVcs.CV2024-09中稿 · as a chapter in th…被引 11

用合成肿瘤数据训练AI,检测效果媲美甚至超过真实数据。

Analyzing Tumors by Synthesis

  • 通过模型或学习生成逼真合成肿瘤图像
  • 在肝、胰、肾等器官上性能达真实数据水平
  • 适合缺乏真实肿瘤数据的医学AI研究者

计算机辅助肿瘤检测在每年超过8000万次美国CT扫描中展现出巨大潜力。然而,由于肿瘤影像尤其是早期肿瘤罕见,真实数据难以获取,导致标注困难、样本稀少。肿瘤合成技术通过生成大量医学图像中的肿瘤实例,助力AI训练。成功合成需保证肿瘤在不同器官中既真实又具备泛化性。本文综述了基于真实与合成数据的AI发展,总结出两类主流合成方法:基于建模的(如Pixel2Cancer)利用通用规则模拟肿瘤演化;基于学习的(如DiffTumor)仅需少量标注样本即可跨器官生成合成肿瘤。专家放射科医生的读者研究显示合成肿瘤具有高度真实性。案例研究涵盖肝脏、胰腺和肾脏,结果表明,使用合成肿瘤训练的AI性能可达到甚至超越仅使用真实数据训练的模型。该技术有望扩充数据集、提升AI可靠性、改善检测表现,并保护患者隐私。

原文摘要 · Abstract (English)

Computer-aided tumor detection has shown great potential in enhancing the interpretation of over 80 million CT scans performed annually in the United States. However, challenges arise due to the rarity of CT scans with tumors, especially early-stage tumors. Developing AI with real tumor data faces issues of scarcity, annotation difficulty, and low prevalence. Tumor synthesis addresses these challenges by generating numerous tumor examples in medical images, aiding AI training for tumor detection and segmentation. Successful synthesis requires realistic and generalizable synthetic tumors across various organs. This chapter reviews AI development on real and synthetic data and summarizes two key trends in synthetic data for cancer imaging research: modeling-based and learning-based approaches. Modeling-based methods, like Pixel2Cancer, simulate tumor development over time using generic rules, while learning-based methods, like DiffTumor, learn from a few annotated examples in one organ to generate synthetic tumors in others. Reader studies with expert radiologists show that synthetic tumors can be convincingly realistic. We also present case studies in the liver, pancreas, and kidneys reveal that AI trained on synthetic tumors can achieve performance comparable to, or better than, AI only trained on real data. Tumor synthesis holds significant promise for expanding datasets, enhancing AI reliability, improving tumor detection performance, and preserving patient privacy.

肿瘤检测合成数据医学AI扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。