arXiv:2410.01828eess.IVcs.CV2024-10

用深度生成模型提升放疗合成影像真实度,助力AI误差检测。

Image-to-Image Translation Based on Deep Generative Modeling for Radiotherapy Synthetic Dataset Creation

  • 通过改进VAE实现配对图像到图像的生成,提升合成数据质量。
  • 新方法使剂量误差降低至4.1 cGy,优于现有方法的6.4 cGy。
  • 适合从事放疗AI、医学影像生成的研究者与临床工程师使用。

放射治疗依赖精确辐射剂量控制,需通过电子射野影像系统(EPID)验证治疗精度。为构建高效的人工智能(AI)误差检测与验证模型,亟需大量高质量标注的EPID图像数据,但真实数据采集困难。合成EPID数据可作为替代方案,但需确保其真实性以有效训练可靠模型。真实测量中存在未被预测模型建模的测量不确定性,会干扰下游任务如误差检测与分类。本研究提出基于深度生成建模的图像到图像(I2I)翻译方法,提升合成数据逼真度。基于989组预测与实测EPID图像数据,评估了配对与非配对生成方法。针对配对情形,提出一种新型变分自编码器(VAE)改进方法,首次应用于该任务;针对非配对情形,采用无监督图像到图像翻译网络(UNIT)。结果表明,两种模型均实现有效转换,改进后的VAE在关键指标上表现更优:平均绝对误差降至4.1 cGy(UNIT为6.4 cGy),场内相对剂量差异为2.5%(UNIT为5.5%),场内绝对剂量差异为5.3 cGy(UNIT为10.8 cGy)。该增强型合成数据有望显著提升神经网络在自动误差检测与分类中的性能。

原文摘要 · Abstract (English)

Objective: Radiotherapy uses precise doses of radiation to treat cancer, requiring accurate verification, e.g. using the Electronic Portal Imaging Device (EPID), to guide treatment. To develop an effective artificial intelligence (AI) model for error detection and treatment verification, a large and well-annotated dataset of EPID images is needed, however, acquiring such high quality real data is difficult. While synthetic EPID data could be a viable alternative, it is critical to ensure that this data is as realistic as possible to effectively train an accurate and reliable AI model. The measurement uncertainty that is not modeled in EPID predictions but is present on real measured EPID images can hinder downstream tasks such as error detection and classification. Our research aims to improve synthetic EPID data through image-to-image (I2I) translation based on deep generative modeling. Approach: A dataset of 989 predicted EPID images and corresponding measured EPID images was used. We evaluate both paired and unpaired generative modeling approaches for this task. For the former, we introduce a novel modification of Variational Autoencoder (VAE) to I2I, a method that, to the best of our knowledge, has not been previously explored for this task. For the latter, we use UNsupervised Image-to-Image Translation Networks (UNIT). Results: Our results show that both models achieved some degree of I2I translation, with our novel modification of the VAE model outperforming the UNIT model in improving key metrics (mean absolute error: 4.1 cGy vs 6.4 cGy; relative dose difference in-field: 2.5% vs 5.5%; absolute dose difference in-field: 5.3 cGy vs 10.8 cGy). Significance: This enhanced synthetic data is expected to improve downstream tasks such as training neural networks for automated error detection and error classification in radiotherapy.

图像生成放疗AI医学影像深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。