用深度学习将模拟影像转为真实透视图像,提升放疗定位效率
Development of an Unpaired Deep Neural Network for Synthesizing X-ray Fluoroscopic Images from Digitally Reconstructed Tomography in Image Guided Radiotherapy
- 基于改进的CycleGAN架构,无配对训练生成真实感透视图像
- 生成图像与真实图像在误差、清晰度和噪声模式上高度相似,毫秒级生成速度
- 适合放疗流程优化,尤其适用于肺部肿瘤患者快速摆位验证
本研究旨在开发并评估一种深度神经网络(DNN),用于将肺癌治疗中的数字重建放射影像(DRR)转换为平板探测器(FPD)图像,以改善图像引导放疗的临床流程。采用改进的CycleGAN架构,在超过400对患者肺肿瘤的DRR-FPD图像数据上进行训练,最终模型在独立的100张FPD图像上进行评估。使用平均绝对误差(MAE)、峰值信噪比(PSNR)、结构相似性指数(SSIM)和核置信度距离(KID)量化合成图像与真实图像的相似性,并测量生成耗时。尽管部分DRR-FPD图像存在位置偏差,合成图像仍与真实图像高度一致。相比输入的DRR图像及U-Net方法,该DNN在各项指标上均有显著提升,平均生成时间约为毫秒级,具备实时应用潜力。定性评估显示,DNN成功复现了真实FPD图像的噪声模式,减少了手动调整需求。结论表明,该DNN能有效将胸腹部DRR转化为逼真FPD图像,提供快速实用的解决方案,有助于简化患者摆位验证流程、提升整体临床效率。未来工作需在不同成像系统上验证模型,并解决标记物可视化问题,推动更广泛临床应用。
原文摘要 · Abstract (English)
Purpose The purpose of this study was to develop and evaluate a deep neural network (DNN) capable of generating flat-panel detector (FPD) images from digitally reconstructed radiography (DRR) images in lung cancer treatment, with the aim of improving clinical workflows in image-guided radiotherapy. Methods A modified CycleGAN architecture was trained on paired DRR-FPD image data obtained from patients with lung tumors. The training dataset consisted of over 400 DRR-FPD image pairs, and the final model was evaluated on an independent set of 100 FPD images. Mean absolute error (MAE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and Kernel Inception Distance (KID) were used to quantify the similarity between synthetic and ground-truth FPD images. Computation time for generating synthetic images was also measured. Results Despite some positional mismatches in the DRR-FPD pairs, the synthetic FPD images closely resembled the ground-truth FPD images. The proposed DNN achieved notable improvements over both input DRR images and a U-Net-based method in terms of MAE, PSNR, SSIM, and KID. The average image generation time was on the order of milliseconds per image, indicating its potential for real-time application. Qualitative evaluations showed that the DNN successfully reproduced image noise patterns akin to real FPD images, reducing the need for manual noise adjustments. Conclusions The proposed DNN effectively converted DRR images into realistic FPD images for thoracic cases, offering a fast and practical method that could streamline patient setup verification and enhance overall clinical workflow. Future work should validate the model across different imaging systems and address remaining challenges in marker visualization, thereby fostering broader clinical adoption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。