arXiv:2411.08158eess.IVcs.CV2024-11被引 2

用一到两视角重建高质量3D医学影像,突破传统扫描限制。

TomoGRAF: A Robust and Generalizable Reconstruction Network for Single-View Computed Tomography

  • 结合X射线物理特性设计新网络,模拟光子穿透过程。
  • 在仅1-2视角下实现比现有方法更优的三维重建效果。
  • 适用于放射治疗等临床场景,只需少量投影即可生成体积数据。

计算机断层扫描(CT)为科学与临床应用提供了高分辨率的三维结构可视化。传统解析/迭代重建算法需数百个角度采样,实际中常受物理与机械限制难以满足。稀疏视角CT重建虽已有优化与机器学习方法尝试,但在仅1至2个视角的超稀疏条件下成效有限。神经辐射场(NeRF)虽能从稀疏视角重建自然场景三维图像,但其直接应用于医学影像重建效果不佳,因光学与X射线光子传输机制差异显著。本文提出TomoGRAF框架,融合独特的X射线传输物理特性,无需先验信息即可实现超稀疏投影下的高质量三维体数据重建。TomoGRAF捕捉CT成像几何,模拟X射线投射与追踪过程,并在训练中惩罚模拟与真实子体积间的差异。我们在一个不同于训练数据、具有不同成像特性的未见数据集上评估了TomoGRAF性能,结果表明其相较当前最优深度学习与NeRF方法有显著提升。TomoGRAF为影像引导放疗和介入放射学等应用提供了首个通用解决方案,可在仅有1~2个X射线视角时仍获得所需三维体积信息。

原文摘要 · Abstract (English)

Computed tomography (CT) provides high spatial resolution visualization of 3D structures for scientific and clinical applications. Traditional analytical/iterative CT reconstruction algorithms require hundreds of angular data samplings, a condition that may not be met in practice due to physical and mechanical limitations. Sparse view CT reconstruction has been proposed using constrained optimization and machine learning methods with varying success, less so for ultra-sparse view CT reconstruction with one to two views. Neural radiance field (NeRF) is a powerful tool for reconstructing and rendering 3D natural scenes from sparse views, but its direct application to 3D medical image reconstruction has been minimally successful due to the differences between optical and X-ray photon transportation. Here, we develop a novel TomoGRAF framework incorporating the unique X-ray transportation physics to reconstruct high-quality 3D volumes using ultra-sparse projections without prior. TomoGRAF captures the CT imaging geometry, simulates the X-ray casting and tracing process, and penalizes the difference between simulated and ground truth CT sub-volume during training. We evaluated the performance of TomoGRAF on an unseen dataset of distinct imaging characteristics from the training data and demonstrated a vast leap in performance compared with state-of-the-art deep learning and NeRF methods. TomoGRAF provides the first generalizable solution for image-guided radiotherapy and interventional radiology applications, where only one or a few X-ray views are available, but 3D volumetric information is desired.

CT重建稀疏视角NeRF医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。