用跨模态图像翻译生成先验,提升低采样率成像重建质量
Generative Translation Priors: Bayesian Imaging with Cross-Modality Image Translation

- 将扩散模型转为跨模态先验,通过似然引导实现贝叶斯重构
- 在严重欠采样下仍保持高保真度,优于传统方法
- 适合医学影像重建领域,尤其多模态数据融合场景
利用共存模态图像指导目标域重建在成像算法中极具价值。本文提出生成式翻译先验(GTP)——一种贝叶斯框架,将基于扩散的图像到图像翻译模型转化为针对病态成像逆问题的跨模态先验。GTP通过似然引导融入目标域测量,引导翻译过程逼近期望的后验分布。该框架基于对后验动态的理论分析,揭示了似然引导带来的内在偏差。我们进一步表征该偏差并推导出无需真实值的估计方法,可作为后验采样质量的实际评估指标。在此基础上,我们分别推导出基于梯度和近端似然引导的两种离散化GTP算法。我们在使用磁共振侧信息的计算机断层扫描重建、以及使用计算机断层扫描侧信息的正电子发射断层扫描重建任务上验证了GTP。实验表明,GTP能有效融合互补的跨模态信息,在严重欠采样条件下仍实现高保真重建。
原文摘要 · Abstract (English)
The ability to leverage images from co-available modalities to inform target-domain reconstruction is highly desirable in imaging algorithms. In this work, we introduce Generative Translation Priors (GTP)--a Bayesian framework that transforms diffusion-based image-to-image translation models into cross-modality image priors for ill-posed imaging inverse problems. GTP incorporates target-domain measurements through likelihood guidance, steering the translation process toward the desired posterior distribution. The framework is grounded in a theoretical analysis of the resulting posterior dynamics, which reveals an intrinsic bias introduced by likelihood guidance. We further characterize this bias and derive a ground-truth-free formulation for its estimation, enabling it to serve as a practical metric for assessing posterior sampling quality. Building on this analysis, we derive two discretized GTP algorithms based on gradient and proximal likelihood guidance, respectively. We validate GTP on computed tomography reconstruction with magnetic resonance side information, and on positron emission tomography reconstruction with computed tomography side information. Experiments demonstrate that GTP effectively incorporates complementary cross-modality information and achieves high-fidelity reconstruction even under severely undersampled measurements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。