用扩散模型重建真实稀疏视角CT数据,发现域偏移影响大
Towards reconstructing experimental sparse-view X-ray CT data with diffusion models
- 用分解扩散采样框架,结合合成数据训练的扩散先验
- 域偏移严重时模型崩溃,但多样先验表现更优
- 调整似然权重可缓解前向模型偏差,适合医学成像研究
基于扩散的图像生成器在稀疏视角X射线计算机断层扫描(CT)等病态逆问题中表现出良好前景。然而多数研究依赖合成数据,真实实验数据中的域偏移或前向模型不匹配是否影响其应用尚不明确。我们采集了与合成Shepp-Logan幻影相似的物理幻影的CT数据,使用不同域偏移程度的合成数据集训练扩散先验,并在逐步增加难度的稀疏视角数据集上应用这些先验,最终处理实验数据。结果表明:域偏移作用复杂——严重不匹配会导致模型崩溃和幻觉;而多样化的先验在性能上可超越匹配但单一的先验。前向模型不匹配会使图像样本偏离先验流形,引发伪影,但通过采用退火似然权重调度可有效缓解,同时提升计算效率。总体而言,合成数据上的性能优势无法直接迁移到真实数据,未来工作必须在真实世界基准上验证。
原文摘要 · Abstract (English)
Diffusion-based image generators are promising priors for ill-posed inverse problems like sparse-view X-ray Computed Tomography (CT). As most studies consider synthetic data, it is not clear whether training data mismatch (``domain shift'') or forward model mismatch complicate their successful application to experimental data. We measured CT data from a physical phantom resembling the synthetic Shepp-Logan phantom and trained diffusion priors on synthetic image data sets with different degrees of domain shift towards it. Then, we employed the priors in a Decomposed Diffusion Sampling scheme on sparse-view CT data sets with increasing difficulty leading to the experimental data. Our results reveal that domain shift plays a nuanced role: while severe mismatch causes model collapse and hallucinations, diverse priors match or exceed well-matched but narrow priors. Forward model mismatch pulls the image samples away from the prior manifold, which causes artifacts but can be mitigated with annealed likelihood weight schedules that also increase computational efficiency. Overall, we demonstrate that performance gains do not immediately translate from synthetic to experimental data, and future development must validate against real-world benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。