arXiv:2604.21066cs.CVcs.LG2026-04

仅用一张图像优化扩散先验,提升重建可信度。

Optimizing Diffusion Priors in Image Reconstruction from a Single Observation

论文配图:Optimizing Diffusion Priors in Image Reconstruction from a Single Observation
图 1 · 摘自论文原文
  • 将多个扩散先验合并为乘积专家模型,通过证据最大化确定权重
  • 在单张观测下实现黑洞成像与去模糊,重建质量显著优于基线
  • 适合数据稀缺场景,尤其适用于真实世界逆问题重建

尽管扩散先验在多种逆问题中能生成高质量后验样本,但其训练通常依赖有限或纯模拟数据,易继承源数据中的误差与偏差。现有微调方法需大量不同前向算子的观测数据,难以获取且小样本时易过拟合。本文提出一种仅基于单张观测的先验优化方法:将现有扩散先验组合为乘积专家先验,并通过最大化贝叶斯证据来确定最优指数权重。我们在真实逆问题上验证该方法,包括真先验未知的黑洞成像,以及文本条件先验下的图像去模糊。结果表明,证据常在超越单一数据集训练先验的组合上达到最大。通过指数加权泛化先验,本方法可从温度化与组合扩散模型中采样,生成更灵活、可信的后验图像分布。

原文摘要 · Abstract (English)

While diffusion priors generate high-quality posterior samples across many inverse problems, they are often trained on limited training sets or purely simulated data, thus inheriting the errors and biases of these underlying sources. Current approaches to finetuning diffusion models rely on a large number of observations with varying forward operators, which can be difficult to collect for many applications, and thus lead to overfitting when the measurement set is small. We propose a method for tuning a prior from only a single observation by combining existing diffusion priors into a single product-of-experts prior and identifying the exponents that maximize the Bayesian evidence. We validate our method on real-world inverse problems, including black hole imaging, where the true prior is unknown a priori, and image deblurring with text-conditioned priors. We find that the evidence is often maximized by priors that extend beyond those trained on a single dataset. By generalizing the prior through exponent weighting, our approach enables posterior sampling from both tempered and combined diffusion models, yielding more flexible priors that improve the trustworthiness of the resulting posterior image distribution.

扩散模型图像重建先验优化单图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。