arXiv:2505.10630cs.LGmath.ST2025-05NeurIPS被引 2

揭示贝叶斯反问题中测量数与先验复杂度的关系,为深度生成先验提供理论支持。

How many measurements are enough? Bayesian recovery in inverse problems with general distributions

  • 基于近似覆盖数和前向算子的集中性,给出非渐近样本复杂度上界。
  • 深度生成先验下,样本数随隐空间维数k呈对数线性增长。
  • 适用于任意分布的贝叶斯反问题,特别适合研究生成模型在逆问题中的应用。

本文研究在一般先验、正向算子和噪声分布下,贝叶斯恢复的样本复杂度。考虑根据近似先验 $\\$\mathcal{P}$\$$ 进行后验采样,建立了稳定且高概率准确恢复的充分条件。主要结果是一个非渐近界,表明样本复杂度取决于(i)$\\$\mathcal{P}$\$$ 的内在复杂度,由其近似覆盖数刻画;(ii)正向算子和噪声分布的集中性界。作为关键应用,我们聚焦生成先验,其中 $\\$\mathcal{P}$\$$ 是通过深度神经网络(DNN)将潜在分布映射得到的。我们证明样本复杂度关于隐空间维数 $k$ 呈对数线性增长,从而验证了基于 DNN 的先验的有效性。进一步推广了关于正交矩阵 $U$ 随机采样的经典确定性恢复结果,指出样本复杂度由 $U$ 与 $\\$\mathcal{P}$\$$ 支持集的相干性决定。因此,我们确立了相干性在贝叶斯恢复中的基础作用。整体框架统一并扩展了先前工作,为任意分布下的贝叶斯反问题提供了严格的样本复杂度保证。

原文摘要 · Abstract (English)

We study the sample complexity of Bayesian recovery for solving inverse problems with general prior, forward operator and noise distributions. We consider posterior sampling according to an approximate prior $\mathcal{P}$, and establish sufficient conditions for stable and accurate recovery with high probability. Our main result is a non-asymptotic bound that shows that the sample complexity depends on (i) the intrinsic complexity of $\mathcal{P}$, quantified by its so-called approximate covering number, and (ii) concentration bounds for the forward operator and noise distributions. As a key application, we specialize to generative priors, where $\mathcal{P}$ is the pushforward of a latent distribution via a Deep Neural Network (DNN). We show that the sample complexity scales log-linearly with the latent dimension $k$, thus establishing the efficacy of DNN-based priors. Generalizing existing results on deterministic (i.e., non-Bayesian) recovery for the important problem of random sampling with an orthogonal matrix $U$, we show how the sample complexity is determined by the coherence of $U$ with respect to the support of $\mathcal{P}$. Hence, we establish that coherence plays a fundamental role in Bayesian recovery as well. Overall, our framework unifies and extends prior work, providing rigorous guarantees for the sample complexity of solving Bayesian inverse problems with arbitrary distributions.

贝叶斯反问题生成先验样本复杂度深度生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。