无需干净数据,通过黑箱噪声模型重建生成模型。
Generative Modeling from Black-box Corruptions via Self-Consistent Stochastic Interpolants
- 用随机插值迭代逼近反向噪声通道,仅需污染数据和黑箱噪声函数。
- 在图像修复与科学重建任务中性能超越现有方法,收敛性有理论保证。
- 适合无干净数据、噪声模型复杂但可访问的科研与工程场景。
基于传输的方法已成为构建来自大规模清洁数据集的生成模型的主流范式。然而,在许多科学和工程领域,清洁数据往往不可得:我们仅能观测到通过噪声且病态的信道污染后的测量值。因此,原始数据的生成模型需要在分布层面求解逆问题。本文提出一种新方法,基于随机插值:通过仅访问污染数据集以及对污染通道的黑箱访问,迭代更新污染与清洁数据样本间的传输映射。在适当条件下,该迭代过程收敛至自洽的传输映射,有效反转污染通道,从而实现对清洁数据的生成建模。我们称该方法为自洽随机插值(SCSI)。其具有:(i) 相比变分方法计算效率更高;(ii) 极高灵活性,仅需黑箱访问即可处理任意非线性前向模型;(iii) 理论保证。我们在自然图像处理和科学重建中的逆问题上展示了优越性能,并在合理假设下建立了该方案的收敛性保证。源代码公开于 https://github.com/modichirag/SCSI。
原文摘要 · Abstract (English)
Transport-based methods have emerged as a leading paradigm for building generative models from large, clean datasets. However, in many scientific and engineering domains, clean data are often unavailable: instead, we only observe measurements corrupted through a noisy, ill-conditioned channel. A generative model for the original data thus requires solving an inverse problem at the level of distributions. In this work, we introduce a novel approach to this task based on Stochastic Interpolants: we iteratively update a transport map between corrupted and clean data samples using only access to the corrupted dataset as well as black box access to the corruption channel. Under appropriate conditions, this iterative procedure converges towards a self-consistent transport map that effectively inverts the corruption channel, thus enabling a generative model for the clean data. We refer to the resulting method as the self-consistent stochastic interpolant (SCSI). It (i) is computationally efficient compared to variational alternatives, (ii) highly flexible, handling arbitrary nonlinear forward models with only black-box access, and (iii) enjoys theoretical guarantees. We demonstrate superior performance on inverse problems in natural image processing and scientific reconstruction, and establish convergence guarantees of the scheme under appropriate assumptions. Our source code is publicly available at https://github.com/modichirag/SCSI
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。