突破生成模型在逆问题中的高频结构丢失瓶颈
Hybrid-Domain Posterior Sampling for Inverse Problems via Latent Flow Matching

- 分域采样:在像素空间用Langevin动态吸收测量梯度,再投影回生成流形
- 实测超越现有方法,在超分辨率、去模糊等任务中恢复出缺失的高频细节
- 适合需要高保真重建的医学成像、遥感等精密逆问题场景
潜在流模型虽推动了压缩空间图像生成,但在高保真逆问题中仍受限。本文指出根本原因在于预训练自编码器的几何缺陷——一阶流形盲区:当解码器压缩至仅保留约2%原始自由度时,其雅可比矩阵秩不足,导致正交补空间中的高频测量残差对潜在梯度不可见,即使解码器能表示目标图像。为此,我们提出分域后验采样(HDPS),一种解耦物理一致性与语义先验建模的推断框架。HDPS在像素空间采用Langevin动力学吸收精确的正交测量梯度,随后将结构修正投影回生成流形。引入基于优化的潜在对齐机制,在去除像素空间伪影的同时避免直接编码引发的语义漂移。在多种逆问题上的实验表明,HDPS建立新基准,成功恢复了潜变量模型固有丢弃的高频结构精度。代码已开源。
原文摘要 · Abstract (English)
Latent Flow Models have revolutionized compressed-space image synthesis, yet their application to high-fidelity inverse problems remains bottlenecked. In this paper, we trace this dilemma to a fundamental geometric limitation of pre-trained autoencoders, which we term \emph{First-Order Manifold Blindness}. Severe decoder compression (e.g., retaining only $\sim\!2\%$ of the original degrees of freedom) produces a rank-deficient Jacobian, rendering high-frequency measurement residuals in its orthogonal complement invisible to latent gradients even when the decoder can represent the target image. To overcome this bottleneck, we propose Hybrid-Domain Posterior Sampling (HDPS), a decoupled inference framework that disentangles physical measurement consistency from semantic prior modeling. HDPS diverges into the pixel space, leveraging Langevin dynamics to absorb precise orthogonal measurement gradients, and subsequently projects these structural corrections back onto the generative manifold. An optimization-based latent alignment is introduced to filter pixel-space artifacts while avoiding the semantic drift of direct encoding. Extensive experiments on diverse inverse problems demonstrate that HDPS establishes a new state-of-the-art, successfully recovering the high-frequency structural precision that latent-only solvers inherently discard. The code is available at \href{https://github.com/74587887/HDPS}{https://github.com/74587887/HDPS}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。