arXiv:2608.11747cs.CV2026-08

优化图像逆问题求解中每一步的信息分配,提升重建质量。

Making Every Step Count: Spatio-Temporal Information Allocation for Imaging Inverse Problems

论文配图:Making Every Step Count: Spatio-Temporal Information Allocation for Imaging Inverse Problems
图 1 · 摘自论文原文
  • 根据退化谱和信噪比几何分布动态分配计算步数,平衡探索与细化。
  • 通过数据与先验冲突引导信息流向未观测区域,增强结构保真度。
  • 无需重训练即可接入现有模型,适用于超分辨率等常见任务。

基于流的生成模型已成为无需训练的图像逆问题求解强大先验,能捕捉连贯语义与精细结构。然而,现有方法多关注单步更新设计,忽视在固定函数评估次数(NFE)下时空信息分配问题。时间上,早期探索不足易使流轨迹陷入错误语义盆地;过早消耗大量NFE则削弱后期精修能力。空间上,数据一致性仅在观测区域提供约束,缺失区域恢复主要依赖生成先验。为此,本文提出两个互补且无需训练的组件:频谱自适应调度(SAS)与测量优先注意力(MPA)。SAS根据退化谱和对数信噪比几何分布分配可用NFE,更优平衡语义探索与细节精修。MPA利用数据-先验冲突引导信息向弱约束区域传播,提升语义与结构保真度。在超分辨率、运动去模糊、图像修复等标准任务上的实验表明,所提方法可无痛集成至现有流式逆解器,无需重训练或额外模型评估,显著提升现有求解器的重建质量。

原文摘要 · Abstract (English)

Flow-based generative models have emerged as powerful image priors for training-free inverse problem solving, capturing coherent semantics and fine-grained structure. Despite these strengths, existing flow-based inverse solvers primarily focus on the design of individual updates, largely overlooking spatio-temporal information allocation under a fixed number of function evaluations (NFEs). Temporally, insufficient early exploration can trap the flow trajectory in an incorrect semantic basin, whereas excessive allocation of NFEs to early stages leaves little budget for late-stage refinement. Spatially, data consistency provides direct constraints only within observed regions, whereas the recovery of missing regions relies mainly on the generative prior. To address these two issues, we introduce two complementary and training-free components, i.e., Spectrum-Adaptive Scheduling (SAS) and Measurement-Prioritized Attention (MPA). For temporal allocation, SAS distributes the available NFEs over flow time according to the degradation spectrum and logSNR geometry, thus better balancing semantic exploration and detail refinement. For spatial propagation, MPA exploits data-prior conflicts to guide information toward weakly constrained regions, thereby enhancing semantic and structural fidelity. Extensive experiments on standard image inverse problems, e.g., super-resolution, motion deblurring, and inpainting, demonstrate that the proposed components can be integrated into existing flow-based inverse solvers in a plug-and-play manner without retraining or additional flow-model evaluations, and can also significantly improve the restoration quality of existing solvers.

图像重建生成模型流模型逆问题

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。