让扩散模型无缝处理超大遥感图像,细节更清晰。
InfScene-SR: Seamless Super-Resolution of Arbitrarily Large Remote-Sensing Scenes via Variance-Preserving Joint Denoising

- 提出独立去噪融合方法,解决大图超分中的噪声模糊问题。
- 在5倍超分任务中,实现无接缝、高保真且细节锐利的图像重建。
- 适合需要超大场景超分的遥感分析与地物识别研究者使用。
扩散模型在超分辨率(SR)中提供最佳视觉质量,但其架构和训练限制其仅适用于小尺寸固定图像块。实际遥感应用需无缝处理规模大得多的图像场景。联合去噪通过每一步反向过程融合重叠块,使文本到图像扩散模型生成超出其训练块大小的内容,但该方法依赖确定性常微分方程(ODE)采样器。而如SR3等SR模型采用随机采样器时,平均操作会部分抵消各块独立的噪声,导致已知的方差衰减,模糊应恢复的细节,必须纠正。本文将方差校正融合引入条件超分,推导出空间解耦方差校正(SDVC),一种精确重构方法:用单次累加的独立块贡献替代每步全局归一化,将原本耦合的每步计算变为局部块独立并行处理。由此构建的InfScene-SR管道可在多GPU上并行运行,实现任意大场景超分。基于NAIP航空影像构建的5×超分任务中,我们以保真度、感知质量、接缝连续性与忠实度指标评估全幅图像。在同一主干网络下,InfScene-SR是唯一同时实现无缝与清晰的融合策略,合成细节最接近低分辨率观测,且在下游入侵植物分割任务中与原生高分辨率图像的交并比(IoU)差距小于0.003。代码已开源于https://github.com/TitorX/infscene-sr。
原文摘要 · Abstract (English)
Diffusion models now give the best perceptual quality in super-resolution (SR), but their architecture and training confine them to small fixed crops. Operational remote sensing needs seamless scenes orders of magnitude larger. Joint denoising fuses overlapping tiles at every reverse step and lets text-to-image diffusion generate beyond its training crop, but it assumes deterministic ODE samplers. With the stochastic sampler of SR models such as SR3, the averaging also partly cancels independent per-tile noise. This known variance erosion blurs the detail SR should recover and must be corrected. We carry variance-corrected fusion to conditional SR and derive Spatially-Decoupled Variance Correction (SDVC), an exact reformulation that replaces per-step global normalization with independent per-tile contributions accumulated in one additive pass. SDVC turns the coupled per-step computation into independent tile-local work, so the resulting pipeline, InfScene-SR, runs in parallel across GPUs and makes SR of arbitrarily large scenes feasible. On a 5$\times$ SR task built from NAIP aerial imagery, we evaluate whole scenes with fidelity, perceptual, seam-continuity, and faithfulness metrics. Under one backbone, InfScene-SR is the only fusion strategy that is seamless and sharp at once, the closest to the low-resolution observation among those that synthesize detail, and within 0.003 IoU of native high-resolution imagery on downstream invasive-plant segmentation. Code is available at https://github.com/TitorX/infscene-sr.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。