针对遥感图像纹理不均问题,提出感知纹理分布的扩散模型。
Remote Sensing Image Super-Resolution for Imbalanced Textures: A Texture-Aware Diffusion Framework

- 通过相对纹理密度图显式建模纹理分布
- 在损失、采样和生成中动态调节纹理区域
- 有效减少纹理幻觉,提升下游任务性能
生成式扩散先验在自然图像超分辨率中表现卓越,能合成逼真的细节。然而直接应用于遥感图像超分辨率(RSISR)时存在明显不足。遥感图像具有全局随机、局部聚集的独特纹理分布,导致纹理极不均衡,严重阻碍模型的空间感知能力。为此,我们提出TexADiff框架:首先估计相对纹理密度图(RTDM)以表征纹理分布;随后将该图用于三个协同机制:作为显式空间条件引导扩散过程,作为损失调制项优先关注纹理丰富区域,以及作为采样调度的动态适配器。这些设计使模型具备明确的纹理感知能力。实验表明,TexADiff在定量指标上达到领先或相当水平;定性结果也显示,模型能生成真实高频细节,有效抑制纹理幻觉。这种更优的重建质量还带来了下游任务性能的显著提升。代码已开源:https://github.com/ZezFuture/TexAdiff。
原文摘要 · Abstract (English)
Generative diffusion priors have recently achieved state-of-the-art performance in natural image super-resolution, demonstrating a powerful capability to synthesize photorealistic details. However, their direct application to remote sensing image super-resolution (RSISR) reveals significant shortcomings. Unlike natural images, remote sensing images exhibit a unique texture distribution where ground objects are globally stochastic yet locally clustered, leading to highly imbalanced textures. This imbalance severely hinders the model's spatial perception. To address this, we propose TexADiff, a novel framework that begins by estimating a Relative Texture Density Map (RTDM) to represent the texture distribution. TexADiff then leverages this RTDM in three synergistic ways: as an explicit spatial conditioning to guide the diffusion process, as a loss modulation term to prioritize texture-rich regions, and as a dynamic adapter for the sampling schedule. These modifications are designed to endow the model with explicit texture-aware capabilities. Experiments demonstrate that TexADiff achieves superior or competitive quantitative metrics. Furthermore, qualitative results show that our model generates faithful high-frequency details while effectively suppressing texture hallucinations. This improved reconstruction quality also results in significant gains in downstream task performance. The source code of our method can be found at https://github.com/ZezFuture/TexAdiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。