arXiv:2608.00083cs.CV2026-08

用地图和小波变换生成卫星图,解决缺数据地区影像更新难题

Beyond Edge Maps: Wavelet-Domain Conditioning for Multi-Adapter Map-to-Satellite Diffusion

论文配图:Beyond Edge Maps: Wavelet-Domain Conditioning for Multi-Adapter Map-to-Satellite Diffusion
图 1 · 摘自论文原文
  • 仅用地图与小波子带作条件,不依赖目标影像
  • 多适配器融合提升图像结构与细节质量,8组对比中6胜
  • 适合低资源地区遥感图像合成,尤其地形复杂区

商业制图合作在资源匮乏地区常不可得,导致卫星底图过时,亟需从独立维护的地图数据合成卫星影像。现有基于ControlNet的扩散模型通常依赖目标图像自身的边缘或分割信号,假设影像已存在,限制了其在最需要合成的区域的应用。地图条件替代方案虽引入边缘等线索,但忽略了频域结构。本文提出一种仅依赖可独立获取的制图源(如OpenStreetMap栅格地图及其平稳小波变换子带)的控制扩散框架,首次将小波子带用于地图转卫星任务。两个分别训练于地图与小波表示的ControlNet适配器通过MultiControlNet融合,在不重新训练多输入模型的前提下联合利用空间结构与频率细节。在为尼泊尔(数据稀缺、地形多样)构建的新配对数据集上评估,结合条件在八项指标中六胜——包括两数据集的SSIM与PSNR,以及我们数据集上的LPIPS(Alex与VGG双后端),并在Pix2Pix LPIPS上与仅地图条件持平,仍略胜仅小波条件。仅小波条件在两数据集上取得最低FID,表现图像保真与分布真实性的权衡。鉴于测试集较小且FID存在小样本偏差,该差距持谨慎态度。

原文摘要 · Abstract (English)

Commercial mapping partnerships are often unavailable in low-resource regions, leaving satellite basemaps stale and motivating synthesis of satellite imagery from independently maintained cartographic data. Existing ControlNet-based diffusion methods typically condition on structural signals like edges or segmentation extracted from the target image itself, assuming the imagery already exists and limiting their use exactly where synthesis matters most. Map-conditioned alternatives add cues like edge detection but omit frequency-domain structure. We propose a ControlNet-based diffusion framework conditioned only on cartographic sources obtainable independently of the target imagery: OpenStreetMap (OSM) raster maps and their stationary wavelet transform (SWT) subbands, a conditioning signal previously unexplored for map-to-satellite diffusion. Two ControlNet adapters, trained separately on the map and wavelet representations atop a frozen Stable Diffusion backbone, are fused via MultiControlNet, jointly drawing on spatial structure and frequency detail without retraining a multi-input model. We evaluate on a new paired map-satellite dataset curated for Nepal, a data-scarce, topographically diverse region, alongside the Pix2Pix maps-satellite benchmark. Combined conditioning wins six of eight metric-dataset comparisons -- SSIM and PSNR on both datasets, plus LPIPS (both Alex and VGG backbones) on ours and ties map-only on both Pix2Pix LPIPS backbones while still edging past wavelet-only there. Wavelet-only takes the lowest FID on both datasets, matching the tradeoff between per-image fidelity and distributional realism. We treat this gap cautiously given our modest test-set sizes and FID's known small-sample bias.

图像生成扩散模型地图转卫星小波变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。