arXiv:2507.12103cs.CVcs.CY2025-07IJCAI被引 3

用文本控制生成城市阴影图,助力高温下智能导航

DeepShade: Enable Shade Simulation by Text-conditioned Image Generation

  • 基于3D模拟构建多场景阴影数据集,匹配卫星图像
  • 扩散模型融合边缘特征与对比学习,精准生成动态阴影
  • 可按时间/光照条件生成阴影,适合城市热环境研究

热浪对公共健康构成严重威胁,尤其在全球变暖加剧的背景下。然而,当前导航系统(如在线地图)因难以从噪声卫星影像中直接估计阴影,且生成模型训练数据有限,无法纳入阴影信息。本文提出两大贡献:首先,构建覆盖不同经纬度、建筑密度和城市布局的大型数据集,利用Blender进行3D模拟,结合建筑轮廓在全年不同时间、太阳天顶角下生成建筑阴影,并与卫星图像对齐,形成丰富的阴影学习资源;其次,提出DeepShade——一种基于扩散的模型,通过联合考虑RGB图像与Canny边缘层,强调边缘细节,并引入对比学习捕捉阴影随时间变化的规律。该模型可根据文本描述(如时间、太阳角度)生成相应阴影图像。我们在亚利桑那州坦佩市验证了其在真实路线规划中计算阴影比例的应用价值。本工作有助于极端高温下的城市规划,具有实际环境应用潜力。

原文摘要 · Abstract (English)

Heatwaves pose a significant threat to public health, especially as global warming intensifies. However, current routing systems (e.g., online maps) fail to incorporate shade information due to the difficulty of estimating shades directly from noisy satellite imagery and the limited availability of training data for generative models. In this paper, we address these challenges through two main contributions. First, we build an extensive dataset covering diverse longitude-latitude regions, varying levels of building density, and different urban layouts. Leveraging Blender-based 3D simulations alongside building outlines, we capture building shadows under various solar zenith angles throughout the year and at different times of day. These simulated shadows are aligned with satellite images, providing a rich resource for learning shade patterns. Second, we propose the DeepShade, a diffusion-based model designed to learn and synthesize shade variations over time. It emphasizes the nuance of edge features by jointly considering RGB with the Canny edge layer, and incorporates contrastive learning to capture the temporal change rules of shade. Then, by conditioning on textual descriptions of known conditions (e.g., time of day, solar angles), our framework provides improved performance in generating shade images. We demonstrate the utility of our approach by using our shade predictions to calculate shade ratios for real-world route planning in Tempe, Arizona. We believe this work will benefit society by providing a reference for urban planning in extreme heat weather and its potential practical applications in the environment.

阴影生成扩散模型城市规划文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。