用生成模型提升低分辨率影像质量,实现少标注下的精准树木分割。
Data Augmentation and Resolution Enhancement using GANs and Diffusion Models for Tree Segmentation
- 结合GAN与扩散模型,生成结构一致的高质合成影像以扩增数据。
- 低分辨率图像的分割交并比(IoU)提升超50%,显著优于传统方法。
- 适合数据稀缺的遥感场景,尤其适用于城市森林监测与规划。
城市森林对改善环境质量和维护生物多样性至关重要。精确识别树木对城市规划与保护具有重要意义,但复杂地形及不同卫星传感器或无人机飞行高度导致的图像分辨率差异使检测困难。尽管深度学习表现良好,其效果仍依赖大规模人工标注数据,而这类数据获取成本高、数量难保障。本文提出一种新流程,融合域适应技术与GAN及扩散模型,提升低分辨率航拍影像质量。该流程在保持语义内容的前提下增强图像清晰度,使无需大量标注数据即可实现有效树木分割。利用pix2pix、Real-ESRGAN、Latent Diffusion和Stable Diffusion等模型生成真实且结构一致的合成样本,扩充训练集并统一多源数据尺度。该方法不仅提升了分割模型在不同采集条件下的鲁棒性,还为标注资源匮乏的遥感场景提供了可扩展、可复现的解决方案。实验表明,低分辨率图像的交并比(IoU)提升超过50%,显著优于传统流程。
原文摘要 · Abstract (English)
Urban forests play a key role in enhancing environmental quality and supporting biodiversity in cities. Mapping and monitoring these green spaces are crucial for urban planning and conservation, yet accurately detecting trees is challenging due to complex landscapes and the variability in image resolution caused by different satellite sensors or UAV flight altitudes. While deep learning architectures have shown promise in addressing these challenges, their effectiveness remains strongly dependent on the availability of large and manually labeled datasets, which are often expensive and difficult to obtain in sufficient quantity. In this work, we propose a novel pipeline that integrates domain adaptation with GANs and Diffusion models to enhance the quality of low-resolution aerial images. Our proposed pipeline enhances low-resolution imagery while preserving semantic content, enabling effective tree segmentation without requiring large volumes of manually annotated data. Leveraging models such as pix2pix, Real-ESRGAN, Latent Diffusion, and Stable Diffusion, we generate realistic and structurally consistent synthetic samples that expand the training dataset and unify scale across domains. This approach not only improves the robustness of segmentation models across different acquisition conditions but also provides a scalable and replicable solution for remote sensing scenarios with scarce annotation resources. Experimental results demonstrated an improvement of over 50% in IoU for low-resolution images, highlighting the effectiveness of our method compared to traditional pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。