arXiv:2410.20466eess.IVcs.CV2024-10被引 7

分离光学图像属性,提升无人机热成像超分辨率鲁棒性

Guidance Disentanglement Network for Optics-Guided Thermal UAV Image Super-Resolution

  • 按无人机场景属性解耦光学图像特征,生成适应不同条件的引导信息
  • 在低光和雾霾等挑战环境下,性能优于当前最优方法
  • 适用于复杂场景下无人机热成像增强,尤其适合安防与农业应用

光学引导的热成像无人机超分辨率(OTUAV-SR)因在安全巡检、农业测量和目标检测中的潜力而受到广泛关注。现有方法通常使用单一引导模型从光学图像生成引导特征,但在无人机复杂场景下的良好与恶劣条件下难以生成有效引导特征,限制了性能。为此,本文提出新型引导解耦网络(GDNet),根据典型无人机场景属性对光学图像表征进行解耦,分别生成良好与恶劣条件下的引导特征,实现更鲁棒的OTUAV-SR。此外,设计属性感知融合模块,整合多属性引导特征,形成更具判别力的表示,适配属性无关的引导过程。为推动复杂无人机场景下的研究,构建了大规模基准数据集VGTSR2.0,包含3,500对在多样化条件与场景下采集的光学-热成像配对图像。在VGTSR2.0上的大量实验表明,GDNet显著优于当前最优方法,尤其在低光和雾天等挑战性环境中表现突出。代码与数据集将公开于https://github.com/Jocelyney/GDNet。

原文摘要 · Abstract (English)

Optics-guided Thermal UAV image Super-Resolution (OTUAV-SR) has attracted significant research interest due to its potential applications in security inspection, agricultural measurement, and object detection. Existing methods often employ single guidance model to generate the guidance features from optical images to assist thermal UAV images super-resolution. However, single guidance models make it difficult to generate effective guidance features under favorable and adverse conditions in UAV scenarios, thus limiting the performance of OTUAV-SR. To address this issue, we propose a novel Guidance Disentanglement network (GDNet), which disentangles the optical image representation according to typical UAV scenario attributes to form guidance features under both favorable and adverse conditions, for robust OTUAV-SR. Moreover, we design an attribute-aware fusion module to combine all attribute-based optical guidance features, which could form a more discriminative representation and fit the attribute-agnostic guidance process. To facilitate OTUAV-SR research in complex UAV scenarios, we introduce VGTSR2.0, a large-scale benchmark dataset containing 3,500 aligned optical-thermal image pairs captured under diverse conditions and scenes. Extensive experiments on VGTSR2.0 demonstrate that GDNet significantly improves OTUAV-SR performance over state-of-the-art methods, especially in the challenging low-light and foggy environments commonly encountered in UAV scenarios. The dataset and code will be publicly available at https://github.com/Jocelyney/GDNet.

超分辨率无人机热成像图像融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。