arXiv:2601.03526cs.CV2026-01

解决热成像无人机图像超分辨中的物理不一致问题

Physics-Constrained Cross-Resolution Enhancement Network for Optics-Guided Thermal UAV Image Super-Resolution

  • 设计双向跨分辨率增强模块,保留高频光学先验
  • 引入热传导物理模型,抑制纹理失真和边缘模糊
  • 适合需要高精度热成像的无人机监测应用

光学引导的热成像无人机图像超分辨在全天候监控中具有重要价值。现有方法通常压缩光学特征以匹配热成像特征维度,导致高频信息丢失,并因忽略模态间成像物理差异,引入纹理扭曲、边缘模糊等不一致伪影。为此,提出PCNet实现光学与热成像跨分辨率互增强,通过热传导物理约束光学引导过程,提升热成像超分辨鲁棒性。设计交叉分辨率互增强模块(CRME),联合优化热图像超分辨与光学到热成像转换,促进多分辨率下双向特征交互并保留高频光学先验。提出物理驱动热传导模块(PDTM),将二维热传导引入光学引导,建模空间变化的热传导特性以防止不一致伪影。引入温度一致性损失,强制区域分布一致性和边界梯度平滑性,确保生成热图符合真实热辐射规律。在VGTSR2.0和DroneVehicle数据集上的大量实验表明,PCNet显著优于当前最优方法,在重建质量及语义分割、目标检测等下游任务上表现更优。

原文摘要 · Abstract (English)

Optics-guided thermal UAV image super-resolution has attracted significant research interest due to its potential in all-weather monitoring applications. However, existing methods typically compress optical features to match thermal feature dimensions for cross-modal alignment and fusion, which not only causes the loss of high-frequency information that is beneficial for thermal super-resolution, but also introduces physically inconsistent artifacts such as texture distortions and edge blurring by overlooking differences in the imaging physics between modalities. To address these challenges, we propose PCNet to achieve cross-resolution mutual enhancement between optical and thermal modalities, while physically constraining the optical guidance process via thermal conduction to enable robust thermal UAV image super-resolution. In particular, we design a Cross-Resolution Mutual Enhancement Module (CRME) to jointly optimize thermal image super-resolution and optical-to-thermal modality conversion, facilitating effective bidirectional feature interaction across resolutions while preserving high-frequency optical priors. Moreover, we propose a Physics-Driven Thermal Conduction Module (PDTM) that incorporates two-dimensional heat conduction into optical guidance, modeling spatially-varying heat conduction properties to prevent inconsistent artifacts. In addition, we introduce a temperature consistency loss that enforces regional distribution consistency and boundary gradient smoothness to ensure generated thermal images align with real-world thermal radiation principles. Extensive experiments on VGTSR2.0 and DroneVehicle datasets demonstrate that PCNet significantly outperforms state-of-the-art methods on both reconstruction quality and downstream tasks including semantic segmentation and object detection.

图像超分辨热成像无人机物理约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。