arXiv:2511.19117cs.CVphysics.optics2025-11中稿 · CVPR被引 2

无需标定的多相机热成像增强,提升手机热成像清晰度。

3M-TI: High-Quality Mobile Thermal Imaging via Calibration-free Multi-Camera Cross-Modal Diffusion

论文配图:3M-TI: High-Quality Mobile Thermal Imaging via Calibration-free Multi-Camera Cross-Modal Diffusion
图 1 · 摘自论文原文
  • 用跨模态自注意力替代原注意力,自动对齐热图与可见光特征。
  • 在真实手机设备上实现最优画质,显著提升目标检测与分割性能。
  • 免标定设计适合移动端部署,实用性强。

移动端热成像传感器微型化导致空间分辨率和纹理保真度受限,图像模糊且信息量不足。现有热成像超分辨率方法分为单图与基于可见光引导两类:前者难以从有限信息中恢复细结构,后者依赖精确且耗时的跨相机标定,制约实际应用与鲁棒性。本文提出3M-TI,一种免标定的多相机跨模态扩散框架,用于移动热成像。核心是将跨模态自注意力模块(CSM)嵌入扩散UNet,替换原有自注意力层,在去噪过程中自适应对齐热图与可见光特征,无需显式标定。该设计使扩散网络利用生成先验,有效提升超分辨热图的空间分辨率、结构保真度与纹理细节。在真实移动端热相机及公开基准上的大量实验验证了其卓越性能,视觉质量与量化指标均达当前最优。更重要的是,3M-TI增强后的热图显著提升目标检测与分割等下游任务表现,凸显其在稳健移动端热感知系统中的实用价值。

原文摘要 · Abstract (English)

The miniaturization of thermal sensors for mobile platforms inherently limits their spatial resolution and textural fidelity, leading to blurry and less informative images. Existing thermal super-resolution (SR) methods can be grouped into single-image and RGB-guided approaches: the former struggles to recover fine structures from limited information, while the latter relies on accurate and laborious cross-camera calibration, which hinders practical deployment and robustness. Here, we propose 3M-TI, a calibration-free Multi-camera cross-Modality diffusion framework for Mobile Thermal Imaging. At its core, 3M-TI integrates a cross-modal self-attention module (CSM) into the diffusion UNet, replacing the original self-attention layers to adaptively align thermal and RGB features throughout the denoising process, without requiring explicit camera calibration. This design enables the diffusion network to leverage its generative prior to enhance spatial resolution, structural fidelity, and texture detail in the super-resolved thermal images. Extensive evaluations on real-world mobile thermal cameras and public benchmarks validate our superior performance, achieving state-of-the-art results in both visual quality and quantitative metrics. More importantly, the thermal images enhanced by 3M-TI lead to substantial gains in critical downstream tasks like object detection and segmentation, underscoring its practical value for robust mobile thermal perception systems. More materials: https://github.com/work-submit/3MTI.

热成像扩散模型超分辨率多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。