arXiv:2609.03585cs.CV2026-09

用文字描述物理属性,生成逼真热成像图

Text2Thermal: Physics-Aware Thermal Image Synthesis from Textual Priors

论文配图:Text2Thermal: Physics-Aware Thermal Image Synthesis from Textual Priors
图 1 · 摘自论文原文
  • 用文本显式指定材料、天气等热辐射参数,解决可见光转热图的歧义问题
  • 在M3FD、FLIR、FMB数据集上FID达当前最优,且无需配对可见图像
  • 支持文本级控制,适合需要精准热特征生成的研究者

热红外成像在黑暗和恶劣天气下仍能可靠感知,但热成像数据集稀缺,促使大量研究致力于从丰富的RGB图像生成热图。然而,该任务本质病态:热外观由表面发射率和物体温度决定,这些在可见光中不可见,导致单张RGB图像对应多种有效热输出。本文认为语言可自然化解此歧义,提出Text2Thermal框架,通过热学语义的文本提示(包含材料、天气、时间、发热状态)显式提供辐射物理参数,并适配预训练Stable Diffusion模型至热域。因辐射内容完全由提示决定,该方法推理时无需注册的RGB图像;若需空间引导,可附加控制信号传递场景结构而不干扰提示定义的辐射特性。在M3FD、FLIR和FMB数据集上的实验表明,Text2Thermal在热图生成中达到当前最优的FID分数,同时提供翻译类方法无法实现的文本级控制能力。

原文摘要 · Abstract (English)

Thermal infrared imaging offers reliable perception in darkness and adverse weather, but thermal datasets remain scarce, motivating extensive work on translating abundant RGB images into thermal. Such translation is fundamentally ill-posed as thermal appearance is governed by surface emissivity and object temperature, neither of which is observable in the visible spectrum, so a single RGB image is consistent with many valid thermal outputs. We argue that language offers a natural means of resolving this ambiguity, and propose Text2Thermal, a framework for physics-aware thermal image synthesis from textual priors. Rather than inferring the unobservable radiometric factors from RGB, we supply them explicitly through thermally grounded captions encoding material, weather, time-of-day, and heat-emission state, and adapt a pretrained Stable Diffusion backbone to the thermal domain. Because the radiometric content is determined entirely by the prompt, Text2Thermal synthesizes thermal imagery without requiring a registered RGB image at inference; where spatial guidance is desired, an optional control signal imparts scene geometry without disturbing the prompt-specified radiometry. Experiments on M3FD, FLIR, and FMB show that Text2Thermal achieves state-of-the-art FID among thermal image synthesis methods while offering text-level control that translation-based approaches cannot provide.

热成像生成文本控制物理感知扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。