arXiv:2511.07362cs.CVcs.AI2025-11被引 1

用推理时引导提升红外图像生成质量,解决数据少难题。

Inference-Time Scaling of Diffusion Models for Infrared Data Generation

  • 用小样本微调扩散模型,并在推理时用CLIP验证器引导生成。
  • 在KAIST数据集上FID降低10%,生成图像更贴合文本描述。
  • 适合缺乏红外标注数据的生成模型研究者使用。

红外成像通过被动传感器实现基于温度的场景理解,尤其在可见光条件差时优于传统RGB成像。然而,红外应用的下游视觉模型开发受限于高质量标注数据稀缺,因红外标注需专业技能。虽然合成红外图像可加速模型训练,但受限于数据量,构建红外领域基础生成模型仍困难。针对此问题,本文探索一种基于领域自适应CLIP验证器的推理时扩展方法,以提升红外图像生成质量。将最先进的文生图扩散模型FLUX.1-dev通过参数高效微调适配至红外域,再在推理阶段利用训练好的验证器指导采样过程,使生成结果更符合输入文本提示。实验证明,该方法显著提升生成质量,在KAIST多光谱行人检测基准上相比无引导基线样本,FID得分降低10%。结果表明,推理时引导是低数据环境下弥合红外领域差距的可行路径。

原文摘要 · Abstract (English)

Infrared imagery enables temperature-based scene understanding using passive sensors, particularly under conditions of low visibility where traditional RGB imaging fails. Yet, developing downstream vision models for infrared applications is hindered by the scarcity of high-quality annotated data, due to the specialized expertise required for infrared annotation. While synthetic infrared image generation has the potential to accelerate model development by providing large-scale, diverse training data, training foundation-level generative diffusion models in the infrared domain has remained elusive due to limited datasets. In light of such data constraints, we explore an inference-time scaling approach using a domain-adapted CLIP-based verifier for enhanced infrared image generation quality. We adapt FLUX.1-dev, a state-of-the-art text-to-image diffusion model, to the infrared domain by finetuning it on a small sample of infrared images using parameter-efficient techniques. The trained verifier is then employed during inference to guide the diffusion sampling process toward higher quality infrared generations that better align with input text prompts. Empirically, we find that our approach leads to consistent improvements in generation quality, reducing FID scores on the KAIST Multispectral Pedestrian Detection Benchmark dataset by 10% compared to unguided baseline samples. Our results suggest that inference-time guidance offers a promising direction for bridging the domain gap in low-data infrared settings.

红外生成扩散模型推理时引导小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。