arXiv:2505.15184cs.CV2025-05被引 4

利用传感器元数据提升红外小目标检测在复杂场景下的泛化能力

AuxDet: Auxiliary Metadata Matters for Omni-Domain Infrared Small Target Detection

  • 引入传感器拍摄参数等辅助元数据,与视觉特征融合增强模型感知
  • 在WideIRSTD-Full数据集上超越当前最优方法,显著提升检测准确率
  • 适合需要跨平台、多分辨率红外目标检测的应用场景

全域红外小目标检测(Omni-IRSTD)面临巨大挑战,单一模型需适应不同成像系统、分辨率及多种光谱波段。现有方法主要依赖纯视觉建模,难以应对复杂背景干扰和目标特征稀疏问题,且在存在显著域偏移和外观变化的复杂场景中泛化能力有限。本文揭示现有范式的关键忽视:忽略易获取的辅助元数据(如光谱波段、传感器平台、分辨率、观测视角)。为此,提出首个将元数据融入红外小目标检测的多模态框架AuxDet,通过基于多层感知机(MLPs)的高维融合模块,动态融合元数据语义与视觉特征,实现样本级场景自适应表征学习。此外设计轻量级先验初始化增强模块,采用1D卷积块进一步优化融合特征,恢复细粒度目标线索。在具有挑战性的WideIRSTD-Full基准上,实验表明AuxDet持续优于现有最优方法,验证了辅助信息在提升全域红外小目标检测鲁棒性与精度中的关键作用。代码已开源。

原文摘要 · Abstract (English)

Omni-domain infrared small target detection (Omni-IRSTD) poses formidable challenges, as a single model must seamlessly adapt to diverse imaging systems, varying resolutions, and multiple spectral bands simultaneously. Current approaches predominantly rely on visual-only modeling paradigms that not only struggle with complex background interference and inherently scarce target features, but also exhibit limited generalization capabilities across complex omni-scene environments where significant domain shifts and appearance variations occur. In this work, we reveal a critical oversight in existing paradigms: the neglect of readily available auxiliary metadata describing imaging parameters and acquisition conditions, such as spectral bands, sensor platforms, resolution, and observation perspectives. To address this limitation, we propose the Auxiliary Metadata Driven Infrared Small Target Detector (AuxDet), a novel multimodal framework that is the first to incorporate metadata into the IRSTD paradigm for scene-aware optimization. Through a high-dimensional fusion module based on multi-layer perceptrons (MLPs), AuxDet dynamically integrates metadata semantics with visual features, guiding adaptive representation learning for each individual sample. Additionally, we design a lightweight prior-initialized enhancement module using 1D convolutional blocks to further refine fused features and recover fine-grained target cues. Extensive experiments on the challenging WideIRSTD-Full benchmark demonstrate that AuxDet consistently outperforms state-of-the-art methods, validating the critical role of auxiliary information in improving robustness and accuracy in omni-domain IRSTD tasks. Code is available at https://github.com/GrokCV/AuxDet.

红外检测多模态元数据小目标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。