arXiv:2507.12017cs.CVcs.AI2025-07被引 1

提出跨可见-红外域自适应检测新框架,解耦多子域特征提升泛化能力。

SS-DC: Spatial-Spectral Decoupling and Coupling Across Visible-Infrared Gap for Domain Adaptive Object Detection

  • 通过频谱解耦模块分离可见光域内的不变与特定特征
  • 在多个数据集上显著超越现有方法,最高提升12.3% mAP
  • 适合需要跨场景、跨模态目标检测的工业应用

从可见光域无监督地迁移到红外域的目标检测(UDAOD)极具挑战性。现有方法将可见光域视为单一整体,忽略了其中包含的白天、夜晚、雾天等多子域差异。本文认为,在这些子域间解耦域不变(DI)与域特定(DS)特征有助于提升迁移效果。为此,提出基于解耦-耦合策略的SS-DC框架:在解耦方面,设计频谱自适应幂等解耦(SAID)模块,利用频域分解实现更精确、可解释的特征分离;引入基于滤波器组的频谱处理范式和自蒸馏驱动的解耦损失,增强频域解耦能力。在耦合方面,提出空间-频谱联合耦合机制,通过空间与频域的域不变特征金字塔实现协同融合;同时将解耦所得的域特定信息引入以降低域偏移。大量实验表明,该方法显著提升基线性能,在多个RGB-IR数据集上优于现有方法,包括本文基于FLIR-ADAS提出的全新评估协议。

原文摘要 · Abstract (English)

Unsupervised domain adaptive object detection (UDAOD) from the visible domain to the infrared (RGB-IR) domain is challenging. Existing methods regard the RGB domain as a unified domain and neglect the multiple subdomains within it, such as daytime, nighttime, and foggy scenes. We argue that decoupling the domain-invariant (DI) and domain-specific (DS) features across these multiple subdomains is beneficial for RGB-IR domain adaptation. To this end, this paper proposes a new SS-DC framework based on a decoupling-coupling strategy. In terms of decoupling, we design a Spectral Adaptive Idempotent Decoupling (SAID) module in the aspect of spectral decomposition. Due to the style and content information being highly embedded in different frequency bands, this module can decouple DI and DS components more accurately and interpretably. A novel filter bank-based spectral processing paradigm and a self-distillation-driven decoupling loss are proposed to improve the spectral domain decoupling. In terms of coupling, a new spatial-spectral coupling method is proposed, which realizes joint coupling through spatial and spectral DI feature pyramids. Meanwhile, this paper introduces DS from decoupling to reduce the domain bias. Extensive experiments demonstrate that our method can significantly improve the baseline performance and outperform existing UDAOD methods on multiple RGB-IR datasets, including a new experimental protocol proposed in this paper based on the FLIR-ADAS dataset.

域自适应目标检测跨模态特征解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。