通过专家引导的特征重校准提升遥感多模态目标检测性能
SuppreSensing: Expert-Guided Feature Recalibration and Discrepancy Augmentation for Multimodal Object Detection

- 设计多专家自适应选择机制,解决多模态融合对称性陷阱
- 在DroneVehicle和VEDAI上达到当前最优性能,跨域测试表现稳健
- 适合遥感、自动驾驶等复杂环境下的多模态检测任务
遥感中的多模态目标检测面临语义异构性和模态特异性噪声干扰。为此,我们提出SuppreSensing,将多模态融合重构为一种选择性协作过程,联合建模共享信息与模态特有线索。首先设计专家驱动的多模态特征重校准(EMFR)模块,将共享共识提取重构为输入自适应的多专家选择过程,缓解多模态融合中的对称性陷阱。同时,采用模态特异性属性增强策略,通过建模双向差异模式强化特定模态特征,缓解跨模态异构性。此外,基于“专业检查-综合分析-诊断更新”体检范式,提出专家驱动的定制化特征净化(ECFP)模块,迭代过滤冗余并增强任务相关语义。在DroneVehicle和VEDAI数据集上的大量实验表明,SuppreSensing达到领先检测性能;在自然场景数据集FLIR和LLVIP上的跨域评估进一步验证其在多样环境条件下的优越鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Multimodal object detection in remote sensing faces challenges due to semantic heterogeneity and modality-specific noise interference. To this end, we propose SuppreSensing, which reformulates multimodal fusion as a selective collaboration process that jointly models shared information and modality-specific cues. SuppreSensing first designs an Expert-driven Multimodal Feature Recalibration (EMFR) module, which reformulates shared-consensus extraction as an input-adaptive multi-expert selection process to alleviate the symmetry trap in multimodal fusion. Complementing this, a modality-specific attribute augmentation strategy is employed to enhance specific modality features by modeling bidirectional discrepancy patterns, mitigating cross-modal heterogeneity. Furthermore, we propose an Expert-driven Customized Feature Purification (ECFP) module based on a "specialized inspection-comprehensive analysis-diagnostic update" physical examination paradigm to iteratively filter redundancies and reinforce task-relevant semantics. Extensive experiments on the DroneVehicle and VEDAI datasets demonstrate that SuppreSensing achieves state-of-the-art detection performance. Cross-domain evaluations on natural scene datasets (FLIR and LLVIP) further validate its superior robustness and generalization capability across diverse environmental conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。