针对红外可见光目标检测,提出首个交互式结构化剪枝框架,提升效率且不降性能。
InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection

- 基于泰勒隐式准则与互补偿评估,动态量化通道重要性。
- 在FLIR数据集上剪掉50%通道,mAP反升0.6%。
- 融合语言先验实现场景自适应剪枝,适合多模态检测研究者。
多模态目标检测在遥感中表现优异,尤其是可见光-红外范式。并行特征提取器虽提供丰富信息,却带来显著通道冗余和计算开销。现有剪枝方法适用于单模态主干网络,忽视跨模态交互与场景动态冗余。本文提出InterPruner,首个针对可见光-红外检测器的交互式结构化通道剪枝框架。首先,通过高阶泰勒展开与隐函数定理推导泰勒隐式准则(TIC),量化通道重要性;其次,设计模态交互冗余分析器(MIRA),基于互补偿性评估识别冗余通道;最后,引入场景先验通道锚点(SPCA),利用语言先验作为语义锚点,衡量通道-场景相关性以实现动态重要性估计。跨模态通道剪枝在可见光-红外检测中尚未探索。在可见光-红外检测数据集上的大量实验表明,InterPruner在保持高性能的同时实现极小性能损失,尤其在FLIR数据集上剪除50%通道后,mAP反而提升0.6%。代码将开源以促进后续研究。
原文摘要 · Abstract (English)
Multimodal object detection proves effective in remote sensing, especially the RGB-Infrared paradigm. The parallel feature extractors provide rich multimodal information for robust detection, yet introduce substantial channel redundancy and computational overhead. Existing pruning methods can reduce channel redundancy, but they are designed for unimodal backbones, overlooking cross-modal interactions and dynamic scene-wise redundancy. In this paper, we propose InterPruner, the first interactive structured channel pruning framework for RGB-infrared object detectors. Specifically, we first derive a Taylor-Implicit Criterion(TIC) to quantify channel importance via high-order Taylor expansion and the implicit function theorem. Then, a Modality Interaction Redundancy Analyzer (MIRA) identifies redundant channels via mutual compensability assessment. Finally, a Scene-Prior Channel Anchor (SPCA) uses language priors as semantic anchors to measure channel-scene relevance for dynamic channel importance estimation. Cross-modality channel pruning for RGB-Infrared detection is yet unexplored. Extensive experiments on RGB-infrared object detection dataset demonstrate that InterPruner maintains high performance with negligible degradation. Specifically, it even achieves a 0.6% mAP increase on the FLIR dataset when pruning 50% of the channels. Code will be available on GitHub to facilitate future work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。