通过敏感性剪枝提升测试时目标检测的适应效率
Efficient Test-time Adaptive Object Detection via Sensitivity-Guided Pruning
- 基于通道敏感性量化,动态剪掉有害特征
- 在三个基准上性能优于当前最优方法,计算量降低12%
- 适合资源受限场景下的实时目标检测应用
持续测试时自适应目标检测(CTTA-OD)旨在推理过程中在线适应不断变化的环境。现有方法多关注效果而忽略计算效率,这对资源受限场景至关重要。本文提出一种高效剪枝策略:观察到部分源模型特征对目标域有害,尤其是一些对领域差异敏感的通道。为此,我们设计了图像与实例级敏感性度量,并引入加权稀疏正则化,有选择地抑制和剪除这些敏感通道,使适配聚焦于不变特征。此外,还设计随机通道重激活机制,恢复可能有用的特征,避免过早剪枝风险。在三个基准上的大量实验表明,本方法在保持更优适应性能的同时,相比最新SOTA方法减少了12%的FLOPs计算开销。
原文摘要 · Abstract (English)
Continual test-time adaptive object detection (CTTA-OD) aims to online adapt a source pre-trained detector to ever-changing environments during inference under continuous domain shifts. Most existing CTTA-OD methods prioritize effectiveness while overlooking computational efficiency, which is crucial for resource-constrained scenarios. In this paper, we propose an efficient CTTA-OD method via pruning. Our motivation stems from the observation that not all learned source features are beneficial; certain domain-sensitive feature channels can adversely affect target domain performance. Inspired by this, we introduce a sensitivity-guided channel pruning strategy that quantifies each channel based on its sensitivity to domain discrepancies at both image and instance levels. We apply weighted sparsity regularization to selectively suppress and prune these sensitive channels, focusing adaptation efforts on invariant ones. Additionally, we introduce a stochastic channel reactivation mechanism to restore pruned channels, enabling recovery of potentially useful features and mitigating the risks of early pruning. Extensive experiments on three benchmarks show that our method achieves superior adaptation performance while reducing computational overhead by 12% in FLOPs compared to the recent SOTA method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。