通过通道蒸馏提升深度跟踪器效率,实时筛选关键特征通道。
Distilling Channels for Efficient Deep Tracking
- 将特征压缩、响应生成与模型更新统一为能量最小化问题
- 自适应选择有效通道,显著降低计算与内存开销
- 适用于多种跟踪框架,兼顾精度与速度
深度跟踪器在视觉跟踪中表现优异。通常依赖预训练的深层网络,从固定层提取多通道特征以表示各类物体。这些网络虽能很好表达通用物体,但结构复杂,难以高效表征特定运动目标,导致泛化能力差且计算与内存成本高。本文提出一种新颖通用的通道蒸馏框架,以提升深度跟踪器性能。以判别相关滤波(DCF)和ECO为例,证明可将特征压缩、响应图生成与模型更新统一为一个能量最小化问题,实现对信息量丰富的特征通道的自适应选择,从而实时提升对运动目标的跟踪效果。该方法能准确提取有效通道,抑制噪声通道影响,普遍减少通道数量,并自适应适配不同通道与网络结构。最终得到的跟踪器兼具高精度、高速度与低内存需求。在多个主流基准上的大量实验充分验证了该框架的有效性与普适性。
原文摘要 · Abstract (English)
Deep trackers have proven success in visual tracking. Typically, these trackers employ optimally pre-trained deep networks to represent all diverse objects with multi-channel features from some fixed layers. The deep networks employed are usually trained to extract rich knowledge from massive data used in object classification and so they are capable to represent generic objects very well. However, these networks are too complex to represent a specific moving object, leading to poor generalization as well as high computational and memory costs. This paper presents a novel and general framework termed channel distillation to facilitate deep trackers. To validate the effectiveness of channel distillation, we take discriminative correlation filter (DCF) and ECO for example. We demonstrate that an integrated formulation can turn feature compression, response map generation, and model update into a unified energy minimization problem to adaptively select informative feature channels that improve the efficacy of tracking moving objects on the fly. Channel distillation can accurately extract good channels, alleviating the influence of noisy channels and generally reducing the number of channels, as well as adaptively generalizing to different channels and networks. The resulting deep tracker is accurate, fast, and has low memory requirements. Extensive experimental evaluations on popular benchmarks clearly demonstrate the effectiveness and generalizability of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。