arXiv:2603.01412cs.CV2026-03中稿 · CVPR被引 1

提出轻量级多模态目标跟踪框架,支持多种传感器输入且高效实用。

UETrack: A Unified and Efficient Framework for Single Object Tracking

  • 基于令牌池的专家混合机制,实现特征聚合与专家专精。
  • 目标感知自适应蒸馏策略,减少冗余监督,提升跟踪精度。
  • 支持RGB、深度、热成像等多模态输入,部署灵活适合边缘设备。

随着实际应用需求的增长,高效目标跟踪受到越来越多关注。然而,现有方法大多仅限于RGB输入,在多模态场景下表现不佳;而现有的多模态跟踪方法通常设计复杂,难以在资源受限环境中部署。为此,我们提出UETrack,一种高效统一的单目标跟踪框架。该框架具备高实用性与通用性,可高效处理包括RGB、Depth、Thermal、Event及Language在内的多种模态输入,填补了高效多模态跟踪的空白。其核心包含两个关键组件:基于令牌池的专家混合机制(Token-Pooling-based Mixture-of-Experts),通过特征聚合与专家专精增强建模能力;以及目标感知自适应蒸馏策略(Target-aware Adaptive Distillation),根据样本特性选择性进行蒸馏,减少冗余监督并提升性能。在12个基准数据集上跨3种硬件平台的大量实验表明,相比以往方法,UETrack在速度与精度之间实现了更优权衡。例如,UETrack-B在LaSOT上达到69.2% AUC,运行速度分别为163/56/60 FPS(GPU/CPU/AGX),展现出强大的实用性和通用性。代码已公开于https://github.com/kangben258/UETrack。

原文摘要 · Abstract (English)

With growing real-world demands, efficient tracking has received increasing attention. However, most existing methods are limited to RGB inputs and struggle in multi-modal scenarios. Moreover, current multi-modal tracking approaches typically use complex designs, making them too heavy and slow for resource-constrained deployment. To tackle these limitations, we propose UETrack, an efficient framework for single object tracking. UETrack demonstrates high practicality and versatility, efficiently handling multiple modalities including RGB, Depth, Thermal, Event, and Language, and addresses the gap in efficient multi-modal tracking. It introduces two key components: a Token-Pooling-based Mixture-of-Experts mechanism that enhances modeling capacity through feature aggregation and expert specialization, and a Target-aware Adaptive Distillation strategy that selectively performs distillation based on sample characteristics, reducing redundant supervision and improving performance. Extensive experiments on 12 benchmarks across 3 hardware platforms show that UETrack achieves a superior speed-accuracy trade-off compared to previous methods. For instance, UETrack-B achieves 69.2% AUC on LaSOT and runs at 163/56/60 FPS on GPU/CPU/AGX, demonstrating strong practicality and versatility. Code is available at https://github.com/kangben258/UETrack.

目标跟踪多模态轻量化边缘部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。