HopTrack实现实时多目标追踪,嵌入式设备上速度超39帧,精度领先且省电。
HopTrack: A Real-time Multi-Object Tracking System for Embedded Devices
- 采用离散化动静态匹配与内容感知动态采样提升精度
- 在NVIDIA AGX Xavier上达39.29fps,MOTA达63.12%
- 兼容多种检测器,适合资源受限的嵌入式场景
多目标追踪(MOT)在计算机视觉中面临挑战。尽管广泛应用于机器人、自动驾驶和智能制造,但针对嵌入式设备运行MOT的研究仍有限。现有高性能GPU设计的追踪器在嵌入式设备上处理速度常低于11fps。已有嵌入式框架通过融合检测模型与特征嵌入模型降低延迟,或组合多个追踪器提升精度,但往往顾此失彼。本文提出专为嵌入式设备设计的实时多目标追踪系统HopTrack,采用新型离散化静态与动态匹配方法,结合创新的内容感知动态采样技术,在保证实时性的同时提升追踪精度。在NVIDIA AGX Xavier上,相比最佳高阶GPU优化基线Byte (Embed) 和现有最佳嵌入式基线MobileNet-JDE,HopTrack实现最高39.29 fps的处理速度,MOT16基准上达到63.12%的多目标追踪准确率(MOTA),分别超越两者2.15%和4.82%。此外,精度提升伴随能耗降低20.8%、功耗下降5%、内存占用减少8%,这些对嵌入式设备至关重要。系统还具备检测器无关性,支持即插即用。
原文摘要 · Abstract (English)
Multi-Object Tracking (MOT) poses significant challenges in computer vision. Despite its wide application in robotics, autonomous driving, and smart manufacturing, there is limited literature addressing the specific challenges of running MOT on embedded devices. State-of-the-art MOT trackers designed for high-end GPUs often experience low processing rates (<11fps) when deployed on embedded devices. Existing MOT frameworks for embedded devices proposed strategies such as fusing the detector model with the feature embedding model to reduce inference latency or combining different trackers to improve tracking accuracy, but tend to compromise one for the other. This paper introduces HopTrack, a real-time multi-object tracking system tailored for embedded devices. Our system employs a novel discretized static and dynamic matching approach along with an innovative content-aware dynamic sampling technique to enhance tracking accuracy while meeting the real-time requirement. Compared with the best high-end GPU modified baseline Byte (Embed) and the best existing baseline on embedded devices MobileNet-JDE, HopTrack achieves a processing speed of up to 39.29 fps on NVIDIA AGX Xavier with a multi-object tracking accuracy (MOTA) of up to 63.12% on the MOT16 benchmark, outperforming both counterparts by 2.15% and 4.82%, respectively. Additionally, the accuracy improvement is coupled with the reduction in energy consumption (20.8%), power (5%), and memory usage (8%), which are crucial resources on embedded devices. HopTrack is also detector agnostic allowing the flexibility of plug-and-play.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。