用卡尔曼滤波加速点追踪,让边缘设备实时运行高精度追踪。
K-Track: Kalman-Enhanced Tracking for Accelerating Deep Point Trackers on Edge Devices
- 关键帧用深度网络,中间帧用轻量卡尔曼滤波预测。
- 速度提升5-10倍,精度保留85%以上。
- 适合机器人、AR等资源受限场景部署。
视频序列中的点追踪是机器人、自动驾驶、增强现实和视频分析等实际应用的基础能力。尽管近期基于深度学习的追踪器在挑战性基准上达到最先进精度,但其依赖每帧GPU推理,严重制约了在计算、功耗和连接受限的边缘设备上的部署。我们提出K-Track(卡尔曼增强追踪),一种通用、追踪器无关的加速框架,通过结合稀疏深度学习关键帧更新与轻量级卡尔曼滤波进行中间帧预测,并利用贝叶斯不确定性传播保持时间一致性,显著降低推理成本。该混合策略实现5-10倍加速,同时保留超过85%的原始追踪器精度。我们在多个先进点追踪器上验证了K-Track,在NVIDIA Jetson Nano和RTX Titan等边缘平台实现实时性能。K-Track在大幅降低计算需求的同时保持高精度,为现代追踪算法在真实资源受限环境中的部署提供了可行路径。
原文摘要 · Abstract (English)
Point tracking in video sequences is a foundational capability for real-world computer vision applications, including robotics, autonomous systems, augmented reality, and video analysis. While recent deep learning-based trackers achieve state-of-the-art accuracy on challenging benchmarks, their reliance on per-frame GPU inference poses a major barrier to deployment on resource-constrained edge devices, where compute, power, and connectivity are limited. We introduce K-Track (Kalman-enhanced Tracking), a general-purpose, tracker-agnostic acceleration framework designed to bridge this deployment gap. K-Track reduces inference cost by combining sparse deep learning keyframe updates with lightweight Kalman filtering for intermediate frame prediction, using principled Bayesian uncertainty propagation to maintain temporal coherence. This hybrid strategy enables 5-10X speedup while retaining over 85% of the original trackers' accuracy. We evaluate K-Track across multiple state-of-the-art point trackers and demonstrate real-time performance on edge platforms such as the NVIDIA Jetson Nano and RTX Titan. By preserving accuracy while dramatically lowering computational requirements, K-Track provides a practical path toward deploying high-quality point tracking in real-world, resource-limited settings, closing the gap between modern tracking algorithms and deployable vision systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。