arXiv:2511.17508cs.HCcs.CV2025-11被引 1

轻量级追踪算法让AR设备实时准确定位物体

Deep Learning-based Lightweight RGB Object Tracking for Augmented Reality Devices

  • 用精简的孪生网络结合剪枝量化等技术压缩模型
  • 在移动AR头显上实现30帧/秒,比之前快10倍以上
  • 适合资源受限的可穿戴AR设备,提升交互体验

增强现实(AR)应用常需实时准确跟踪用户环境中的物体以正确叠加虚拟内容。尽管深度学习带来了高精度的追踪模型,但其计算和内存开销过大,难以在可穿戴AR设备上运行。本文提出一种专为资源受限的AR平台设计的轻量级RGB物体追踪算法。该追踪器采用紧凑的孪生神经网络架构,并结合模型剪枝、量化与知识蒸馏等优化技术,大幅降低模型规模和推理开销,同时保持高追踪精度。模型在大型视频数据集上离线训练,再部署至设备端进行实时追踪。标准追踪基准测试结果表明,本方法在精度上可媲美当前最优追踪器,但在同一硬件上实现约30帧/秒的实时性能,较以往高性能追踪器提速超十倍。该工作使轻量化设备上的稳定物体追踪成为可能,推动更丰富动态的AR交互体验。

原文摘要 · Abstract (English)

Augmented Reality (AR) applications often require robust real-time tracking of objects in the user's environment to correctly overlay virtual content. Recent advances in computer vision have produced highly accurate deep learning-based object trackers, but these models are typically too heavy in computation and memory for wearable AR devices. In this paper, we present a lightweight RGB object tracking algorithm designed specifically for resource-constrained AR platforms. The proposed tracker employs a compact Siamese neural network architecture and incorporates optimization techniques such as model pruning, quantization, and knowledge distillation to drastically reduce model size and inference cost while maintaining high tracking accuracy. We train the tracker offline on large video datasets using deep convolutional neural networks and then deploy it on-device for real-time tracking. Experimental results on standard tracking benchmarks show that our approach achieves comparable accuracy to state-of-the-art trackers, yet runs in real-time on a mobile AR headset at around 30 FPS -- more than an order of magnitude faster than prior high-performance trackers on the same hardware. This work enables practical, robust object tracking for AR use-cases, opening the door to more interactive and dynamic AR experiences on lightweight devices.

AR追踪轻量化模型实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。