提出OmniTrack框架,实现全景图像下的多目标跟踪
Omnidirectional Multi-Object Tracking
- 引入轨迹管理与圆形统计模块,缓解全景畸变问题
- 在JRDB和新数据集QuadTrack上分别取得26.92%和23.45%的HOTA
- 适合需要全景感知的自动驾驶、机器人导航场景
全景图像具有360°视场,能全面捕捉周围物体的空间与时间关系,支持多目标跟踪(MOT)。然而,现有MOT算法大多针对有限视角的针孔图像设计,难以直接应用于全景场景。此外,全景图像存在分辨率损失、几何畸变和光照不均等问题,进一步限制了现有方法的适用性。为此,本文提出OmniTrack框架,集成轨迹管理机制引入时序信息,采用可变形实例(FlexiTrack Instances)进行目标定位与关联,并设计圆形统计模块(CircularStatE)缓解图像与几何畸变。该框架可在快速传感器运动下实现全景视场中的有效跟踪。为解决全景MOT数据集匮乏问题,我们构建了QuadTrack数据集——由四足机器人采集的综合性全景数据集,涵盖复杂环境、剧烈运动等挑战。在公开数据集JRDB及新提出的QuadTrack基准上的实验表明,OmniTrack在两项任务上分别取得26.92%和23.45%的HOTA得分,较基线分别提升3.43%和6.81%,性能达到当前最优。代码与数据集已开源。
原文摘要 · Abstract (English)
Panoramic imagery, with its 360° field of view, offers comprehensive information to support Multi-Object Tracking (MOT) in capturing spatial and temporal relationships of surrounding objects. However, most MOT algorithms are tailored for pinhole images with limited views, impairing their effectiveness in panoramic settings. Additionally, panoramic image distortions, such as resolution loss, geometric deformation, and uneven lighting, hinder direct adaptation of existing MOT methods, leading to significant performance degradation. To address these challenges, we propose OmniTrack, an omnidirectional MOT framework that incorporates Tracklet Management to introduce temporal cues, FlexiTrack Instances for object localization and association, and the CircularStatE Module to alleviate image and geometric distortions. This integration enables tracking in panoramic field-of-view scenarios, even under rapid sensor motion. To mitigate the lack of panoramic MOT datasets, we introduce the QuadTrack dataset--a comprehensive panoramic dataset collected by a quadruped robot, featuring diverse challenges such as panoramic fields of view, intense motion, and complex environments. Extensive experiments on the public JRDB dataset and the newly introduced QuadTrack benchmark demonstrate the state-of-the-art performance of the proposed framework. OmniTrack achieves a HOTA score of 26.92% on JRDB, representing an improvement of 3.43%, and further achieves 23.45% on QuadTrack, surpassing the baseline by 6.81%. The established dataset and source code are available at https://github.com/xifen523/OmniTrack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。