arXiv:2606.30097cs.CVcs.RO2026-06

解决全景视频多目标追踪中的深度与拓扑难题。

CylindTrack: Depth-Aware Cylindrical Motion Modeling for Panoramic Multi-Object Tracking

论文配图:CylindTrack: Depth-Aware Cylindrical Motion Modeling for Panoramic Multi-Object Tracking
图 1 · 摘自论文原文
  • 将水平运动映射到连续角度空间,实现无缝隙追踪
  • 通过轨迹级深度建模提升遮挡场景下身份一致性
  • 适合需要360°感知的机器人、自动驾驶系统

多目标追踪(MOT)是具身感知的核心能力,全景相机因360°视场可减少盲区并更长时间观测周围目标而备受青睐。然而,全景MOT并非透视MOT的简单扩展。在等距投影全景视频中,水平图像域具有周期性而非欧氏性,破坏平面运动假设,导致0°/360°接缝附近基于交并比(IoU)的关联不可靠。同时,大视角场景常伴随更多目标、更强尺度变化和频繁交互,使在线关联对不稳定的帧级深度线索尤为敏感。为此,本文提出CylindTrack,一种面向全景MOT的深度感知柱面追踪框架。CylindTrack首先引入深度-时间轨迹建模(DTM),将孤立帧级深度线索提升为时序滤波的轨迹级状态。为增强深度观测可靠性,进一步设计球面时空一致性学习(SSTC),结合时间混合器与球面几何感知注意力,提升深度表征的时间连贯性与全景几何对齐性。最后,提出拓扑感知柱面运动模型(TCMM),将水平运动升维至连续角度状态空间,在周期性全景域中实现无缝隙运动预测与关联。通过联合建模轨迹级深度一致性与全景拓扑结构,CylindTrack显著提升复杂全景场景下的身份保持与轨迹连续性。代码将开源于https://github.com/warriordby/CylindTrack。

原文摘要 · Abstract (English)

Multi-Object Tracking (MOT) is a core capability for embodied perception, and panoramic cameras are attractive for embodied systems because their 360° field of view reduces blind spots and keeps surrounding targets observable for longer durations. However, panoramic MOT is not a straightforward extension of perspective MOT. In equirectangular panoramic videos, the horizontal image domain is periodic rather than Euclidean, which breaks planar motion assumptions and makes IoU-based association unreliable near the 0°/360° seam. Meanwhile, large-FoV scenes often contain more objects, stronger scale variation, and more frequent interactions, making online association particularly sensitive to unstable frame-wise depth cues. To address these issues, we propose CylindTrack, a depth-aware cylindrical tracking-by-detection framework for panoramic MOT. CylindTrack first introduces Depth-Temporal Trajectory Modeling (DTM), which promotes instance depth from an isolated frame-wise cue to a temporally filtered trajectory-level state. To improve the reliability of depth observations, we further develop Spherical Spatio-Temporal Consistency Learning (SSTC), which combines a Temporal Mixer and Spherical Geometry-aware Attention to enhance temporal coherence and panoramic geometric alignment in depth-aware representations. Finally, we design a Topology-Aware Cylindrical Motion Model (TCMM) that lifts horizontal motion into a continuous angular state space and performs seam-consistent motion prediction and association in the periodic panoramic domain. By jointly modeling trajectory-level depth consistency and panoramic topology, CylindTrack improves identity preservation and trajectory continuity in challenging panoramic scenes. The source code will be released at https://github.com/warriordby/CylindTrack.

全景追踪多目标追踪深度感知柱面建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。