arXiv:2511.05356cs.CV2025-11

提出4D动态物体分割新框架,通过统一姿态空间提升分割精度。

Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects

  • 构建可形变物体的4D基准数据集Artic4D,含时序标注与关节参数
  • 设计统一姿态空间表示,使部件在时间上对齐,提升复杂场景分割准确率
  • 适合做动态物体感知、机器人交互与具身智能的研究者参考

可动物体感知在计算机视觉中面临重大挑战,因多数现有方法忽略其固有的动态特性。尽管4D时空数据在该领域尚未充分探索,尤其在全景分割任务中仍缺乏研究。此外,缺乏基准数据集也制约了该方向的发展。为此,我们基于PartNet Mobility构建了新的数据集Artic4D,通过合成传感器数据增强,包含4D全景标注与关节参数。在此基础上,我们提出CanonSeg4D,一种新型4D全景分割框架。该方法显式估计每帧中观测部件到学习得到的规范空间的偏移量,从而增强部件级分割性能,并利用该规范表示实现多帧间部件的一致对齐。在Artic4D上的全面实验表明,所提CanonSeg4D在复杂场景下优于现有最优方法,验证了时序建模与规范对齐在动态物体理解中的有效性,为未来4D可动物体感知研究奠定基础。

原文摘要 · Abstract (English)

Articulated object perception presents significant challenges in computer vision, particularly because most existing methods ignore temporal dynamics despite the inherently dynamic nature of such objects. The use of 4D temporal data has not been thoroughly explored in articulated object perception and remains unexamined for panoptic segmentation. The lack of a benchmark dataset further hurt this field. To this end, we introduce Artic4D as a new dataset derived from PartNet Mobility and augmented with synthetic sensor data, featuring 4D panoptic annotations and articulation parameters. Building on this dataset, we propose CanonSeg4D, a novel 4D panoptic segmentation framework. This approach explicitly estimates per-frame offsets mapping observed object parts to a learned canonical space, thereby enhancing part-level segmentation. The framework employs this canonical representation to achieve consistent alignment of object parts across sequential frames. Comprehensive experiments on Artic4D demonstrate that the proposed CanonSeg4D outperforms state of the art approaches in panoptic segmentation accuracy in more complex scenarios. These findings highlight the effectiveness of temporal modeling and canonical alignment in dynamic object understanding, and pave the way for future advances in 4D articulated object perception.

4D分割动态物体姿态对齐全景分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。