arXiv:2409.05151cs.CVcs.GR2024-09

用时间对应与形变压缩任意拓扑的3D网格序列,效果领先。

Ultron: Enabling Temporal Geometry Compression of 3D Mesh Sequences using Temporal Correspondence and Mesh Deformation

  • 通过时间对应和形变模型,实现不同拓扑网格间的序列压缩。
  • 在多个数据集上达到当前最优压缩率,峰值信噪比最高提升2.1dB。
  • 适合需要高效传输动态3D模型的研究者与开发者使用。

随着计算机视觉的发展,动态3D重建技术取得了显著进展,并广泛应用于多个领域。然而,这些技术生成大量3D数据序列,亟需高效的存储与传输方法。现有3D模型压缩方法主要针对静态模型,未考虑帧间信息,限制了数据压缩能力。时间网格压缩研究较少,且通常要求所有输入网格具有相同拓扑结构,这在真实应用中极少满足。本文提出一种可处理任意拓扑网格序列的压缩方法,基于时间对应与网格形变。该方法建立相邻帧间的时序对应关系,使用形变模型将前一帧网格映射至后续帧,若形变后质量满足容差阈值,则用变形网格替代原始网格。大量实验表明,该方法在压缩性能上达到当前最优水平。本文贡献包括:基于几何与运动的时间对应建模、用于时序网格序列的质量评估方法、基于熵编码与角表的压缩方案,以及充分的实验验证。代码将在https://github.com/lszhuhaichao/ultron开源。

原文摘要 · Abstract (English)

With the advancement of computer vision, dynamic 3D reconstruction techniques have seen significant progress and found applications in various fields. However, these techniques generate large amounts of 3D data sequences, necessitating efficient storage and transmission methods. Existing 3D model compression methods primarily focus on static models and do not consider inter-frame information, limiting their ability to reduce data size. Temporal mesh compression, which has received less attention, often requires all input meshes to have the same topology, a condition rarely met in real-world applications. This research proposes a method to compress mesh sequences with arbitrary topology using temporal correspondence and mesh deformation. The method establishes temporal correspondence between consecutive frames, applies a deformation model to transform the mesh from one frame to subsequent frames, and replaces the original meshes with deformed ones if the quality meets a tolerance threshold. Extensive experiments demonstrate that this method can achieve state-of-the-art performance in terms of compression performance. The contributions of this paper include a geometry and motion-based model for establishing temporal correspondence between meshes, a mesh quality assessment for temporal mesh sequences, an entropy-based encoding and corner table-based method for compressing mesh sequences, and extensive experiments showing the effectiveness of the proposed method. All the code will be open-sourced at https://github.com/lszhuhaichao/ultron.

3D网格压缩时间对应形变建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。