arXiv:2412.10433cs.CVcs.LG2024-12被引 2

用神经网络隐式压缩点云,实现更高精度的几何与属性还原。

Implicit Neural Compression of Point Clouds

  • 通过坐标神经网络隐式表示点云的几何和属性信息。
  • 静态点云压缩性能超越传统G-PCC标准,动态点云媲美最先进方法。
  • 适合需要高保真3D数据压缩的研究者和工业应用开发者。

点云因其对三维物体与场景的精确表达能力,在诸多应用中备受关注。然而,高效压缩无结构、高精度的点云数据仍是重大挑战。本文提出NeRC$^3$,一种基于隐式神经表示(INRs)的新点云压缩框架,可同时编码密集点云的几何与属性信息。该方法采用两个基于坐标的神经网络:一个将空间坐标映射为体素占据状态,另一个将占据体素映射为其属性值,从而隐式表示体素化点云的几何与属性。编码器对网络参数及重建所需辅助信息进行量化压缩,解码器通过输入体素坐标激活神经网络以重建原始点云。此外,我们通过减少时间冗余,将方法扩展至动态点云压缩,引入一种4维时空表示——4D-NeRC$^3$。实验结果验证了该方法的有效性:在静态点云上,NeRC$^3$优于基于八叉树的G-PCC标准及现有基于INR的方法;在动态点云上,4D-NeRC$^3$在几何压缩性能上超越最新G-PCC与V-PCC标准,且在联合几何与属性压缩方面达到顶尖学习型方法水平。

原文摘要 · Abstract (English)

Point clouds have gained prominence across numerous applications due to their ability to accurately represent 3D objects and scenes. However, efficiently compressing unstructured, high-precision point cloud data remains a significant challenge. In this paper, we propose NeRC$^3$, a novel point cloud compression framework that leverages implicit neural representations (INRs) to encode both geometry and attributes of dense point clouds. Our approach employs two coordinate-based neural networks: one maps spatial coordinates to voxel occupancy, while the other maps occupied voxels to their attributes, thereby implicitly representing the geometry and attributes of a voxelized point cloud. The encoder quantizes and compresses network parameters alongside auxiliary information required for reconstruction, while the decoder reconstructs the original point cloud by inputting voxel coordinates into the neural networks. Furthermore, we extend our method to dynamic point cloud compression through techniques that reduce temporal redundancy, including a 4D spatio-temporal representation termed 4D-NeRC$^3$. Experimental results validate the effectiveness of our approach: For static point clouds, NeRC$^3$ outperforms octree-based G-PCC standard and existing INR-based methods. For dynamic point clouds, 4D-NeRC$^3$ achieves superior geometry compression performance compared to the latest G-PCC and V-PCC standards, while matching state-of-the-art learning-based methods. It also demonstrates competitive performance in joint geometry and attribute compression.

点云压缩隐式表示神经网络3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。