arXiv:2409.10293eess.IVcs.CV2024-09被引 22

基于采样的点云属性压缩方法,实现超低码率下高保真重建。

SPAC: Sampling-based Progressive Attribute Compression for Dense Point Clouds

  • 通过频域采样与自适应特征提取,分层捕获点云高频信息。
  • 在固体与密集点云数据集上分别降低24.58%和22.48%的码率(Y分量)。
  • 首个在MPEG测试条件下超越传统G-PCC标准的学习型编码器。

本文提出一种端到端的稠密点云属性压缩方法。该方法结合频率采样模块、基于几何辅助的自适应尺度特征提取模块以及全局超先验熵模型。频率采样模块利用汉明窗与快速傅里叶变换提取点云的高频成分,原始点云与采样点云的差值被划分为多个子点云,并通过八叉树划分生成结构化输入。特征提取模块融合自适应卷积层与偏移注意力机制,捕捉局部与全局特征;随后引入几何辅助的属性特征优化模块进行特征精炼。最后,采用全局超先验模型进行熵编码,通过将深层(基底层)的超先验参数传播至其他层级,提升编码效率。解码端使用镜像网络逐级恢复特征,并通过转置卷积重建颜色属性。该方法在基底层以低码率编码,逐步添加增强层信息以提升重建精度。在MPEG通用测试条件(CTCs)下,相较于最新G-PCC测试模型(TMC13v23),在MPEG固态数据集上,Y分量平均降低24.58%码率(YUV联合降低21.23%),在密集数据集上分别降低22.48%(YUV联合17.19%)。这是首个在相同测试条件下,学习型编码器超越传统G-PCC标准的实例。

原文摘要 · Abstract (English)

We propose an end-to-end attribute compression method for dense point clouds. The proposed method combines a frequency sampling module, an adaptive scale feature extraction module with geometry assistance, and a global hyperprior entropy model. The frequency sampling module uses a Hamming window and the Fast Fourier Transform to extract high-frequency components of the point cloud. The difference between the original point cloud and the sampled point cloud is divided into multiple sub-point clouds. These sub-point clouds are then partitioned using an octree, providing a structured input for feature extraction. The feature extraction module integrates adaptive convolutional layers and uses offset-attention to capture both local and global features. Then, a geometry-assisted attribute feature refinement module is used to refine the extracted attribute features. Finally, a global hyperprior model is introduced for entropy encoding. This model propagates hyperprior parameters from the deepest (base) layer to the other layers, further enhancing the encoding efficiency. At the decoder, a mirrored network is used to progressively restore features and reconstruct the color attribute through transposed convolutional layers. The proposed method encodes base layer information at a low bitrate and progressively adds enhancement layer information to improve reconstruction accuracy. Compared to the latest G-PCC test model (TMC13v23) under the MPEG common test conditions (CTCs), the proposed method achieved an average Bjontegaard delta bitrate reduction of 24.58% for the Y component (21.23% for YUV combined) on the MPEG Category Solid dataset and 22.48% for the Y component (17.19% for YUV combined) on the MPEG Category Dense dataset. This is the first instance of a learning-based codec outperforming the G-PCC standard on these datasets under the MPEG CTCs.

点云压缩学习编码超先验频域采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。