arXiv:2410.17823cs.LGcs.CV2024-10被引 6

用注意力机制提升点云属性压缩效率,显著改善图像质量。

Att2CPC: Attention-Guided Lossy Attribute Compression of Point Clouds

  • 引入外部交叉注意力,融合几何与属性信息分层聚合特征
  • 在Y通道和YUV通道分别提升1.15dB和2.13dB的压缩性能
  • 首个将注意力机制用于点云属性压缩的方法,适合3D视觉应用

随着3D感知与采集技术的进步,点云数据量急剧增长,亟需高效压缩方法。本文聚焦于学习型有损点云属性压缩(PCAC)任务,提出一种基于注意力机制的高效压缩方法,采用自编码器架构。编码端通过多级下采样提取局部属性模式,并设计有效外部交叉注意力(ECA),融合属性与几何上下文实现分层特征聚合;解码端基于多尺度表示与零填充上采样策略逐步重建点云属性。据我们所知,这是首个将注意力机制引入点基有损PCAC任务的方法。在人体帧、稀疏物体及大规模点云场景等多组序列上验证了模型压缩效率。实验表明,相比当前最优的点基方法Deep-PCAC,本方法在Y通道和YUV通道的BD-PSNR分别提升1.15dB和2.13dB。代码已开源:https://github.com/I2-Multimedia-Lab/Att2CPC。

原文摘要 · Abstract (English)

With the great progress of 3D sensing and acquisition technology, the volume of point cloud data has grown dramatically, which urges the development of efficient point cloud compression methods. In this paper, we focus on the task of learned lossy point cloud attribute compression (PCAC). We propose an efficient attention-based method for lossy compression of point cloud attributes leveraging on an autoencoder architecture. Specifically, at the encoding side, we conduct multiple downsampling to best exploit the local attribute patterns, in which effective External Cross Attention (ECA) is devised to hierarchically aggregate features by intergrating attributes and geometry contexts. At the decoding side, the attributes of the point cloud are progressively reconstructed based on the multi-scale representation and the zero-padding upsampling tactic. To the best of our knowledge, this is the first approach to introduce attention mechanism to point-based lossy PCAC task. We verify the compression efficiency of our model on various sequences, including human body frames, sparse objects, and large-scale point cloud scenes. Experiments show that our method achieves an average improvement of 1.15 dB and 2.13 dB in BD-PSNR of Y channel and YUV channel, respectively, when comparing with the state-of-the-art point-based method Deep-PCAC. Codes of this paper are available at https://github.com/I2-Multimedia-Lab/Att2CPC.

点云压缩注意力机制属性编码自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。