arXiv:2502.17939cs.MMcs.CV2025-02被引 2

端到端联合压缩点云几何与颜色,大幅降低码率且提速

Deep-JGAC: End-to-End Deep Joint Geometry and Attribute Compression for Dense Colored Point Clouds

  • 联合建模几何与属性相关性,提升压缩效率
  • 在相同质量下,相比现有方法码率降低超30%
  • 适合需要高效传输或存储密集彩色点云的场景

彩色点云是三维视觉中的基础表示形式,因数据量巨大,亟需高效的点云压缩(PCC)。本文提出一种面向密集彩色点云的端到端深度联合几何与属性压缩框架(Deep-JGAC),利用几何与属性之间的相关性实现高效率压缩。首先,设计灵活的Deep-JGAC框架,支持学习型或非学习型的几何与属性编码器。其次,提出属性辅助的深度几何编码器,在不改变解码流程的前提下增强几何特征表示,并引入属性信息融合模块(AIFM)实现属性信息在几何编码中的有效融合。第三,针对几何压缩失真导致的几何与属性错位问题,提出优化的重着色模块,将属性重新附着于失真的几何结构上,提升重建色彩质量并降低计算开销。大量实验表明,在几何质量指标D1-PSNR下,Deep-JGAC相较最先进方法G-PCC、V-PCC、GRASP和PCGCv2分别实现82.96%、36.46%、41.72%和31.16%的码率降低;在感知联合质量指标MS-GraphSIM下,相较G-PCC、V-PCC和IT-DL-PCC分别实现48.72%、14.67%和57.14%的码率降低。编码/解码时间平均减少94.29%/24.70%(对比V-PCC)和96.75%/91.02%(对比IT-DL-PCC)。

原文摘要 · Abstract (English)

Colored point cloud becomes a fundamental representation in the realm of 3D vision. Effective Point Cloud Compression (PCC) is urgently needed due to huge amount of data. In this paper, we propose an end-to-end Deep Joint Geometry and Attribute point cloud Compression (Deep-JGAC) framework for dense colored point clouds, which exploits the correlation between the geometry and attribute for high compression efficiency. Firstly, we propose a flexible Deep-JGAC framework, where the geometry and attribute sub-encoders are compatible to either learning or non-learning based geometry and attribute encoders. Secondly, we propose an attribute-assisted deep geometry encoder that enhances the geometry latent representation with the help of attribute, where the geometry decoding remains unchanged. Moreover, Attribute Information Fusion Module (AIFM) is proposed to fuse attribute information in geometry coding. Thirdly, to solve the mismatch between the point cloud geometry and attribute caused by the geometry compression distortion, we present an optimized re-colorization module to attach the attribute to the geometrically distorted point cloud for attribute coding. It enhances the colorization and lowers the computational complexity. Extensive experimental results demonstrate that in terms of the geometry quality metric D1-PSNR, the proposed Deep-JGAC achieves an average of 82.96%, 36.46%, 41.72%, and 31.16% bit-rate reductions as compared to the state-of-the-art G-PCC, V-PCC, GRASP, and PCGCv2, respectively. In terms of perceptual joint quality metric MS-GraphSIM, the proposed Deep-JGAC achieves an average of 48.72%, 14.67%, and 57.14% bit-rate reductions compared to the G-PCC, V-PCC, and IT-DL-PCC, respectively. The encoding/decoding time costs are also reduced by 94.29%/24.70%, and 96.75%/91.02% on average as compared with the V-PCC and IT-DL-PCC.

点云压缩深度学习几何属性联合高效编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。