arXiv:2503.00047eess.IVcs.CV2025-03被引 12

用最优传输理论提升点云压缩后的感知质量,兼顾细节与视觉自然度。

PCE-GAN: A Generative Adversarial Network for Point Cloud Attribute Quality Enhancement based on Optimal Transport

  • 基于最优传输设计生成对抗网络,同步优化重建精度与人眼感知质量。
  • 在G-PCC测试中相比PredLift和RAHT配置分别降低19.2%和18.3%的BD-rate。
  • 适合关注点云压缩后质量修复、尤其是纹理与色彩表现的研究者。

点云压缩虽大幅减少数据量,但牺牲了重建质量,亟需先进增强技术。现有方法多聚焦点对点保真度,忽视人眼视觉系统的感知质量。为此,我们提出基于最优传输理论的点云质量增强生成对抗网络(PCE-GAN),旨在同时优化数据保真度与感知质量。生成器包含局部特征提取(LFE)单元、全局空间相关性(GSC)单元和特征压缩单元。LFE单元通过动态图构建与图注意力机制高效提取局部特征,更关注严重失真的点;GSC单元利用邻近区域几何信息扩展局部邻域,并引入类Transformer结构捕捉长程全局相关性。判别器计算增强后点云与原始点云概率分布间的差异,引导生成器实现高质量重建。实验表明,该方法达到领先性能:在最新基于几何的点云压缩(G-PCC)测试模型上,相比PredLift编码配置平均降低19.2%的BD-rate,相比RAHT配置降低18.3%。主观对比显示纹理清晰度与颜色过渡显著改善,呈现更精细细节与更自然的颜色渐变。

原文摘要 · Abstract (English)

Point cloud compression significantly reduces data volume but sacrifices reconstruction quality, highlighting the need for advanced quality enhancement techniques. Most existing approaches focus primarily on point-to-point fidelity, often neglecting the importance of perceptual quality as interpreted by the human visual system. To address this issue, we propose a generative adversarial network for point cloud quality enhancement (PCE-GAN), grounded in optimal transport theory, with the goal of simultaneously optimizing both data fidelity and perceptual quality. The generator consists of a local feature extraction (LFE) unit, a global spatial correlation (GSC) unit and a feature squeeze unit. The LFE unit uses dynamic graph construction and a graph attention mechanism to efficiently extract local features, placing greater emphasis on points with severe distortion. The GSC unit uses the geometry information of neighboring patches to construct an extended local neighborhood and introduces a transformer-style structure to capture long-range global correlations. The discriminator computes the deviation between the probability distributions of the enhanced point cloud and the original point cloud, guiding the generator to achieve high quality reconstruction. Experimental results show that the proposed method achieves state-of-the-art performance. Specifically, when applying PCE-GAN to the latest geometry-based point cloud compression (G-PCC) test model, it achieves an average BD-rate of -19.2% compared with the PredLift coding configuration and -18.3% compared with the RAHT coding configuration. Subjective comparisons show a significant improvement in texture clarity and color transitions, revealing finer details and more natural color gradients.

点云压缩生成对抗网络感知质量最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。