arXiv:2411.07728cs.CVcs.AI2024-11中稿 · IEEE Transactions …被引 24

用图卷积网络分析多视角投影关系,实现无参考点云质量评估

No-Reference Point Cloud Quality Assessment via Graph Convolutional Network

  • 通过多视角投影构建感知一致的图结构,捕捉视图间空间关系
  • 在两个公开数据集上优于现有方法,最高提升0.15分(SROCC)
  • 适合点云质量评价、三维媒体传输等场景的研究者使用

三维点云作为新兴视觉媒介,因其能提供比二维数据更真实的视觉信息而日益受青睐。与二维图像和视频类似,点云在多媒体通信系统中也会经历质量退化和信息丢失,因此自动点云质量评估(PCQA)至关重要。本文提出一种新型无参考点云质量评估方法(GC-PCQA),利用图卷积网络(GCN)刻画多视角二维投影内容间的相互依赖关系。该方法包含三个模块:多视角投影、图构建与基于GCN的质量预测。首先对测试点云进行多视角投影,生成一系列水平与垂直方向的投影图像;随后基于各投影图像间的空间关系构建感知一致的图结构;最后通过GCN对图进行推理,表征不同投影图像间的相互依赖与交互关系,并融合多视角投影特征以完成最终质量预测。在两个公开基准数据库上的实验结果表明,所提方法性能优于当前最优质量评估指标。代码将开源于:https://github.com/chenwuwq/GC-PCQA。

原文摘要 · Abstract (English)

Three-dimensional (3D) point cloud, as an emerging visual media format, is increasingly favored by consumers as it can provide more realistic visual information than two-dimensional (2D) data. Similar to 2D plane images and videos, point clouds inevitably suffer from quality degradation and information loss through multimedia communication systems. Therefore, automatic point cloud quality assessment (PCQA) is of critical importance. In this work, we propose a novel no-reference PCQA method by using a graph convolutional network (GCN) to characterize the mutual dependencies of multi-view 2D projected image contents. The proposed GCN-based PCQA (GC-PCQA) method contains three modules, i.e., multi-view projection, graph construction, and GCN-based quality prediction. First, multi-view projection is performed on the test point cloud to obtain a set of horizontally and vertically projected images. Then, a perception-consistent graph is constructed based on the spatial relations among different projected images. Finally, reasoning on the constructed graph is performed by GCN to characterize the mutual dependencies and interactions between different projected images, and aggregate feature information of multi-view projected images for final quality prediction. Experimental results on two publicly available benchmark databases show that our proposed GC-PCQA can achieve superior performance than state-of-the-art quality assessment metrics. The code will be available at: https://github.com/chenwuwq/GC-PCQA.

点云质量评估图卷积网络无参考评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。