提出联合上采样几何与属性的新方法,提升大规模彩色点云质量。
Deep Learning based Joint Geometry and Attribute Up-sampling for Large-Scale Colored Point Clouds

- 联合学习几何与属性模式,利用空间属性相关性增强重建。
- 在4~16倍上采样率下PSNR达30.39~33.90分贝,优于现有方法。
- 适用于需要高保真3D建模的场景,如虚拟现实与自动驾驶。
彩色点云包含几何与属性两部分,是实现真实感和沉浸式3D应用的主要表示方式。为生成大规模、高密度的彩色点云,本文提出一种基于深度学习的联合几何与属性上采样(JGAU)方法,能够同时学习几何与属性的分布模式,并利用空间属性相关性。首先,构建并发布一个大规模彩色点云上采样数据集SYSU-PCUD,包含121个大尺度彩色点云,涵盖六类对象及四种采样率,具有丰富的几何与属性复杂度。其次,设计了联合上采样的JGAU框架,包含几何上采样网络与属性上采样网络,后者借助上采样的辅助几何信息建模属性邻域相关性。第三,提出两种粗粒度属性上采样方法:基于几何距离加权的属性插值(GDWAI)与基于深度学习的属性插值(DLAI),用于生成初始属性;随后引入属性增强模块,通过挖掘内在属性与几何模式进一步优化属性,生成高质量点云。大量实验表明,所提方法在4倍、8倍、12倍、16倍上采样率下的峰值信噪比(PSNR)分别为33.90、32.10、31.10、30.39分贝,相比当前最优方法分别提升2.32、2.47、2.28、2.11分贝,效果显著。
原文摘要 · Abstract (English)
Colored point cloud, which includes geometry and attribute components, is a mainstream representation enabling realistic and immersive 3D applications. To generate large-scale and denser colored point clouds, we propose a deep learning-based Joint Geometry and Attribute Up-sampling (JGAU) method that learns to model both geometry and attribute patterns while leveraging spatial attribute correlations. First, we establish and release a large-scale dataset for colored point cloud up-sampling called SYSU-PCUD, containing 121 large-scale colored point clouds with diverse geometry and attribute complexities across six categories and four sampling rates. Second, to improve the quality of up-sampled point clouds, we propose a deep learning-based JGAU framework that jointly up-samples geometry and attributes. It consists of a geometry up-sampling network and an attribute up-sampling network, where the latter leverages the up-sampled auxiliary geometry to model neighborhood correlations of the attributes. Third, we propose two coarse attribute up-sampling methods, Geometric Distance Weighted Attribute Interpolation (GDWAI) and Deep Learning-based Attribute Interpolation (DLAI), to generate coarse up-sampled attributes for each point. Then, an attribute enhancement module is introduced to refine these up-sampled attributes and produce high-quality point clouds by further exploiting intrinsic attribute and geometry patterns. Extensive experiments show that the Peak Signal-to-Noise Ratio (PSNR) achieved by the proposed JGAU method is 33.90 decibels, 32.10 decibels, 31.10 decibels, and 30.39 decibels for up-sampling rates of 4 times, 8 times, 12 times, and 16 times, respectively. Compared to state-of-the-art methods, JGAU achieves average PSNR gains of 2.32 decibels, 2.47 decibels, 2.28 decibels, and 2.11 decibels at these four up-sampling rates, demonstrating significant improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。