提升压缩动态点云画质,利用时空关联修复细节。
STQE: Spatial-Temporal Attribute Quality Enhancement for G-PCC Compressed Dynamic Point Clouds
- 通过重映射与注意力机制融合时空信息,精准对齐帧间几何结构。
- 在G-PCC测试中,亮度、色度分量分别提升0.855dB和0.828dB,码率降低超30%。
- 适合点云编解码优化、VR/AR等需高质量动态点云的场景。
针对压缩动态点云画质提升研究不足的问题,本文提出一种时空属性质量增强(STQE)网络,充分利用帧间空间-时间相关性以改善G-PCC压缩后的动态点云视觉质量。创新包括:基于重着色的运动补偿模块,将参考帧属性映射至当前帧几何以实现精确帧间对齐;通道感知的时间注意力模块,动态突出双向参考帧中的关键区域;高斯引导的邻域特征聚合模块,高效捕捉几何与颜色属性间的空间依赖关系;以及基于皮尔逊相关系数的联合损失函数,缓解传统点级均方误差优化带来的过度平滑问题。在最新G-PCC测试模型上,STQE在亮度、Cb、Cr分量上分别实现0.855 dB、0.682 dB、0.828 dB的delta PSNR提升,对应Bjøntegaard Delta rate(BD-rate)分别下降-25.2%、-31.6%、-32.5%。
原文摘要 · Abstract (English)
Very few studies have addressed quality enhancement for compressed dynamic point clouds. In particular, the effective exploitation of spatial-temporal correlations between point cloud frames remains largely unexplored. Addressing this gap, we propose a spatial-temporal attribute quality enhancement (STQE) network that exploits both spatial and temporal correlations to improve the visual quality of G-PCC compressed dynamic point clouds. Our contributions include a recoloring-based motion compensation module that remaps reference attribute information to the current frame geometry to achieve precise inter-frame geometric alignment, a channel-aware temporal attention module that dynamically highlights relevant regions across bidirectional reference frames, a Gaussian-guided neighborhood feature aggregation module that efficiently captures spatial dependencies between geometry and color attributes, and a joint loss function based on the Pearson correlation coefficient, designed to alleviate over-smoothing effects typical of point-wise mean squared error optimization. When applied to the latest G-PCC test model, STQE achieved improvements of 0.855 dB, 0.682 dB, and 0.828 dB in delta PSNR, with Bjøntegaard Delta rate (BD-rate) reductions of -25.2%, -31.6%, and -32.5% for the Luma, Cb, and Cr components, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。