融合预训练模型与隐式表示,实现更高效点云压缩。
HybridINR-PCGC: Hybrid Lossless Point Cloud Geometry Compression Bridging Pretrained Model and Implicit Neural Representation
- 用预训练先验网络加速隐式重构收敛
- 仅传输增强层参数,降低码流开销20.43%
- 适合对压缩率和编码速度有要求的场景
基于学习的点云压缩性能优于传统编码器。但基于预训练的方法依赖训练数据,而隐式神经表示(INR)方法虽分布无关、鲁棒性强,却需耗时在线训练且存在模型过拟合导致的码流开销。为此,我们提出HybridINR-PCGC,一种结合预训练模型与INR的混合框架。该框架保留分布无关性的同时,利用预训练网络加速收敛并减少模型开销,包含两部分:快速推理的预训练先验网络(PPN)和分布无关的优化器(DAR)。DAR分为基础层与增强层,仅增强层需编码进码流。进一步设计监督式模型压缩模块,最小化增强层参数比特率。实验表明,相比G-PCC在8iVFB上降低约20.43%的Bpp;在挑战性跨分布场景Cat1B中,相比UniPCGC降低约57.85%;平均相较LINR-PCGC在8iVFB上提升15.193%的压缩率,兼具高效编码与优异性能。
原文摘要 · Abstract (English)
Learning-based point cloud compression presents superior performance to handcrafted codecs. However, pretrained-based methods, which are based on end-to-end training and expected to generalize to all the potential samples, suffer from training data dependency. Implicit neural representation (INR) based methods are distribution-agnostic and more robust, but they require time-consuming online training and suffer from the bitstream overhead from the overfitted model. To address these limitations, we propose HybridINR-PCGC, a novel hybrid framework that bridges the pretrained model and INR. Our framework retains distribution-agnostic properties while leveraging a pretrained network to accelerate convergence and reduce model overhead, which consists of two parts: the Pretrained Prior Network (PPN) and the Distribution Agnostic Refiner (DAR). We leverage the PPN, designed for fast inference and stable performance, to generate a robust prior for accelerating the DAR's convergence. The DAR is decomposed into a base layer and an enhancement layer, and only the enhancement layer needed to be packed into the bitstream. Finally, we propose a supervised model compression module to further supervise and minimize the bitrate of the enhancement layer parameters. Based on experiment results, HybridINR-PCGC achieves a significantly improved compression rate and encoding efficiency. Specifically, our method achieves a Bpp reduction of approximately 20.43% compared to G-PCC on 8iVFB. In the challenging out-of-distribution scenario Cat1B, our method achieves a Bpp reduction of approximately 57.85% compared to UniPCGC. And our method exhibits a superior time-rate trade-off, achieving an average Bpp reduction of 15.193% relative to the LINR-PCGC on 8iVFB.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。