ResPCC让点云压缩在丢包环境下仍能保持高精度,适合实际网络传输。
ResPCC: A Loss-Resilient Neural Point Cloud Codec over Lossy Networks

- 根据丢包率自适应调节特征分布,用空间交错设计缓解通道丢失问题。
- 在5%~30%丢包率下,重建质量优于现有方法,几何失真显著减少。
- 适用于车载、无人机等存在不稳定网络的3D数据传输场景。
点云压缩(PCC)对高效存储和传输三维数据至关重要。尽管基于学习的PCC方法在理想传输条件下表现良好,但普遍依赖无损环境。实际中,丢包常见且会严重扭曲潜在特征,导致坐标漂移和几何退化。为此,我们提出ResPCC,首个端到端神经点云编码器,具备内在抗丢包能力。其框架具有丢包率感知特性,可适应多样丢包条件。编码器引入条件自适应潜在调制(CALM)模块,依据感知丢包率调整潜在特征分布;并采用空间-通道交织(SCI)机制,将通道级数据缺失转化为空间分散的元素级缺失模式。解码器设计掩码感知图式潜在修复(MGLR)模块,后接字典式精修(DBR)阶段,恢复受损特征并使其与规范先验对齐。在ShapeNet和SemanticKITTI数据集上,5%至30%丢包率下的评估显示,ResPCC始终表现出更优的稳定性与率失真性能。该框架在丢包条件下维持高重建保真度,为实际网络上的3D数据传输提供可靠解决方案。代码已开源:https://github.com/starrynight314/ResPCC。
原文摘要 · Abstract (English)
Point cloud compression (PCC) is critical for efficient storage and transmission of 3D data. While recent learning-based PCC methods achieve good rate-distortion (R-D) performance, they generally rely on ideal transmission conditions. In practice, packet loss is a common issue and can severely distort latent features, causing coordinate drift and geometric degradation. To address this challenge, we present ResPCC, the first end-to-end neural point cloud codec designed to offer intrinsic resilience against data loss. Our framework is loss-rate-aware and adapts to diverse packet loss conditions. At the encoder, we introduce a Condition-Adaptive Latent Modulation (CALM) module to adjust latent feature distributions according to the perceived loss rate, as well as a Spatial-Channel Interleaving (SCI) mechanism that transforms channel-wise data extinction into spatially scattered element-wise missing patterns. At the decoder, we develop a Mask-Aware Graph-based Latent Restoration (MGLR) module, followed by a Dictionary-based Refinement (DBR) stage to recover corrupted features and align them with canonical priors. Evaluations on ShapeNet and SemanticKITTI under 5\% to 30\% packet loss rates show that ResPCC consistently delivers superior stability and R-D performance over baselines. Our framework maintains high reconstruction fidelity under lossy conditions, providing a reliable solution for 3D data transmission over practical networks. Code is available at https://github.com/starrynight314/ResPCC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。