让2D高斯点更懂图像结构,压缩效率大幅提升。
Structure-Guided Allocation of 2D Gaussians for Image Representation and Compression
- 根据图像结构分布初始化高斯点,提升语义相关性。
- 复杂区域用更高精度编码,低比特率下节省43%码率。
- 适合图像压缩与实时渲染场景,保持千帧以上速度。
近期2D高斯点阵(2DGS)在图像表示中展现出毫秒级解码能力,但现有方法对图像结构缺乏感知,导致低比特率下率失真(RD)效率受限。为此,本文提出一种结构引导的2DGS分配机制,将图像结构与表示容量和量化精度显式耦合,同时保持原生解码速度。首先,引入基于空间结构先验的初始化策略,使高斯点分布更局部且具语义意义;其次,在量化感知微调中,采用自适应位宽量化协方差参数,对复杂区域的小尺度高斯赋予更高精度,其余区域降低精度,实现RD优化,减少冗余而不影响边缘质量;第三,施加几何一致性正则化,使高斯方向与局部梯度一致,更好保留结构细节。大量实验表明,该方法显著提升2DGS的表示能力与RD性能,同时保持超过1000 FPS解码速度。相比基线方法GSImage,Kodak数据集上BD-rate降低43.44%,DIV2K上降低29.91%。
原文摘要 · Abstract (English)
Recent advances in 2D Gaussian Splatting (2DGS) have demonstrated its potential as a compact image representation with millisecond-level decoding. However, existing 2DGS-based pipelines allocate representation capacity and parameter precision largely oblivious to image structure, limiting their rate-distortion (RD) efficiency at low bitrates. To address this, we propose a structure-guided allocation principle for 2DGS, which explicitly couples image structure with both representation capacity and quantization precision, while preserving native decoding speed. First, we introduce a structure-guided initialization that assigns 2D Gaussians according to spatial structural priors inherent in natural images, yielding a localized and semantically meaningful distribution. Second, during quantization-aware fine-tuning, we propose adaptive bitwidth quantization of covariance parameters, which grants higher precision to small-scale Gaussians in complex regions and lower precision elsewhere, enabling RD-aware optimization, thereby reducing redundancy without degrading edge quality. Third, we impose a geometry-consistent regularization that aligns Gaussian orientations with local gradient directions to better preserve structural details. Extensive experiments demonstrate that our approach substantially improves both the representational power and the RD performance of 2DGS while maintaining over 1000 FPS decoding. Compared with the baseline GSImage, we reduce BD-rate by 43.44% on Kodak and 29.91% on DIV2K.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。