用智能高斯点压缩超高清图像,兼顾画质与压缩率。
SmartSplat: Feature-Smart Gaussians for Scalable Compression of Ultra-High-Resolution Images
- 根据梯度和颜色方差动态采样高斯点,提升覆盖效率。
- 在16K图像上实现超越现有方法的压缩性能,峰值达10.27dB PSNR。
- 适合需要超高清图像高效存储与传输的场景,如元宇宙、VR应用。
生成式AI推动了超高清视觉内容的爆发式增长,对终端设备上的高效压缩与实时解码带来挑战。受3D高斯溅射启发,现有2D高斯图像模型虽提升了表示效率,但在超高清场景下仍难以平衡压缩比与重建保真度。为此,我们提出SmartSplat,一种基于高斯溅射的可扩展图像压缩框架,支持任意分辨率与压缩比。该方法引入梯度-颜色引导的变分采样策略及排除式均匀采样方案,优化高斯原语在像素空间中的非重叠覆盖;同时提出尺度自适应颜色采样方法,增强多尺度下的颜色初始化。通过联合优化空间布局、尺度与颜色初始化,仅用少量高斯点即可高效捕捉局部结构与全局纹理,在强压缩条件下实现高重建质量。在DIV8K和新构建的16K数据集上的大量实验表明,SmartSplat在相近压缩比下持续优于当前最优方法,并突破其压缩极限,展现出优异的可扩展性与实用性。代码已开源:https://github.com/lif314/SmartSplat。
原文摘要 · Abstract (English)
Recent advances in generative AI have accelerated the production of ultra-high-resolution visual content, posing significant challenges for efficient compression and real-time decoding on end-user devices. Inspired by 3D Gaussian Splatting, recent 2D Gaussian image models improve representation efficiency, yet existing methods struggle to balance compression ratio and reconstruction fidelity in ultra-high-resolution scenarios. To address this issue, we propose SmartSplat, a highly adaptive and feature-aware GS-based image compression framework that supports arbitrary image resolutions and compression ratios. SmartSplat leverages image-aware features such as gradients and color variances, introducing a Gradient-Color Guided Variational Sampling strategy together with an Exclusion-based Uniform Sampling scheme to improve the non-overlapping coverage of Gaussian primitives in pixel space. In addition, we propose a Scale-Adaptive Gaussian Color Sampling method to enhance color initialization across scales. Through joint optimization of spatial layout, scale, and color initialization, SmartSplat efficiently captures both local structures and global textures using a limited number of Gaussians, achieving high reconstruction quality under strong compression. Extensive experiments on DIV8K and a newly constructed 16K dataset demonstrate that SmartSplat consistently outperforms state-of-the-art methods at comparable compression ratios and exceeds their compression limits, showing strong scalability and practical applicability. The code is publicly available at https://github.com/lif314/SmartSplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。