用稀疏编码压缩隐式神经表示,省空间还保质量
SINR: Sparsity Driven Compressed Implicit Neural Representations
- 利用INR权重向量的稀疏模式,通过高维字典编码压缩
- 在多种数据上压缩率显著优于传统方法,解码质量高
- 兼容现有压缩方案,适合需要高效存储的视觉任务
隐式神经表示(INRs)因其无限查询分辨率和低存储需求,正成为离散信号的通用表示方式。现有压缩方法通常采用两种策略:1. 直接量化并结合熵编码训练好的INR;2. 通过可学习变换在INR上生成潜在码。其性能高度依赖量化与熵编码方案。本文提出SINR,一种创新压缩算法,利用INR权重向量空间中的模式,通过高维稀疏码在字典中进行压缩。进一步分析表明,生成稀疏码的字典原子无需学习或传输即可成功恢复INR权重。我们证明该方法可与任意现有基于INR的信号压缩技术集成。实验显示,SINR在不同配置下均显著降低INR存储需求,超越传统基线。同时,在图像、占据场和神经辐射场等多种数据模态上保持高质量解码。
原文摘要 · Abstract (English)
Implicit Neural Representations (INRs) are increasingly recognized as a versatile data modality for representing discretized signals, offering benefits such as infinite query resolution and reduced storage requirements. Existing signal compression approaches for INRs typically employ one of two strategies: 1. direct quantization with entropy coding of the trained INR; 2. deriving a latent code on top of the INR through a learnable transformation. Thus, their performance is heavily dependent on the quantization and entropy coding schemes employed. In this paper, we introduce SINR, an innovative compression algorithm that leverages the patterns in the vector spaces formed by weights of INRs. We compress these vector spaces using a high-dimensional sparse code within a dictionary. Further analysis reveals that the atoms of the dictionary used to generate the sparse code do not need to be learned or transmitted to successfully recover the INR weights. We demonstrate that the proposed approach can be integrated with any existing INR-based signal compression technique. Our results indicate that SINR achieves substantial reductions in storage requirements for INRs across various configurations, outperforming conventional INR-based compression baselines. Furthermore, SINR maintains high-quality decoding across diverse data modalities, including images, occupancy fields, and Neural Radiance Fields.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。