探索非线性变换在压缩中的信息与计算权衡,提出高效低比特压缩新方法。
Information-computation trade-offs in non-linear transforms
- 对比INR与高斯点阵的表示特性与压缩表现,揭示其优劣
- 提出文本变换,在极低码率下实现高效压缩并提升感知质量
- 设计通用LZ78变换框架,保持算法普适性同时提升压缩效率
本文研究非线性变换在现代信息处理任务中信息与计算的权衡关系。针对图像压缩,分析了隐式神经表示(INRs)和2D高斯点阵(GS)两种新兴非线性变换框架的表征能力、有损压缩下的行为及收敛特性。结果表明,INR具有紧凑且分辨率可调的神经场表示,而GS则具备高度并行化和空间可解释性。随后,提出一种文本变换,可在超低码率下实现高效压缩,并显著提升人类感知满意度;结合有损压缩去噪思想,该变换成为强大的去噪工具。最后,引入一个通用的Lempel-Ziv(LZ78)变换,应用于广泛压缩器家族时,生成的新压缩器保留了LZ78的渐近通用性保证。三类变换共同揭示了编码效率与计算成本之间的根本权衡。这些洞见还可扩展至分类、去噪与生成式AI等任务,为在资源约束下优化性能提供了新路径。
原文摘要 · Abstract (English)
In this work, we explore the interplay between information and computation in non-linear transform-based compression for broad classes of modern information-processing tasks. We first investigate two emerging nonlinear data transformation frameworks for image compression: Implicit Neural Representations (INRs) and 2D Gaussian Splatting (GS). We analyze their representational properties, behavior under lossy compression, and convergence dynamics. Our results highlight key trade-offs between INR's compact, resolution-flexible neural field representations and GS's highly parallelizable, spatially interpretable fitting, providing insights for future hybrid and compression-aware frameworks. Next, we introduce the textual transform that enables efficient compression at ultra-low bitrate regimes and simultaneously enhances human perceptual satisfaction. When combined with the concept of denoising via lossy compression, the textual transform becomes a powerful tool for denoising tasks. Finally, we present a Lempel-Ziv (LZ78) "transform", a universal method that, when applied to any member of a broad compressor family, produces new compressors that retain the asymptotic universality guarantees of the LZ78 algorithm. Collectively, these three transforms illuminate the fundamental trade-offs between coding efficiency and computational cost. We discuss how these insights extend beyond compression to tasks such as classification, denoising, and generative AI, suggesting new pathways for using non-linear transformations to balance resource constraints and performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。