arXiv:2505.13542eess.IVcs.CV2025-05被引 1

用生成对抗网络和二值球面量化,让图像压缩更快更小更清晰。

GANCompress: GAN-Enhanced Neural Image Compression with Binary Spherical Quantization

  • 将隐变量投影到超球面实现高效离散化,降低量化误差。
  • 压缩比最高达100倍,视觉失真极小,编码解码速度提升2.4倍。
  • 适合实时视觉通信系统,对复杂图像内容适应性强。

数字通信中视觉数据的指数增长加剧了对高效压缩技术的需求,要求在率失真性能与计算可行性之间取得平衡。尽管近期神经压缩方法展现出潜力,但仍面临高压缩比下保持感知质量、计算效率及适应多样视觉内容等根本挑战。本文提出GANCompress,一种结合二值球面量化(BSQ)与生成对抗网络(GAN)的新型神经压缩框架。该方法采用基于Transformer的自编码器,其增强型BSQ瓶颈将潜在表示投影至超球面,实现高效离散化并控制量化误差。随后引入专用GAN架构,融合频域注意力与色彩一致性优化。实验表明,GANCompress在压缩效率上实现显著提升——文件大小最多减少100倍,视觉失真极小。相比传统编解码器如H.264,在感知指标上提升12-15%,同时保持相当的PSNR/SSIM值,编码解码速度提升2.4倍。在ImageNet-1k与COCO2017等标准基准上,该方法达到新SOTA,FID从0.72降至0.41(改善43%),且吞吐量更高。本工作为神经压缩技术带来重要进展,具备广泛实时视觉通信应用前景。

原文摘要 · Abstract (English)

The exponential growth of visual data in digital communications has intensified the need for efficient compression techniques that balance rate-distortion performance with computational feasibility. While recent neural compression approaches have shown promise, they still struggle with fundamental challenges: preserving perceptual quality at high compression ratios, computational efficiency, and adaptability to diverse visual content. This paper introduces GANCompress, a novel neural compression framework that synergistically combines Binary Spherical Quantization (BSQ) with Generative Adversarial Networks (GANs) to address these challenges. Our approach employs a transformer-based autoencoder with an enhanced BSQ bottleneck that projects latent representations onto a hypersphere, enabling efficient discretization with bounded quantization error. This is followed by a specialized GAN architecture incorporating frequency-domain attention and color consistency optimization. Experimental results demonstrate that GANCompress achieves substantial improvement in compression efficiency -- reducing file sizes by up to 100x with minimal visual distortion. Our method outperforms traditional codecs like H.264 by 12-15% in perceptual metrics while maintaining comparable PSNR/SSIM values, with 2.4x faster encoding and decoding speeds. On standard benchmarks including ImageNet-1k and COCO2017, GANCompress sets a new state-of-the-art, reducing FID from 0.72 to 0.41 (43% improvement) compared to previous methods while maintaining higher throughput. This work presents a significant advancement in neural compression technology with promising applications for real-time visual communication systems.

图像压缩GAN量化Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。