arXiv:2603.22776eess.IVcs.CV2026-03

针对全景图压缩的畸变问题,提出基于视口的神经压缩新方法。

Viewport-based Neural 360° Image Compression

  • 按视角提取图像块,避免传统投影带来的畸变和冗余
  • 引入跨视口的全局信息建模,减少压缩时的信息损失
  • 相比最优现有方法,平均节省14.01%码率,适合全景视频传输

由于社交平台上360°图像的流行,其压缩技术对媒体存储与传输至关重要。传统压缩流程将球面图像投影到单个2D平面,导致过度采样和畸变问题。本文提出一种新的基于视口的神经压缩框架,用视口提取替代传统投影,高效压缩多个视口以最小化固有失真与冗余。然而,视口提取会阻碍不同视口间的全局信息共享,造成全局上下文丢失。为此,设计了一种基于Transformer的视口上下文(VPCT)模块,嵌入标准2D图像压缩结构中,捕捉多视口间全局先验信息,实现高效压缩。实验表明,该框架在保持质量的前提下,相比最优的360°图像压缩方法平均节省14.01%码率,且所提VPCT编码器在视口压缩框架中优于现有2D图像压缩模型。代码已开源:https://github.com/Jingwei-Liao/VPCT。

原文摘要 · Abstract (English)

Given the popularity of 360° images on social media platforms, 360° image compression becomes a critical technology for media storage and transmission. Conventional 360° image compression pipeline projects the spherical image into a single 2D plane, leading to issues of oversampling and distortion. In this paper, we propose a novel viewport-based neural compression pipeline for 360° images. By replacing the image projection in conventional 360° image compression pipelines with viewport extraction and efficiently compressing multiple viewports, the proposed pipeline minimizes the inherent oversampling and distortion issues. However, viewport extraction impedes information sharing between multiple viewports during compression, causing the loss of global information about the spherical image. To tackle this global information loss, we design a neural viewport codec to capture global prior information across multiple viewports and maximally compress the viewport data. The viewport codec is empowered by a transformer-based ViewPort ConText (VPCT) module that can be integrated with canonical learning-based 2D image compression structures. We compare the proposed pipeline with existing 360° image compression models and conventional 360° image compression pipelines building on learning-based 2D image codecs and standard hand-crafted codecs. Results show that our pipeline saves an average of $14.01\%$ bit consumption compared to the best-performing 360° image compression methods without compromising quality. The proposed VPCT-based codec also outperforms existing 2D image codecs in the viewport-based neural compression pipeline. Our code can be found at: https://github.com/Jingwei-Liao/VPCT.

全景图像神经压缩视口图像编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。