提出新方法压缩光场图像,效率比现有技术高20.5%。
LFIC-DRASC: Deep Light Field Image Compression Using Disentangled Representation and Asymmetrical Strip Convolution
- 用解耦表示与非对称条带卷积提取光场数据结构先验
- 通过长程相关建模实现特征解耦,提升空间关系表达能力
- 适合需要高效压缩光场数据的研究者和工程师
光场(LF)图像是能够真实呈现三维场景空间与角度信息的四维光线数据,但其庞大的数据量给实时处理、传输和存储带来巨大挑战。本文提出一种端到端的深度光场图像压缩方法——LFIC-DRASC,以提升编码效率。首先,将光场图像压缩问题建模为学习解耦的光场表示网络与图像编解码网络。其次,设计两种新颖的特征提取器,利用光场数据在不同维度上的结构先验进行特征融合;同时提出解耦光场表示网络,增强特征解耦能力。第三,提出LFIC-DRASC模型,引入水平与垂直两种非对称条带卷积(ASC)算子,捕获光场特征空间中的长程相关性。这两种ASC算子可与标准卷积结合,进一步解耦光场特征,增强模型对复杂空间关系的建模能力。实验表明,所提方法相比当前最优技术平均降低20.5%码率。
原文摘要 · Abstract (English)
Light-Field (LF) image is emerging 4D data of light rays that is capable of realistically presenting spatial and angular information of 3D scene. However, the large data volume of LF images becomes the most challenging issue in real-time processing, transmission, and storage. In this paper, we propose an end-to-end deep LF Image Compression method Using Disentangled Representation and Asymmetrical Strip Convolution (LFIC-DRASC) to improve coding efficiency. Firstly, we formulate the LF image compression problem as learning a disentangled LF representation network and an image encoding-decoding network. Secondly, we propose two novel feature extractors that leverage the structural prior of LF data by integrating features across different dimensions. Meanwhile, disentangled LF representation network is proposed to enhance the LF feature disentangling and decoupling. Thirdly, we propose the LFIC-DRASC for LF image compression, where two Asymmetrical Strip Convolution (ASC) operators, i.e. horizontal and vertical, are proposed to capture long-range correlation in LF feature space. These two ASC operators can be combined with the square convolution to further decouple LF features, which enhances the model ability in representing intricate spatial relationships. Experimental results demonstrate that the proposed LFIC-DRASC achieves an average of 20.5\% bit rate reductions comparing with the state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。