arXiv:2502.03285cs.CVeess.IV2025-02被引 1

用深度学习将事件数据压缩为单个点云,兼顾时空与极性信息,显著提升压缩率。

Deep Learning-based Event Data Coding: A Joint Spatiotemporal and Polarity Solution

  • 将事件极性作为点云属性,统一编码时空与极性信息
  • 相比传统方案压缩率提升明显,且任务性能无损
  • 支持质量或视觉任务导向的自适应量化策略

类脑视觉传感器(事件相机)生成大量像素级事件,包含时空与极性信息,亟需高效编码方案。现有方法多聚焦无损编码,假设任何失真不可接受,主要用于图像分类、识别等任务。一种有前景的方法借鉴点云编码思想,将事件数据视为三维点集,采用双点云表示分别处理正负极性事件。本文首次提出基于深度学习的联合事件数据编码(DL-JEC)方案,采用单点云表示,将事件极性作为点云属性,从而利用时空与极性间的相关性。此外,提出新型自适应体素二值化策略,可优化质量或计算机视觉任务性能。实验表明,相较于MPEG G-PCC和JPEG Pleno PCC等主流标准,DL-JEC在压缩性能上显著领先;更重要的是,使用有损编码后,在事件分类等任务中性能未下降,打破了事件编码必须无损的固有范式。

原文摘要 · Abstract (English)

Neuromorphic vision sensors, commonly referred to as event cameras, generate a massive number of pixel-level events, composed by spatiotemporal and polarity information, thus demanding highly efficient coding solutions. Existing solutions focus on lossless coding of event data, assuming that no distortion is acceptable for the target use cases, mostly including computer vision tasks such as classification and recognition. One promising coding approach exploits the similarity between event data and point clouds, both being sets of 3D points, thus allowing to use current point cloud coding solutions to code event data, typically adopting a two-point clouds representation, one for each event polarity. This paper proposes a novel lossy Deep Learning-based Joint Event data Coding (DL-JEC) solution, which adopts for the first time a single-point cloud representation, where the event polarity plays the role of a point cloud attribute, thus enabling to exploit the correlation between the geometry/spatiotemporal and polarity event information. Moreover, this paper also proposes novel adaptive voxel binarization strategies which may be used in DL-JEC, optimized for either quality-oriented or computer vision task-oriented purposes which allow to maximize the performance for the task at hand. DL-JEC can achieve significant compression performance gains when compared with relevant conventional and DL-based state-of-the-art event data coding solutions, notably the MPEG G-PCC and JPEG Pleno PCC standards. Furthermore, it is shown that it is possible to use lossy event data coding, with significantly reduced rate regarding lossless coding, without compromising the target computer vision task performance, notably event classification, thus changing the current event data coding paradigm.

事件相机点云编码深度学习有损压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。