arXiv:2504.12923cs.CV2025-04

只编码图像中关键区域,大幅降低计算开销。

Efficient Masked Image Compression with Position-Indexed Self-Attention

  • 用位置索引自注意力机制,仅处理掩码可见区域
  • 相比现有方法,计算量显著减少,仍保持高质量重建
  • 适合需要高效压缩的视觉任务,如目标检测

近年来,面向高层视觉任务的图像压缩受到广泛关注。由于图像中的物体信息对下游任务至关重要,而背景信息作用较小,一些研究提出语义结构化比特流,仅传输和重建任务所需信息。然而,这些方法在编码后才进行结构化,导致编码过程仍需处理整张图像,大量无关信息参与计算,造成冗余。传统压缩方法以二维图像为输入,即使通过语义掩码将非重要区域置零,这些区域仍作为图像一部分参与后续计算。为此,我们提出一种基于位置索引自注意力机制的图像压缩方法,仅对掩码可见部分进行编码与解码。相比现有语义结构化压缩方法,该方法可显著降低计算成本。

原文摘要 · Abstract (English)

In recent years, image compression for high-level vision tasks has attracted considerable attention from researchers. Given that object information in images plays a far more crucial role in downstream tasks than background information, some studies have proposed semantically structuring the bitstream to selectively transmit and reconstruct only the information required by these tasks. However, such methods structure the bitstream after encoding, meaning that the coding process still relies on the entire image, even though much of the encoded information will not be transmitted. This leads to redundant computations. Traditional image compression methods require a two-dimensional image as input, and even if the unimportant regions of the image are set to zero by applying a semantic mask, these regions still participate in subsequent computations as part of the image. To address such limitations, we propose an image compression method based on a position-indexed self-attention mechanism that encodes and decodes only the visible parts of the masked image. Compared to existing semantic-structured compression methods, our approach can significantly reduce computational costs.

图像压缩自注意力高效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。