arXiv:2504.21814cs.CV2025-04ICCV被引 2

用GPT-4o生成图像替代传统压缩,仅传文本就能还原细节。

Why Compress What You Can Generate? When GPT-4o Generation Ushers in Image Compression Fields

  • 用结构化扫描提示将图像转为文本,实现无像素压缩
  • 在极低码率下还原效果优于最新生成式压缩方法
  • 适合对压缩效率与生成质量有极致要求的场景

AIGC基础模型的快速发展重塑了图像压缩范式,推动我们思考:若生成模型足够强大,为何还要压缩?近期OpenAI的GPT-4o已实现出色的跨模态生成、编辑与设计能力,促使我们探索其在图像压缩中的潜力。本文研究两种典型压缩范式:文本编码与多模态编码(文本+极低分辨率图像),所有/大部分像素信息均由GPT-4o生成,而非通过传统变换与编码。核心挑战在于解码过程中保持语义与结构一致性。为此,我们提出一种结构栅格扫描提示工程机制,将图像转换为文本空间并作为GPT-4o生成条件。大量实验表明,该结构提示与GPT-4o生成函数结合,在超低码率下表现显著优于当前主流多模态/生成式图像压缩方法,进一步验证了AIGC生成在图像压缩领域的巨大潜力。

原文摘要 · Abstract (English)

The rapid development of AIGC foundation models has revolutionized the paradigm of image compression, which paves the way for the abandonment of most pixel-level transform and coding, compelling us to ask: why compress what you can generate if the AIGC foundation model is powerful enough to faithfully generate intricate structure and fine-grained details from nothing more than some compact descriptors, i.e., texts, or cues. Fortunately, recent GPT-4o image generation of OpenAI has achieved impressive cross-modality generation, editing, and design capabilities, which motivates us to answer the above question by exploring its potential in image compression fields. In this work, we investigate two typical compression paradigms: textual coding and multimodal coding (i.e., text + extremely low-resolution image), where all/most pixel-level information is generated instead of compressing via the advanced GPT-4o image generation function. The essential challenge lies in how to maintain semantic and structure consistency during the decoding process. To overcome this, we propose a structure raster-scan prompt engineering mechanism to transform the image into textual space, which is compressed as the condition of GPT-4o image generation. Extensive experiments have shown that the combination of our designed structural raster-scan prompts and GPT-4o's image generation function achieved the impressive performance compared with recent multimodal/generative image compression at ultra-low bitrate, further indicating the potential of AIGC generation in image compression fields.

图像压缩生成模型GPT-4o文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。