arXiv:2512.18200eess.IVcs.CV2025-12被引 2

用扩散模型压缩图像,专为机器视觉优化,省带宽还提精度。

SLIM: Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion

  • 基于预训练扩散模型,只压缩图像中机器关注区域。
  • 相同码率下,图像分类准确率显著高于传统方法。
  • 无需人工标注掩码,自动聚焦关键区域,适合部署于边缘设备。

近年来,面向机器视觉的图像压缩需求急剧增长。然而,现有压缩框架仍以人类视觉为主,保留过多感知细节,限制了在机器任务中降低每像素比特数的潜力。本文提出一种基于扩散模型的机器专用低比特率图像压缩方法——SLIM。该方法利用预训练的潜在扩散模型,仅对图像隐空间中的感兴趣区域(RoI)进行紧凑压缩;随后通过预训练的Unet模型,结合包含图像语义信息的文本描述,对解压后的隐空间进行增强。因此,SLIM能在推理阶段无需任何引导掩码的情况下,聚焦图像的关键区域实现低码率压缩。同时,通过去噪步骤增强隐空间,最终重建图像既优化了机器视觉任务表现,又保留了供人眼观看的感知细节。实验表明,在相同比特率条件下,SLIM的分类准确率显著优于传统机器视觉图像压缩模型。

原文摘要 · Abstract (English)

In recent years, the demand of image compression models for machine vision has increased dramatically. However, the training frameworks of image compression still focus on the vision of human, maintaining the excessive perceptual details, thus have limitations in optimally reducing the bits per pixel in the case of performing machine vision tasks. In this paper, we propose Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion, termed SLIM. This is a new effective training framework of image compression for machine vision, using a pretrained latent diffusion model.The compressor model of our method focuses only on the Region-of-Interest (RoI) areas for machine vision in the image latent, to compress it compactly. Then the pretrained Unet model enhances the decompressed latent, utilizing a RoI-focused text caption which containing semantic information of the image. Therefore, SLIM is able to focus on RoI areas of the image without any guide mask at the inference stage, achieving low bitrate when compressing. And SLIM is also able to enhance a decompressed latent by denoising steps, so the final reconstructed image from the enhanced latent can be optimized for the machine vision task while still containing perceptual details for human vision. Experimental results show that SLIM achieves a higher classification accuracy in the same bits per pixel condition, compared to conventional image compression models for machines.

图像压缩扩散模型机器视觉低比特率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。