arXiv:2503.10912cs.CVcs.AI2025-03

提出兼顾人眼与机器识别的JPEG兼容压缩方法,显著提升模型准确率。

JPEG Compliant Compression for Both Human and Machine, A Report

  • 构建人机并重的多目标优化框架,设计新型误差度量HMOE
  • 在0.61比特/像素下,模型准确率提升超0.81%,压缩率降低9.6倍
  • 完全兼容JPEG格式,适合部署于兼顾视觉与智能分析的场景

深度神经网络(DNN)已成为日常视觉应用的核心,但传统针对人眼视觉系统(HVS)设计的有损图像压缩算法会显著损害DNN的验证准确率。为此,本文将图像压缩建模为兼顾人眼与机器双视角的多目标优化问题,通过线性组合求解,并提出一种面向人与机器的新型误差度量——人机导向误差(HMOE)。基于HMOE,我们进一步设计了人机导向软决策量化(HMOSDQ)算法,实现符合JPEG标准的有损图像压缩。实验在ImageNet验证集两个子集(短边496-512和376-384)上评估了Alexnet与VGG-16两种预训练模型性能。结果表明,相比默认JPEG算法,HMOSDQ在率-准确率与率-失真性能上均更优:在0.61比特/像素时,可使Alexnet准确率提升超过0.81%;或在保持相同准确率前提下,将压缩率降低9.6倍。

原文摘要 · Abstract (English)

Deep Neural Networks (DNNs) have become an integral part of our daily lives, especially in vision-related applications. However, the conventional lossy image compression algorithms are primarily designed for the Human Vision System (HVS), which can non-trivially compromise the DNNs' validation accuracy after compression, as noted in \cite{liu2018deepn}. Thus developing an image compression algorithm for both human and machine (DNNs) is on the horizon. To address the challenge mentioned above, in this paper, we first formulate the image compression as a multi-objective optimization problem which take both human and machine prespectives into account, then we solve it by linear combination, and proposed a novel distortion measure for both human and machine, dubbed Human and Machine-Oriented Error (HMOE). After that, we develop Human And Machine Oriented Soft Decision Quantization (HMOSDQ) based on HMOE, a lossy image compression algorithm for both human and machine (DNNs), and fully complied with JPEG format. In order to evaluate the performance of HMOSDQ, finally we conduct the experiments for two pre-trained well-known DNN-based image classifiers named Alexnet \cite{Alexnet} and VGG-16 \cite{simonyan2014VGG} on two subsets of the ImageNet \cite{deng2009imagenet} validation set: one subset included images with shorter side in the range of 496 to 512, while the other included images with shorter side in the range of 376 to 384. Our results demonstrate that HMOSDQ outperforms the default JPEG algorithm in terms of rate-accuracy and rate-distortion performance. For the Alexnet comparing with the default JPEG algorithm, HMOSDQ can improve the validation accuracy by more than $0.81\%$ at $0.61$ BPP, or equivalently reduce the compression rate of default JPEG by $9.6\times$ while maintaining the same validation accuracy.

图像压缩深度学习JPEG多目标优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。