用LDPC码直接编码图像,让模型无需解码就能分类,更快更省算力。
Goal-Oriented Source Coding using LDPC Codes for Compressed-Domain Image Classification
- 用LDPC码替代传统编码,保留数据结构便于直接学习
- 在MNIST等数据集上分类精度更高,模型规模小一半以上
- 适合需要低延迟、轻量级推理的边缘智能场景
在目标导向通信领域,研究重点已从数据重建转向直接在接收的编码数据上执行特定学习任务,如分类、分割或模式识别。在压缩图像分类的常见场景中,关键目标是实现对熵编码数据的直接学习,从而跳过计算开销大的数据重建步骤。传统熵编码方法如哈夫曼和算术编码虽能高效压缩,但破坏数据结构,不利于直接学习。本文探索使用原本用于信道编码的低密度奇偶校验(LDPC)码作为替代熵编码方案。由于其结构化特性,可被深度学习模型更有效地利用。在接收端,使用门控循环单元(GRU)模型对LDPC编码数据直接进行图像分类。在MNIST、Fashion-MNIST和CIFAR数据集上的实验表明,LDPC码在分类任务中优于哈夫曼与算术编码,且所需学习模型显著更小。此外,论文分析了为何LDPC码比传统熵编码更有效保持数据结构,并研究了关键码参数对分类性能的影响。结果表明,基于LDPC的熵编码在学习效率与模型复杂度间实现了最优平衡,无需预先解码即可完成任务。
原文摘要 · Abstract (English)
In the emerging field of goal-oriented communications, the focus has shifted from reconstructing data to directly performing specific learning tasks, such as classification, segmentation, or pattern recognition, on the received coded data. In the commonly studied scenario of classification from compressed images, a key objective is to enable learning directly on entropy-coded data, thereby bypassing the computationally intensive step of data reconstruction. Conventional entropy-coding methods, such as Huffman and Arithmetic coding, are effective for compression but disrupt the data structure, making them less suitable for direct learning without decoding. This paper investigates the use of low-density parity-check (LDPC) codes -- originally designed for channel coding -- as an alternative entropy-coding approach. It is hypothesized that the structured nature of LDPC codes can be leveraged more effectively by deep learning models for tasks like classification. At the receiver side, gated recurrent unit (GRU) models are trained to perform image classification directly on LDPC-coded data. Experiments on datasets like MNIST, Fashion-MNIST, and CIFAR show that LDPC codes outperform Huffman and Arithmetic coding in classification tasks, while requiring significantly smaller learning models. Furthermore, the paper analyzes why LDPC codes preserve data structure more effectively than traditional entropy-coding techniques and explores the impact of key code parameters on classification performance. These results suggest that LDPC-based entropy coding offers an optimal balance between learning efficiency and model complexity, eliminating the need for prior decoding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。