Easz用Transformer实现轻量图像压缩,适合资源受限的物联网设备。
Easz: An Agile Transformer-based Image Compression Framework for Resource-constrained IoTs
- 将计算负担移至服务器,边缘端无需编码和模型切换
- 通过随机擦除图像块并由接收端重建,支持灵活压缩率
- 设计轻量化重构结构,显著降低接收端计算开销
神经图像压缩在机器间通信中不可或缺,但其复杂的编解码结构和难以灵活切换压缩等级的问题,使其难以部署于计算与存储资源有限的边缘设备。为此,本文提出一种基于Transformer的边缘无计算图像编码框架Easz。Easz将计算负载转移到服务器端,避免了边缘设备上的编码与模型切换开销。该方法采用基于条件均匀分布的采样器,对图像内容进行选择性像素擦除;接收端通过Transformer架构重建被擦除区域。为进一步降低接收端计算负担,我们引入轻量化Transformer重建结构。在真实测试平台上开展的大量评估表明,相较于现有方法,Easz在不同压缩等级下的适应性、计算效率及图像重建质量方面均具显著优势。
原文摘要 · Abstract (English)
Neural image compression, necessary in various machine-to-machine communication scenarios, suffers from its heavy encode-decode structures and inflexibility in switching between different compression levels. Consequently, it raises significant challenges in applying the neural image compression to edge devices that are developed for powerful servers with high computational and storage capacities. We take a step to solve the challenges by proposing a new transformer-based edge-compute-free image coding framework called Easz. Easz shifts the computational overhead to the server, and hence avoids the heavy encoding and model switching overhead on the edge. Easz utilizes a patch-erase algorithm to selectively remove image contents using a conditional uniform-based sampler. The erased pixels are reconstructed on the receiver side through a transformer-based framework. To further reduce the computational overhead on the receiver, we then introduce a lightweight transformer-based reconstruction structure to reduce the reconstruction load on the receiver side. Extensive evaluations conducted on a real-world testbed demonstrate multiple advantages of Easz over existing compression approaches, in terms of adaptability to different compression levels, computational efficiency, and image reconstruction quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。