arXiv:2511.11664cs.DCcs.AI2025-11被引 1

用rANS压缩中间特征,让边缘计算通信更省带宽。

Range Asymmetric Numeral Systems-Based Lightweight Intermediate Feature Compression for Split Computing of Deep Neural Networks

  • 用非对称整数量化+稀疏张量,无需概率建模
  • 跨多种模型保持近原始精度,压缩率显著提升
  • 适合边缘设备与云协同部署的高效推理场景

分割计算将深度神经网络推理分布在资源受限的边缘设备与云服务器之间,但在传输中间特征时面临严重的通信瓶颈。为此,本文提出一种基于范围非对称数值系统(rANS)的轻量级压缩框架,结合非对称整数量化与稀疏张量表示,大幅降低传输开销。具体而言,该方法融合非对称整数量化与稀疏表示技术,避免了复杂的概率建模或网络修改。主要贡献包括:(1) 一种无需依赖数据分布的压缩流水线,利用张量固有稀疏性实现带宽缩减且计算开销极低;(2) 一个近似理论模型,用于优化张量重塑维度以最大化压缩效率;(3) 基于GPU加速的实现,编码/解码延迟低于亚毫秒。在多种神经网络架构(ResNet、VGG16、MobileNetV2、SwinT、DenseNet121、EfficientNetB0)上进行的大量评估表明,该框架在CIFAR100和ImageNet基准测试中始终维持近原始精度。此外,通过在标准基准MMLU、HellaSwag、ARC、PIQA、Winogrande、BoolQ、OpenBookQA上使用Llama2 7B和13B模型验证,证明其在自然语言处理任务中同样有效,具备跨模态广泛适用性。该方法解决了在带宽受限环境下部署复杂AI系统的核心瓶颈,且不牺牲模型性能。

原文摘要 · Abstract (English)

Split computing distributes deep neural network inference between resource-constrained edge devices and cloud servers but faces significant communication bottlenecks when transmitting intermediate features. To this end, in this paper, we propose a novel lightweight compression framework that leverages Range Asymmetric Numeral Systems (rANS) encoding with asymmetric integer quantization and sparse tensor representation to reduce transmission overhead dramatically. Specifically, our approach combines asymmetric integer quantization with a sparse representation technique, eliminating the need for complex probability modeling or network modifications. The key contributions include: (1) a distribution-agnostic compression pipeline that exploits inherent tensor sparsity to achieve bandwidth reduction with minimal computational overhead; (2) an approximate theoretical model that optimizes tensor reshaping dimensions to maximize compression efficiency; and (3) a GPU-accelerated implementation with sub-millisecond encoding/decoding latency. Extensive evaluations across diverse neural architectures (ResNet, VGG16, MobileNetV2, SwinT, DenseNet121, EfficientNetB0) demonstrate that the proposed framework consistently maintains near-baseline accuracy across CIFAR100 and ImageNet benchmarks. Moreover, we validated the framework's effectiveness on advanced natural language processing tasks by employing Llama2 7B and 13B on standard benchmarks such as MMLU, HellaSwag, ARC, PIQA, Winogrande, BoolQ, and OpenBookQA, demonstrating its broad applicability beyond computer vision. Furthermore, this method addresses a fundamental bottleneck in deploying sophisticated artificial intelligence systems in bandwidth-constrained environments without compromising model performance.

边缘计算特征压缩rANS模型分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。