arXiv:2506.22871cs.LGcs.MM2025-06

用低精度模型加更新差分,实现更高效的模型传输。

P$^2$U: Progressive Precision Update For Efficient Model Distribution

  • 先传低精度模型,再传与原模型的差异值,减少传输量。
  • 在100万以上参数的大模型上仍保持高精度,带宽降低4倍以上。
  • 适合边缘计算、物联网等资源受限场景,可与其他压缩技术配合使用。

在带宽受限环境下,高效模型分发变得日益重要。本文提出一种简单而有效的方法——渐进精度更新(P²U),通过传输低比特精度模型及其与原始高精度模型的差分更新,而非直接发送原始模型。我们在多种模型架构上进行了广泛实验,涵盖从100万到超过1000万参数的小型与大型模型,并使用胸片X光、PASCAL-VOC和CIFAR-100三个数据集验证。结果表明,P²U在准确率、带宽使用和延迟之间实现了更优平衡。尤其当带宽或启动时间优先时,可采用激进量化(如4比特)而几乎不损失性能。该方法为联邦学习、边缘计算及物联网部署中的可扩展高效模型分发提供了实用方案。由于P²U可与稀疏化、量化、剪枝等现有压缩技术协同使用,进一步提升空间巨大。

原文摘要 · Abstract (English)

Efficient model distribution is becoming increasingly critical in bandwidth-constrained environments. In this paper, we propose a simple yet effective approach called Progressive Precision Update (P$^2$U) to address this problem. Instead of transmitting the original high-precision model, P$^2$U transmits a lower-bit precision model, coupled with a model update representing the difference between the original high-precision model and the transmitted low precision version. With extensive experiments on various model architectures, ranging from small models ($1 - 6$ million parameters) to a large model (more than $100$ million parameters) and using three different data sets, e.g., chest X-Ray, PASCAL-VOC, and CIFAR-100, we demonstrate that P$^2$U consistently achieves better tradeoff between accuracy, bandwidth usage and latency. Moreover, we show that when bandwidth or startup time is the priority, aggressive quantization (e.g., 4-bit) can be used without severely compromising performance. These results establish P$^2$U as an effective and practical solution for scalable and efficient model distribution in low-resource settings, including federated learning, edge computing, and IoT deployments. Given that P$^2$U complements existing compression techniques and can be implemented alongside any compression method, e.g., sparsification, quantization, pruning, etc., the potential for improvement is even greater.

模型压缩边缘计算量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。