arXiv:2508.09176cs.LGcs.AI2025-08AAAI被引 3

提出无需反量化即可动态调整精度的训练框架,显著提升模型效率。

DQT: Dynamic Quantization Training via Dequantization-Free Nested Integer Arithmetic

  • 用嵌套整数表示实现无反量化位宽切换
  • 4比特动态量化在ImageNet达77.00%准确率
  • 适合部署于资源受限设备的自适应AI系统

资源受限设备上的深度神经网络部署依赖量化技术。静态统一量化对所有输入使用固定比特数,无法适应其复杂度差异。动态实例级混合精度量化通过仅在需要时分配高精度,可实现更优的精度-效率权衡。然而,现有方法需经历耗时的反量化至浮点、再量化回整数过程以改变精度,破坏了纯整数硬件范式并削弱性能优势。本文提出动态量化训练(DQT)框架,消除该瓶颈。DQT核心为嵌套整数表示,低精度值在高位中按位嵌入。结合定制整数运算,可通过近乎零成本的位移操作实现即时比特宽度切换。这使DQT成为首个支持无反量化静态混合精度骨干网络与真正高效动态实例级量化的框架,由轻量控制器实时决定各层量化方式。我们在CIFAR-10上验证ResNet18,在ImageNet上验证ResNet50,结果表明:4比特动态ResNet50在相同比特操作预算下达到77.00%的top-1准确率,优于领先的静态(LSQ,76.70%)和动态(DQNET,76.94%)方法。关键的是,DQT仅需2830万次简单位移操作完成比特切换,相比先前动态方法所需的5660万次乘加浮点操作大幅降低开销,开启了高效自适应AI的新可能。

原文摘要 · Abstract (English)

The deployment of deep neural networks on resource-constrained devices relies on quantization. While static, uniform quantization applies a fixed bit-width to all inputs, it fails to adapt to their varying complexity. Dynamic, instance-based mixed-precision quantization promises a superior accuracy-efficiency trade-off by allocating higher precision only when needed. However, a critical bottleneck remains: existing methods require a costly dequantize-to-float and requantize-to-integer cycle to change precision, breaking the integer-only hardware paradigm and compromising performance gains. This paper introduces Dynamic Quantization Training (DQT), a novel framework that removes this bottleneck. At the core of DQT is a nested integer representation where lower-precision values are bit-wise embedded within higher-precision ones. This design, coupled with custom integer-only arithmetic, allows for on-the-fly bit-width switching through a near-zero-cost bit-shift operation. This makes DQT the first quantization framework to enable both dequantization-free static mixed-precision of the backbone network, and truly efficient dynamic, instance-based quantization through a lightweight controller that decides at runtime how to quantize each layer. We demonstrate DQT state-of-the-art performance on ResNet18 on CIFAR-10 and ResNet50 on ImageNet. On ImageNet, our 4-bit dynamic ResNet50 achieves 77.00% top-1 accuracy, an improvement over leading static (LSQ, 76.70%) and dynamic (DQNET, 76.94%) methods at a comparable BitOPs budget. Crucially, DQT achieves this with a bit-width transition cost of only 28.3M simple bit-shift operations, a drastic improvement over the 56.6M costly Multiply-Accumulate (MAC) floating-point operations required by previous dynamic approaches - unlocking a new frontier in efficient, adaptive AI.

量化动态精度嵌套整数高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。