让深度学习图像压缩在FPGA上高效运行,精度损失小、计算量低。
A Multi-Stage Optimization Framework for Deploying Learned Image Compression on FPGAs
- 提出动态范围感知量化,解决浮点模型转整数时的精度下降问题。
- 通过混合精度搜索和通道剪枝,计算量降低20%以上,性能几乎不变。
- 适合想在FPGA上部署高质量图像压缩模型的研究者与工程师。
基于深度学习的图像压缩(LIC)虽在率失真(RD)性能上达到顶尖水平,但在资源受限的FPGA上部署仍面临挑战。本文提出一个完整的多阶段优化框架,将高性能浮点模型转化为高效、硬件友好的整数实现。首先,针对量化导致的性能退化,提出动态范围感知量化(DRAQ),结合统计校准的激活截断与新型权重正则化,有效缓解极端数据异常值和大动态范围的影响,成功构建高保真的8位整数模型。其次,在此坚实基础上,引入两项面向FPGA的硬件优化技术:一种渐进式混合精度搜索算法,利用FPGA灵活性为各层分配最优非均匀位宽,降低复杂度;同时,适配LIC中常见的广义除性归一化(GDN)层,提出一种通道剪枝方法,移除冗余通道以减少计算开销。实验表明,基础DRAQ方法将基于GDN的模型的BD-rate开销从30%降至6.3%。后续硬件优化进一步降低计算复杂度超20%,对RD性能影响极小,最终模型在效率上达当前最佳,质量也优于现有FPGA部署方案。
原文摘要 · Abstract (English)
Deep learning-based image compression (LIC) has achieved state-of-the-art rate-distortion (RD) performance, yet deploying these models on resource-constrained FPGAs remains a major challenge. This work presents a complete, multi-stage optimization framework to bridge the gap between high-performance floating-point models and efficient, hardware-friendly integer-based implementations. First, we address the fundamental problem of quantization-induced performance degradation. We propose a Dynamic Range-Aware Quantization (DRAQ) method that uses statistically-calibrated activation clipping and a novel weight regularization scheme to counteract the effects of extreme data outliers and large dynamic ranges, successfully creating a high-fidelity 8-bit integer model. Second, building on this robust foundation, we introduce two hardware-aware optimization techniques tailored for FPGAs. A progressive mixed-precision search algorithm exploits FPGA flexibility to assign optimal, non-uniform bit-widths to each layer, minimizing complexity while preserving performance. Concurrently, a channel pruning method, adapted to work with the Generalized Divisive Normalization (GDN) layers common in LIC, removes model redundancy by eliminating inactive channels. Our comprehensive experiments show that the foundational DRAQ method reduces the BD-rate overhead of a GDN-based model from $30\%$ to $6.3\%$. The subsequent hardware-aware optimizations further reduce computational complexity by over $20\%$ with negligible impact on RD performance, yielding a final model that is both state-of-the-art in efficiency and superior in quality to existing FPGA-based LIC implementations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。