提出新型量化方法,让隐式神经表示在硬件上更高效
Distribution-Aware Hadamard Quantization for Hardware-Efficient Implicit Neural Representations
- 用哈达玛变换统一不同层的权重和激活分布,再标准化量化
- 在图像重建任务中,延迟降32.7%,功耗降40.1%,资源用到仅1.7%
- 适合部署在FPGA等资源受限设备上的隐式神经表示应用
隐式神经表示(INRs)通过带有复杂激活函数的多层感知机编码离散信号。尽管性能优越,但依赖全精度计算,导致显著硬件开销。以往的量化方法主要针对权重,因缺乏激活量化,硬件节省有限。为充分挖掘量化优势,我们提出DHQ——一种分布感知的哈达玛量化方案,同时作用于权重与激活。分析表明,首尾层权重分布与中间层不同,最后一层激活也异于前序层。我们利用哈达玛变换将这些多样化分布转化为统一的钟形分布,经实证与理论支持后,再使用标准量化器。为验证实际效益,我们实现了基于FPGA的DHQ系统。在多样图像重建任务中,相比全精度模型,DHQ将延迟降低32.7%,能耗减少40.1%,资源占用最多下降98.3%。
原文摘要 · Abstract (English)
Implicit Neural Representations (INRs) encode discrete signals using Multi-Layer Perceptrons (MLPs) with complex activation functions. While INRs achieve superior performance, they depend on full-precision number representation for accurate computation, resulting in significant hardware overhead. Previous INR quantization approaches have primarily focused on weight quantization, offering only limited hardware savings due to the lack of activation quantization. To fully exploit the hardware benefits of quantization, we propose DHQ, a novel distribution-aware Hadamard quantization scheme that targets both weights and activations in INRs. Our analysis shows that the weights in the first and last layers have distributions distinct from those in the intermediate layers, while the activations in the last layer differ significantly from those in the preceding layers. Instead of customizing quantizers individually, we utilize the Hadamard transformation to standardize these diverse distributions into a unified bell-shaped form, supported by both empirical evidence and theoretical analysis, before applying a standard quantizer. To demonstrate the practical advantages of our approach, we present an FPGA implementation of DHQ that highlights its hardware efficiency. Experiments on diverse image reconstruction tasks show that DHQ outperforms previous quantization methods, reducing latency by 32.7\%, energy consumption by 40.1\%, and resource utilization by up to 98.3\% compared to full-precision counterparts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。