arXiv:2505.05413cs.LG2025-05被引 3

无需重训练,实现超低功耗硬件的高效高维计算压缩。

DPQ-HD: Post-Training Compression for Ultra-Low Power Hyperdimensional Computing

  • 通过分解-剪枝-量化三阶段压缩,不重训练即降低内存占用。
  • 图像与图分类任务中内存减少20-100倍,准确率仅降1-2%。
  • 适合资源受限设备,显著提升微控制器上的推理速度与能效。

高维计算(HDC)正成为边缘AI的有前景方案,兼顾精度与效率。然而现有HDC应用常依赖高精度模型和编码矩阵,带来巨大计算与内存负担,尤其对超低功耗设备不友好。尽管已有精度压缩与剪枝技术提升效率,但多数需重训练,成本高且不实用。为此,我们提出新型后训练压缩算法DPQ-HD,可端到端压缩整个HDC系统,在无需重训练前提下实现接近浮点性能。该方法通过独特组合分解、剪枝与量化三类技术,有效适配硬件约束,并引入能量高效的推理策略,逐步评估相似度(如余弦相似度)并支持提前退出,减少计算量,加速预测推理同时保持精度。实验表明,DPQ-HD在图像与图分类任务中内存消耗减少20-100倍,准确率仅下降1-2%;其性能优于现有后训练压缩方法,媲美甚至超过基于重训练的顶尖技术,整体优化时间缩短高达100倍,微控制器上推理速度最快提升56倍。

原文摘要 · Abstract (English)

Hyperdimensional Computing (HDC) is emerging as a promising approach for edge AI, offering a balance between accuracy and efficiency. However, current HDC-based applications often rely on high-precision models and/or encoding matrices to achieve competitive performance, which imposes significant computational and memory demands, especially for ultra-low power devices. While recent efforts use techniques like precision reduction and pruning to increase the efficiency, most require retraining to maintain performance, making them expensive and impractical. To address this issue, we propose a novel Post Training Compression algorithm, Decomposition-Pruning-Quantization (DPQ-HD), which aims at compressing the end-to-end HDC system, achieving near floating point performance without the need of retraining. DPQ-HD reduces computational and memory overhead by uniquely combining the above three compression techniques and efficiently adapts to hardware constraints. Additionally, we introduce an energy-efficient inference approach that progressively evaluates similarity scores such as cosine similarity and performs early exit to reduce the computation, accelerating prediction inference while maintaining accuracy. We demonstrate that DPQ-HD achieves up to 20-100x reduction in memory for image and graph classification tasks with only a 1-2% drop in accuracy compared to uncompressed workloads. Lastly, we show that DPQ-HD outperforms the existing post-training compression methods and performs better or at par with retraining-based state-of-the-art techniques, requiring significantly less overall optimization time (up to 100x) and faster inference (up to 56x) on a microcontroller

高维计算模型压缩低功耗后训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。