arXiv:2604.12079cs.ETcs.LG2026-04中稿 · Great Lakes Sympos…被引 5

用脑启发表示提升硬件非理想下的推理与学习鲁棒性

Robust Reasoning and Learning with Brain-Inspired Representations under Hardware-Induced Nonlinearities

  • 基于超维度计算优化编码,补偿存内计算的非线性失真
  • 在严重硬件扰动下,量化超维模型准确率提升至84%,比原方法高48%
  • 适用于需要精确变量绑定的图结构推理,显著提升可解释性

传统机器学习依赖高精度算术和理想硬件,但先进半导体器件的变异性正构成挑战。存内计算(CIM)架构虽缓解数据搬运瓶颈并提升能效,却引入非线性失真与可靠性问题。本文提出一种面向硬件的超维度计算(HDC)优化框架,系统性补偿CIM中的非理想相似性计算。通过将编码建模为理想核与硬件受限版本间弗罗贝尼乌斯范数最小化的优化问题,并采用联合优化策略实现超向量表示的端到端校准。实验表明,该方法应用于QuantHD时,在严重硬件扰动下达到84%准确率,较朴素QuantHD提升48%。同时,该优化对依赖精确变量绑定的图基HDC至关重要,在Cora数据集上使RelHD保持原有精度,相比朴素RelHD提升5.4倍。本方案有效保留了HDC的鲁棒性与符号属性,推动面向新兴CIM硬件的可扩展、低功耗智能系统发展。

原文摘要 · Abstract (English)

Traditional machine learning depends on high-precision arithmetic and near-ideal hardware assumptions, which is increasingly challenged by variability in aggressively scaled semiconductor devices. Compute-in-memory (CIM) architectures alleviate data-movement bottlenecks and improve energy efficiency yet introduce nonlinear distortions and reliability concerns. We address these issues with a hardware-aware optimization framework based on Hyperdimensional Computing (HDC), systematically compensating for non-ideal similarity computations in CIM. Our approach formulates encoding as an optimization problem, minimizing the Frobenius norm between an ideal kernel and its hardware-constrained counterpart, and employs a joint optimization strategy for end-to-end calibration of hypervector representations. Experimental results demonstrate that our method when applied to QuantHD achieves 84\% accuracy under severe hardware-induced perturbations, a 48\% increase over naive QuantHD under the same conditions. Additionally, our optimization is vital for graph-based HDC reliant on precise variable-binding for interpretable reasoning. Our framework preserves the accuracy of RelHD on the Cora dataset, achieving a 5.4$\times$ accuracy improvement over naive RelHD under nonlinear environments. By preserving HDC's robustness and symbolic properties, our solution enables scalable, energy-efficient intelligent systems capable of classification and reasoning on emerging CIM hardware.

超维度计算存内计算鲁棒推理硬件感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。