arXiv:2409.13153cs.ARcs.AI2024-09被引 30

分析神经符号AI的计算特性,发现现有硬件效率低,提出优化方案。

Towards Efficient Neuro-Symbolic AI: From Workload Characterization to Hardware Architecture

  • 分类并实测神经符号算法在多种硬件上的性能表现
  • 揭示向量符号运算导致内存瓶颈与可扩展性差
  • 为向量符号架构设计硬件加速方案,提升效率

深度神经网络驱动的人工智能正面临计算不可持续、鲁棒性不足和缺乏可解释性的挑战。神经符号AI作为下一代认知系统的有前景范式,融合神经与符号方法,在提升可解释性、鲁棒性和信任度的同时,支持少样本学习。本文系统分类神经符号算法,并在CPU、GPU和边缘SoC上实测其运行时间、内存占用、计算操作、稀疏性及系统特性。研究发现,现有硬件难以高效支撑神经符号模型,主要因向量符号与逻辑运算的内存密集型特性、复杂控制流、数据依赖、稀疏性波动及可扩展性受限。基于剖析结果,提出跨层优化策略,并针对向量符号架构开展硬件加速案例研究,以提升神经符号计算的性能、能效与可扩展性。最后从系统与架构角度讨论未来挑战与方向。

原文摘要 · Abstract (English)

The remarkable advancements in artificial intelligence (AI), primarily driven by deep neural networks, are facing challenges surrounding unsustainable computational trajectories, limited robustness, and a lack of explainability. To develop next-generation cognitive AI systems, neuro-symbolic AI emerges as a promising paradigm, fusing neural and symbolic approaches to enhance interpretability, robustness, and trustworthiness, while facilitating learning from much less data. Recent neuro-symbolic systems have demonstrated great potential in collaborative human-AI scenarios with reasoning and cognitive capabilities. In this paper, we aim to understand the workload characteristics and potential architectures for neuro-symbolic AI. We first systematically categorize neuro-symbolic AI algorithms, and then experimentally evaluate and analyze them in terms of runtime, memory, computational operators, sparsity, and system characteristics on CPUs, GPUs, and edge SoCs. Our studies reveal that neuro-symbolic models suffer from inefficiencies on off-the-shelf hardware, due to the memory-bound nature of vector-symbolic and logical operations, complex flow control, data dependencies, sparsity variations, and limited scalability. Based on profiling insights, we suggest cross-layer optimization solutions and present a hardware acceleration case study for vector-symbolic architecture to improve the performance, efficiency, and scalability of neuro-symbolic computing. Finally, we discuss the challenges and potential future directions of neuro-symbolic AI from both system and architectural perspectives.

神经符号硬件加速系统优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。