用脉冲神经元让图神经网络更省电,适合材料性能预测。
Hybrid variable spiking graph neural networks for energy-efficient scientific machine learning
- 引入可变脉冲神经元,实现稀疏事件驱动计算
- 在材料力学性质预测任务中达到与传统GNN相当的精度
- 显著降低能耗,适合边缘计算等低功耗场景
针对计算力学数据集(如不规则域或材料微观/介观结构)的图表示,在处理复杂图结构和深层网络时,传统图神经网络(GNNs)能耗过高,难以应用于边缘计算。本文提出混合可变脉冲图神经网络(HVS-GNNs),在架构中引入可变脉冲神经元(VSNs),实现稀疏通信与事件驱动计算,从而大幅降低能量消耗。该方法在三个基于微/介观结构预测材料力学性能的回归任务中验证,性能优于标准GNN及采用漏积分-放电神经元的GNN。结果表明,HVS-GNNs在保持高精度的同时显著提升能效,适用于能源敏感型计算场景。
原文摘要 · Abstract (English)
Graph-based representations for samples of computational mechanics-related datasets can prove instrumental when dealing with problems like irregular domains or molecular structures of materials, etc. To effectively analyze and process such datasets, deep learning offers Graph Neural Networks (GNNs) that utilize techniques like message-passing within their architecture. The issue, however, is that as the individual graph scales and/ or GNN architecture becomes increasingly complex, the increased energy budget of the overall deep learning model makes it unsustainable and restricts its applications in applications like edge computing. To overcome this, we propose in this paper Hybrid Variable Spiking Graph Neural Networks (HVS-GNNs) that utilize Variable Spiking Neurons (VSNs) within their architecture to promote sparse communication and hence reduce the overall energy budget. VSNs, while promoting sparse event-driven computations, also perform well for regression tasks, which are often encountered in computational mechanics applications and are the main target of this paper. Three examples dealing with prediction of mechanical properties of material based on microscale/ mesoscale structures are shown to test the performance of the proposed HVS-GNNs in regression tasks. We have also compared the performance of HVS-GNN architectures with the performance of vanilla GNNs and GNNs utilizing leaky integrate and fire neurons. The results produced show that HVS-GNNs perform well for regression tasks, all while promoting sparse communication and, hence, energy efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。