提出一种低复杂度神经元,高效处理时序预测任务。
Memory-DD: A Low-Complexity Dendrite-Inspired Neuron for Temporal Prediction Tasks
- 双树突神经元组无非线性激活,却能实现非线性映射。
- 18个分类数据集平均准确率89.41%,比LSTM高4.25%。
- 参数减半、计算量降27.7%,适合实时时序应用。
树突启发的神经元在图像分类等静态任务中因计算复杂度低、推理速度快而广泛应用。然而,现有模型多针对静态数据,对动态特征捕捉和长期依赖建模研究不足,缺乏专用于时序预测的高效架构。本文提出Memory-DD,一种低复杂度树突启发神经元模型。该模型由两个无非线性激活函数的树突神经元组构成,仍可实现非线性映射。仅需两组神经元即可提取输入序列中特征间的逻辑关系,有效捕捉时序依赖,适用于序列分类与回归任务。实验表明,在18个时序分类基准数据集上平均准确率达89.41%,优于LSTM 4.25%;在9个时序回归数据集上性能接近LSTM,参数量仅为一半,计算量(FLOPs)降低27.7%。结果证明,Memory-DD成功将树突神经元的低复杂度优势拓展至时序预测,为时间序列处理提供高效解决方案。
原文摘要 · Abstract (English)
Dendrite-inspired neurons have been widely used in tasks such as image classification due to low computational complexity and fast inference speed. Temporal data prediction, as a key machine learning task, plays a key role in real-time scenarios such as sensor data analysis, financial forecasting, and urban traffic management. However, existing dendrite-inspired neurons are mainly designed for static data. Studies on capturing dynamic features and modeling long-term dependencies in temporal sequences remain limited. Efficient architectures specifically designed for temporal sequence prediction are still lacking. In this paper, we propose Memory-DD, a low-complexity dendrite-inspired neuron model. Memory-DD consists of two dendrite-inspired neuron groups that contain no nonlinear activation functions but can still realize nonlinear mappings. Compared with traditional neurons without dendritic functions, Memory-DD requires only two neuron groups to extract logical relationships between features in input sequences. This design effectively captures temporal dependencies and is suitable for both classification and regression tasks on sequence data. Experimental results show that Memory-DD achieves an average accuracy of 89.41% on 18 temporal classification benchmark datasets, outperforming LSTM by 4.25%. On 9 temporal regression datasets, it reaches comparable performance to LSTM, while using only 50% of the parameters and reducing computational complexity (FLOPs) by 27.7%. These results demonstrate that Memory-DD successfully extends the low-complexity advantages of dendrite-inspired neurons to temporal prediction, providing a low-complexity and efficient solution for time-series data processing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。