arXiv:2410.23351cs.LG2024-10被引 5

用随机异构混沌神经元模拟大脑特性,提升分类性能。

Random Heterogeneous Neurochaos Learning Architecture for Data Classification

  • 在输入层随机部署不同混沌神经元,模仿大脑的随机与异质性。
  • 在多个公开数据集上达到最高F1分数,如红酒数据集1.0、手写签名认证0.99。
  • 尤其在小样本训练时表现优异,适合对鲁棒性要求高的场景。

受人脑结构与功能启发,人工神经网络(ANN)被用于数据分类。然而现有神经网络,包括深度神经网络,未能充分模拟大脑的丰富结构,缺乏随机性与神经元异质性,而这些是大脑放电行为中固有的混沌特征。神经混沌学习(NL)是一种基于混沌的神经网络,最近采用一维混沌映射(如广义吕罗思级数和逻辑斯蒂映射)作为神经元。首次提出一种随机异构扩展的神经混沌学习(RHNL),将多种混沌神经元随机分布于输入层,以模拟人脑网络的随机性和异质性。评估了新提出的RHNL架构与传统机器学习方法结合的性能。在多个公开数据集上,RHNL在几乎所有分类任务中均优于同质NL和固定异质NL。在红酒数据集(F1=1.0)、银行票据认证数据集(F1=0.99)、威斯康星州乳腺癌数据集(F1=0.99)和自由语音数字数据集(FSDD,F1=0.98)上取得顶尖表现。在图像数据集上,其性能也优于独立的机器学习分类器,在低训练样本条件下,是独立机器学习方法中的最佳。该架构弥合了现有ANN与人脑混沌、随机、异质特性的差距。未来有望发展出一系列围绕随机异构神经混沌学习的新算法。

原文摘要 · Abstract (English)

Inspired by the human brain's structure and function, Artificial Neural Networks (ANN) were developed for data classification. However, existing Neural Networks, including Deep Neural Networks, do not mimic the brain's rich structure. They lack key features such as randomness and neuron heterogeneity, which are inherently chaotic in their firing behavior. Neurochaos Learning (NL), a chaos-based neural network, recently employed one-dimensional chaotic maps like Generalized Lüroth Series (GLS) and Logistic map as neurons. For the first time, we propose a random heterogeneous extension of NL, where various chaotic neurons are randomly placed in the input layer, mimicking the randomness and heterogeneous nature of human brain networks. We evaluated the performance of the newly proposed Random Heterogeneous Neurochaos Learning (RHNL) architectures combined with traditional Machine Learning (ML) methods. On public datasets, RHNL outperformed both homogeneous NL and fixed heterogeneous NL architectures in nearly all classification tasks. RHNL achieved high F1 scores on the Wine dataset (1.0), Bank Note Authentication dataset (0.99), Breast Cancer Wisconsin dataset (0.99), and Free Spoken Digit Dataset (FSDD) (0.98). These RHNL results are among the best in the literature for these datasets. We investigated RHNL performance on image datasets, where it outperformed stand-alone ML classifiers. In low training sample regimes, RHNL was the best among stand-alone ML. Our architecture bridges the gap between existing ANN architectures and the human brain's chaotic, random, and heterogeneous properties. We foresee the development of several novel learning algorithms centered around Random Heterogeneous Neurochaos Learning in the coming days.

混沌神经网络分类性能小样本学习随机异构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。