通过多尺度时间稳态提升神经网络的鲁棒性与效率
Multi-Scale Temporal Homeostasis Enables Efficient and Robust Neural Networks
- 引入跨时间尺度的稳态调节机制,整合5毫秒到1小时的多级反馈
- 在分子、图和图像分类任务中显著提升准确率并消除灾难性失效
- 适合追求高鲁棒性与生物合理性的人工智能系统设计者
人工神经网络在基准任务上表现强劲,但在扰动下仍显脆弱,限制了其在真实场景中的应用。相比之下,生物神经系统通过跨多时间尺度的稳态调节,在数十年内保持可靠功能。受此启发,本文提出多尺度时间稳态(MSTH),将超快(5毫秒)、快速(2秒)、中等(5分钟)和慢速(1小时)调节机制整合进人工网络。MSTH构建了人工神经网络的跨尺度协调系统,形成统一的时间层次结构,超越表面的生物模仿。该机制通过进化优化的策略提升计算效率。在分子、图和图像分类基准上的实验表明,MSTH consistently 提升准确率,消除灾难性失败,并增强对扰动的恢复能力。此外,MSTH优于单尺度生物启发模型及现有先进方法,在多种领域展现泛化能力。这些结果确立跨尺度时间协调是稳定人工神经系统的根本原则,使MSTH成为构建稳健、弹性且生物可信智能的基础。
原文摘要 · Abstract (English)
Artificial neural networks achieve strong performance on benchmark tasks but remain fundamentally brittle under perturbations, limiting their deployment in real-world settings. In contrast, biological nervous systems sustain reliable function across decades through homeostatic regulation coordinated across multiple temporal scales. Inspired by this principle, this presents Multi-Scale Temporal Homeostasis (MSTH), a biologically grounded framework that integrates ultra-fast (5-ms), fast (2-s), medium (5-min) and slow (1-hrs) regulation into artificial networks. MSTH implements the cross-scale coordination system for artificial neural networks, providing a unified temporal hierarchy that moves beyond superficial biomimicry. The cross-scale coordination enhances computational efficiency through evolutionary-refined optimization mechanisms. Experiments across molecular, graph and image classification benchmarks show that MSTH consistently improves accuracy, eliminates catastrophic failures and enhances recovery from perturbations. Moreover, MSTH outperforms both single-scale bio-inspired models and established state-of-the-art methods, demonstrating generality across diverse domains. These findings establish cross-scale temporal coordination as a core principle for stabilizing artificial neural systems, positioning MSTH as a foundation for building robust, resilient and biologically faithful intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。