arXiv:2603.19344cs.LGcs.AI2026-03

用可学习的非线性聚合替代加权求和,让神经元更抗噪声。

Beyond Weighted Summation: Learnable Nonlinear Aggregation Functions for Robust Artificial Neurons

  • 设计可学习的非线性聚合函数,取代传统加权求和。
  • 在含噪数据上,鲁棒性评分提升至0.991(基准0.890)。
  • 适合追求模型抗干扰能力的研究者与工程师。

加权求和是人工神经元自早期网络以来的默认输入聚合方式。尽管计算高效,但其隐含均值估计行为对噪声或极端输入敏感。本文探讨用可学习的非线性聚合替代固定线性聚合是否能提升神经网络鲁棒性而不损失可训练性。提出两种可微聚合机制:基于可学习幂权重规则的F-Mean神经元,以及基于距离感知亲和度加权的高斯支持神经元。为保持标准神经元的优化稳定性,引入通过可学习混合参数介于线性与非线性聚合之间的混合神经元。在多层感知机与卷积神经网络上,于CIFAR-10及添加高斯噪声的变体上评估,混合神经元在噪声下持续提升鲁棒性;F-Mean混合神经元在干净数据上也取得小幅提升。三路混合神经元在噪声下的鲁棒性评分最高达0.991,显著优于基准的0.890。学习参数稳定收敛至次线性聚合(p ≈ 0.43–0.50)和高新颖性利用率(α ≈ 0.69–0.79)。结果表明,神经元级聚合是构建更抗噪网络的重要且未充分探索的设计维度。

原文摘要 · Abstract (English)

Weighted summation has remained the default input aggregation mechanism in artificial neurons since the earliest neural network models. While computationally efficient, this design implicitly behaves like a mean-based estimator and is therefore sensitive to noisy or extreme inputs. This paper investigates whether replacing fixed linear aggregation with learnable nonlinear alternatives can improve neural network robustness without sacrificing trainability. Two differentiable aggregation mechanisms are introduced: an F-Mean neuron based on a learnable power-weighted aggregation rule, and a Gaussian Support neuron based on distance-aware affinity weighting. To preserve the optimisation stability of standard neurons, hybrid neurons are proposed that interpolate between linear and nonlinear aggregation through a learnable blending parameter. Evaluated in multilayer perceptrons and convolutional neural networks on CIFAR-10 and a noisy CIFAR-10 variant with additive Gaussian corruption, hybrid neurons consistently improve robustness under noise while F-Mean hybrids also yield modest gains on clean data. The three-way hybrid achieves robustness scores of up to 0.991 compared to 0.890 for the standard baseline, and learned parameters converge consistently to sub-linear aggregation (p $\approx$ 0.43--0.50) and high novelty utilisation ($α$ $\approx$ 0.69--0.79). These findings suggest that neuron-level aggregation is a meaningful and underexplored design dimension for building more noise-tolerant neural networks.

神经元设计抗噪性非线性聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。