arXiv:2511.16550cs.LG2025-11

提出新型随机网络框架,解决参数敏感导致的逼近不稳问题

Broad stochastic configuration residual learning system for norm-convergent universal approximation

  • 设计自适应约束机制,动态调节随机参数范围
  • 理论证明满足更强的范数收敛,提升逼近稳定性
  • 在光伏板积尘检测中优于13种主流算法

通用逼近是神经网络学习算法的基础。然而,部分网络仅通过迭代误差在概率测度下收敛来证明通用逼近性,而非更严格的范数收敛,导致随机学习网络对随机参数选择高度敏感。广义残差学习系统(BRLS)作为随机学习模型的一员也面临此问题。我们理论证明其通用逼近性存在局限:若随机参数选择不当且收敛速率满足特定条件,迭代误差不满足范数收敛。为此,提出广义随机配置残差学习系统(BSCRLS)算法,基于BRLS框架引入新颖监督机制,自适应约束随机参数范围。进一步证明了BSCRLS在更强范数收敛意义下的通用逼近定理。提出了三种增量式BSCRLS算法以满足不同网络更新需求。在公开数据集上进行光伏板积尘检测实验,与13种深度学习及广义学习算法对比,结果表明BSCRLS算法具有显著有效性和优越性。

原文摘要 · Abstract (English)

Universal approximation serves as the foundation of neural network learning algorithms. However, some networks establish their universal approximation property by demonstrating that the iterative errors converge in probability measure rather than the more rigorous norm convergence, which makes the universal approximation property of randomized learning networks highly sensitive to random parameter selection, Broad residual learning system (BRLS), as a member of randomized learning models, also encounters this issue. We theoretically demonstrate the limitation of its universal approximation property, that is, the iterative errors do not satisfy norm convergence if the selection of random parameters is inappropriate and the convergence rate meets certain conditions. To address this issue, we propose the broad stochastic configuration residual learning system (BSCRLS) algorithm, which features a novel supervisory mechanism adaptively constraining the range settings of random parameters on the basis of BRLS framework, Furthermore, we prove the universal approximation theorem of BSCRLS based on the more stringent norm convergence. Three versions of incremental BSCRLS algorithms are presented to satisfy the application requirements of various network updates. Solar panels dust detection experiments are performed on publicly available dataset and compared with 13 deep and broad learning algorithms. Experimental results reveal the effectiveness and superiority of BSCRLS algorithms.

随机网络通用逼近残差学习算法优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。