arXiv:2603.24400stat.MLcs.LG2026-03

提出可区分上下文与回归的神经网络,提升效率与可解释性。

Neural Network Models for Contextual Regression

  • 分离上下文识别与回归,结构更清晰
  • 误差更低,性能更稳定,参数更少
  • 适合需要可解释性的建模场景

我们提出一种用于上下文回归的神经网络模型,其中回归模型由决定激活子模型的上下文特征驱动,并设计了相应的拟合算法。所提出的简单上下文神经网络(SCtxtNN)将上下文识别与特定上下文的回归分离,形成结构化且可解释的架构,参数量少于全连接前馈网络。数学上证明该架构仅用标准神经网络组件即可表示上下文线性回归模型。数值实验支持理论结果,表明该模型在参数数量相近时,比前馈神经网络具有更低的额外均方误差和更稳定的性能;更大网络虽能提高精度,但代价是复杂度显著增加。结果表明,引入上下文结构可在保持可解释性的同时提升模型效率。

原文摘要 · Abstract (English)

We propose a neural network model for contextual regression in which the regression model depends on contextual features that determine the active submodel and an algorithm to fit the model. The proposed simple contextual neural network (SCtxtNN) separates context identification from context-specific regression, resulting in a structured and interpretable architecture with fewer parameters than a fully connected feed-forward network. We show mathematically that the proposed architecture is sufficient to represent contextual linear regression models using only standard neural network components. Numerical experiments are provided to support the theoretical result, showing that the proposed model achieves lower excess mean squared error and more stable performance than feed-forward neural networks with comparable numbers of parameters, while larger networks improve accuracy only at the cost of increased complexity. The results suggest that incorporating contextual structure can improve model efficiency while preserving interpretability.

上下文回归神经网络可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。