SAMPAT用代数表达式实现可解释的函数逼近,兼顾精度与透明性。
All you need is SAMPAT

- 基于多项式与解析变换的三层结构,可精确逼近任意光滑函数。
- 两层SAMPAT在多数任务中表现媲美深层网络,且表达式简洁可读。
- 支持自动选择模型形式,适合需要可解释性的科研场景。
当前人工智能/机器学习的主流依赖深度神经网络,但普遍缺乏可解释性。在分析实验数据时,仅靠定量预测不足,可解释性至关重要。我们提出三层神经架构SAMPAT(Smooth Approximation via Multivariate Polynomials and Analytic Transformations),可严格证明逼近任意光滑函数,且其近似表达为连续、处处可导的闭合代数形式,实现完全可解释。合成与基准数据集实验表明,SAMPAT性能与复杂模型相当,且表达更简洁。多数任务中两层已足够。通过约束神经元连接,SAMPAT可生成正则或三角多项式、有理函数、高斯及混合高斯等表达式;无约束时自动学习合适结构。该模型可用于多项式因式分解与非线性系统建模。引入跳跃连接后,四至六层SAMPAT可涵盖广泛主流方法,使模型家族的选择也纳入学习优化过程。
原文摘要 · Abstract (English)
The current state of the art in AI/ML rests on deep neural architectures, which, in general, suffer from a lack of interpretability. Interpretability is crucial to gleaning insights while analyzing experimental data, where quantitative predictions may not be adequate for a scientist. We present a three layer neural architecture, SAMPAT (Smooth Approximation via Multivariate Polynomials and Analytic Transformations), that can provably learn a continuous, everywhere differentiable function, that can approximate any smooth function arbitrarily closely. SAMPAT's approximant can be expressed as a closed and compact algebraic, analytic expression, providing complete interpretability. Experiments on synthetic and benchmark datasets indicate that SAMPAT yields competitive performance with simpler representations. For many tasks, a two layer SAMPAT suffices. By imposing restrictions on the connectivity between neurons, SAMPAT may be used to provide a range of approximants, including regular and trigonometric polynomials, rational expressions, Gaussians, mixtures of Gaussians, as well as arbitrary combinations of the same; without restrictions, it learns a suitable structure. SAMPAT may be used to factorize polynomials and model nonlinear systems. With the addition of skip connections, a 4 to 6 layer SAMPAT is adequate to represent a substantive range of methods widely used in AI/ML, allowing the choice of a model's family, not just its parameters, to also be optimized as part of the learning process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。