用几何点与权重构建紧凑神经网络,实现高效函数逼近。
Barycentric Neural Networks and Length-Weighted Persistent Entropy Loss: A Green Geometric and Topological Framework for Function Approximation
- 基于固定基点和重心坐标构造紧凑浅层网络,保证连续性。
- 在少数据或少训练时长下,逼近精度高于传统损失函数。
- 适合需要可解释性与低计算成本的函数拟合场景。
尽管人工神经网络是连续函数的通用近似器,但许多现代方法依赖过参数化架构,计算成本高。本文提出重心神经网络(BNN):一种通过固定基点及其重心坐标编码结构与参数的紧凑浅层架构。我们证明BNN可精确表示连续分段线性函数(CPLFs),确保各段间严格连续。由于任何紧致域上的连续函数均可被CPLFs一致逼近,BNN成为灵活且可解释的函数逼近工具。为提升资源受限场景下的几何保真度(如基点少或训练轮次有限),我们提出长度加权持续熵(LWPE)——一种稳定的持续熵变体。该方法将BNN与基于LWPE的损失结合,优化定义BNN的基点而非内部参数。实验表明,相比标准损失(MSE、RMSE、MAE、LogCosh),本方法在逼近性能与速度上均更优,提供了一种计算可持续的函数逼近替代方案。
原文摘要 · Abstract (English)
While artificial neural networks are known as universal approximators for continuous functions, many modern approaches rely on overparameterized architectures with high computational cost. In this work, we introduce the Barycentric Neural Network (BNN): a compact shallow architecture that encodes both structure and parameters through a fixed set of base points and their associated barycentric coordinates. We show that the BNN enables the exact representation of continuous piecewise linear functions (CPLFs), ensuring strict continuity across segments. Given that any continuous function on a compact domain can be uniformly approximated by CPLFs, the BNN emerges as a flexible and interpretable tool for function approximation. To enhance geometric fidelity in low-resource scenarios, such as those with few base points to create BNNs or limited training epochs, we propose length-weighted persistent entropy (LWPE): a stable variant of persistent entropy. Our approach integrates the BNN with a loss function based on LWPE to optimize the base points that define the BNN, rather than its internal parameters. Experimental results show that our approach achieves superior and faster approximation performance compared to standard losses (MSE, RMSE, MAE and LogCosh), offering a computationally sustainable alternative for function approximation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。