arXiv:2508.20290cs.LGcs.AI2025-08

提出新指标VC,量化神经网络局部性能波动,提升逼近稳定性。

Objective Value Change and Shape-Based Accelerated Optimization for the Neural Network Approximation

  • 引入VC指标衡量网络局部值变化,反映逼近难度
  • 发现VC趋势与少数群体趋势,揭示误差演化规律
  • 基于VC设计预处理框架,加速真实场景与偏微分方程问题

本文提出一种新型目标函数f的度量方式——值变化(VC),用于衡量神经网络逼近任务中的困难程度及对逼近效果的影响。该指标数值化支持刻画神经网络逼近的局部性能与行为特征。神经网络常表现出不可预测的局部性能,影响其在关键应用中的可靠性。VC通过提供网络行为局部值变化的可量化度量,为理解逼近过程中的稳定性和性能表现提供了洞见。我们研究了VC的基本理论性质,发现了两个有趣现象:VC趋势与少数群体趋势,分别表征点对点误差随VC分布演变的规律。此外,基于VC构建了一种新的函数间距离度量,从变化角度衡量两函数差异。在此基础上,提出一种新的神经网络逼近预处理框架。数值实验结果,包括真实世界应用和与偏微分方程相关的科学问题,均验证了发现的有效性及预处理加速方法的优越性。

原文摘要 · Abstract (English)

This paper introduce a novel metric of an objective function f, we say VC (value change) to measure the difficulty and approximation affection when conducting an neural network approximation task, and it numerically supports characterizing the local performance and behavior of neural network approximation. Neural networks often suffer from unpredictable local performance, which can hinder their reliability in critical applications. VC addresses this issue by providing a quantifiable measure of local value changes in network behavior, offering insights into the stability and performance for achieving the neural-network approximation. We investigate some fundamental theoretical properties of VC and identified two intriguing phenomena in neural network approximation: the VC-tendency and the minority-tendency. These trends respectively characterize how pointwise errors evolve in relation to the distribution of VC during the approximation process.In addition, we propose a novel metric based on VC, which measures the distance between two functions from the perspective of variation. Building upon this metric, we further propose a new preprocessing framework for neural network approximation. Numerical results including the real-world experiment and the PDE-related scientific problem support our discovery and pre-processing acceleration method.

神经网络逼近稳定性分析预处理框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。