arXiv:2409.15394cs.LGcs.AI2024-09International Conf…被引 15

用神经网络近似被积函数的反导数,实现低方差无偏积分。

Neural Control Variates with Automatic Integration

  • 用神经网络拟合被积函数的反导数,通过自动微分构造可积函数
  • 在随机游走球算法中验证,方差低于现有控制变量方法
  • 适用于任意神经网络结构,无需手动设计基函数

本文提出一种新方法,利用任意神经网络架构构建可学习的参数化控制变量。控制变量能有效降低蒙特卡洛积分的方差,但其关键在于找到与被积函数相关且解析积分已知的函数。传统方法依赖启发式选择,表达能力有限。近期研究尝试用可学习模型(如神经网络)建模被积函数,但难以保证解析积分存在。本文提出将神经网络用于近似被积函数的反导数,从而通过自动微分获得可精确积分的函数。该方法在基于行走球算法求解偏微分方程时表现优异,结果表明其为无偏估计,且在多种网络结构下均实现更低方差。

原文摘要 · Abstract (English)

This paper presents a method to leverage arbitrary neural network architecture for control variates. Control variates are crucial in reducing the variance of Monte Carlo integration, but they hinge on finding a function that both correlates with the integrand and has a known analytical integral. Traditional approaches rely on heuristics to choose this function, which might not be expressive enough to correlate well with the integrand. Recent research alleviates this issue by modeling the integrands with a learnable parametric model, such as a neural network. However, the challenge remains in creating an expressive parametric model with a known analytical integral. This paper proposes a novel approach to construct learnable parametric control variates functions from arbitrary neural network architectures. Instead of using a network to approximate the integrand directly, we employ the network to approximate the anti-derivative of the integrand. This allows us to use automatic differentiation to create a function whose integration can be constructed by the antiderivative network. We apply our method to solve partial differential equations using the Walk-on-sphere algorithm. Our results indicate that this approach is unbiased and uses various network architectures to achieve lower variance than other control variate methods.

控制变量神经网络积分无偏估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。