提出适用于任意概率分布的布尔超立方体傅里叶分析新方法。
Fourier Analysis on the Boolean Hypercube via Hoeffding Functional Decomposition
- 基于ANOVA构造任意概率测度下的显式函数分解基
- 将傅里叶分解转化为最小二乘问题,有效应对高维难题
- 适用于非均匀数据场景,如独热编码特征,助力可解释AI
布尔超立方体上的傅里叶分析本质上是伪布尔函数空间在均匀概率测度下的正交分解。本文提出一种基于ANOVA的推广方法,适用于布尔超立方体上任意概率测度。我们给出了显式的分解基,该基在任意概率测度下推广了沃尔什-哈达玛德(或奇偶函数)基。将整个函数分解的计算形式化为最小二乘问题,并提供解决经典维度灾难挑战的方法。本工作全面推广了布尔超立方体上的傅里叶分析,使其能够处理真实机器学习任务中固有的非均匀配置空间,例如处理独热编码特征时。最后,通过与SHAP或TreeHFD等特征归因方法的对比研究,展示了其在可解释人工智能领域的实际影响。
原文摘要 · Abstract (English)
Fourier analysis on the Boolean hypercube is fundamentally defined as the orthogonal decomposition of the space of pseudo-Boolean functions with respect to the uniform probability measure. In this work, we propose an ANOVA-based generalization of the Fourier decomposition on the Boolean hypercube endowed with any arbitrary probability measure. We provide an \emph{explicit} decomposition basis which generalizes the Walsh-Hadamard (or parity functions) basis under any \emph{arbitrary} probability measure on the Boolean hypercube. We formulate the computation of the entire functional decomposition as a least squares problem and also provide a method to address the classical \emph{curse of dimensionality} challenge. We provide a comprehensive generalization of Fourier analysis on the Boolean hypercube, enabling the handling of non-uniform configuration spaces inherent to real-world machine learning tasks, \textit{e.g.} when dealing with \emph{one-hot encoded} features. Finally, we demonstrate its practical impact in the field of explainable AI, by conducting comparative studies with feature attribution methods such as SHAP or TreeHFD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。