突破分布限制,让傅里叶方法能学复杂逻辑表达式
Learning DNF through Generalized Fourier Representations
- 用贝叶斯网络建模非独立分布,构造广义傅里叶展开
- 证明关键项的谱范数有界,实现对DNF和决策树的学习
- 适用于未知分布场景,适合学习理论研究者
布尔傅里叶表示在学习理论中被广泛用于在均匀分布和乘积分布下学习析取范式(DNF)。将这些结果推广到非乘积分布一直是长期未解难题。本文通过引入一种广义傅里叶表示,实现了在一大类非乘积分布下的学习。方法将任意分布 $D$ 建模为贝叶斯网络(BN),并推导出对应的傅里叶展开。我们证明,标准的基于成员查询的傅里叶学习技术可经微小修改应用于该广义表示。对于差值有界的树形贝叶斯网络,我们证明了合取项的 $L_1$ 谱范数仍保持有界,显著推广了均匀分布下的已知结果;匹配的下界表明这些约束是必要的。基于此,我们建立了在该类分布下对DNF的可学习性以及对决策树的鲁棒可学习性。最后,我们提出一个学习差值有界树形贝叶斯网络分布的算法,将结果扩展至分布未知的情形。
原文摘要 · Abstract (English)
The Boolean Fourier representation has been widely used in learning theory, particularly for learning Disjunctive Normal Form (DNF) under uniform and product distributions. Extending these results to non-product distributions has remained a longstanding open problem. We address this challenge by introducing a generalized Fourier representation that enables learning under a broad class of non-product distributions. Our approach represents any distribution $D$ as a Bayesian network (BN) and derives a corresponding Fourier expansion. We show that standard Fourier-based learning techniques using membership queries to identify heavy coefficients can be adapted to this generalized representation with minor modifications. We prove that the $L_1$ spectral norm of conjunctions remains bounded under this expansion for difference-bounded tree BNs, significantly generalizing the known result for uniform distributions; matching lower bounds demonstrate the necessity of these constraints. Using these results, we establish the learnability of DNF and the agnostic learnability of decision trees under such distributions. Finally, we present an algorithm for learning difference-bounded tree BN distributions, extending our results to settings where the distribution is unknown.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。