提出高效算法,精准学习高维布尔多项式中的稀疏项。
Adaptive Sparse Möbius Transforms for Learning Polynomials
- 用自适应分组测试思想构造莫比乌斯变换,突破相干基难题。
- 算法仅需O(sd log(n/d))次查询,接近理论最优。
- 适用于超图重构等场景,避免高阶组合爆炸问题。
我们研究在AND基下精确学习一个s-稀疏、次数为d的实值布尔多项式f: {0,1}^n → ℝ的问题。该问题等价于在AND基下的函数分解,即计算莫比乌斯变换(或莫比乌斯反演)。尽管在奇偶基(傅里叶变换)下该问题已有充分理解,但AND基的基向量具有强相关性,导致标准压缩感知方法失效。本文通过识别可利用自适应分组测试实现高效的莫比乌斯变换,提出两种算法:全自适应稀疏莫比乌斯变换(FASMT)使用O(sd log(n/d))次自适应查询,时间复杂度为O((sd + n) sd log(n/d)),查询复杂度接近最优;部分自适应稀疏莫比乌斯变换(PASMT)将查询数降至O(sd² log(n/d)),自适应轮数减少至O(d² log(n/d)),且不再依赖稀疏度s。应用于边计数查询下的超图重构时,我们的方法避免了秩为d时的组合爆炸问题。实验表明,该方法在模拟中能有效学习真实超图。
原文摘要 · Abstract (English)
We consider the problem of exactly learning an $s$-sparse real-valued Boolean polynomial of degree $d$ of the form $f:\{ 0,1\}^n \rightarrow \mathbb{R}$. This problem corresponds to decomposing functions in the AND basis and is known as taking a Möbius transform. While the analogous problem for the parity basis (Fourier transform) $f: \{-1,1 \}^n \rightarrow \mathbb{R}$ is well-understood, the AND basis presents a unique challenge: the basis vectors are coherent, precluding standard compressed sensing methods. We overcome this challenge by identifying that we can exploit adaptive group testing to provide a constructive, query-efficient implementation of the Möbius transform (also known as Möbius inversion) for sparse functions. We present two algorithms based on this insight. The Fully-Adaptive Sparse Möbius Transform (FASMT) uses $O(sd \log(n/d))$ adaptive queries in $O((sd + n) sd \log(n/d))$ time, which we show is near-optimal in query complexity. Furthermore, we also present the Partially-Adaptive Sparse Möbius Transform (PASMT), which uses $O(sd^2\log(n/d))$ queries, trading a factor of $d$ to reduce the number of adaptive rounds to $O(d^2\log(n/d))$, with no dependence on $s$. When applied to hypergraph reconstruction from edge-count queries, our results improve upon baselines by avoiding the combinatorial explosion in the rank $d$. We demonstrate the practical utility of our method for hypergraph reconstruction by applying it to learning real hypergraphs in simulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。