arXiv:2506.09887cs.LGmath.ST2025-06NeurIPS被引 8

用球谐函数重新解析单指标模型,揭示旋转对称性下的学习规律

Learning single-index models via harmonic decomposition

  • 以球谐函数替代赫尔米特多项式,捕捉输入的旋转对称性
  • 提出两种新估计器,在样本复杂度或运行时间上达到最优
  • 在高斯输入下重现并深化了已有结果,发现此前被忽略的新现象

我们研究单指标模型的学习问题,其中标签 $y \in \mathbb{R}$ 仅通过未知的一维投影 $\langle \boldsymbol{w}_*,\boldsymbol{x}\rangle$ 依赖于输入 $\boldsymbol{x} \in \mathbb{R}^d$。已有研究表明,在高斯输入下,恢复 $\boldsymbol{w}_*$ 的统计与计算复杂度由链接函数的赫尔米特展开决定。本文提出新视角:球谐函数——而非赫尔米特多项式——才是该问题的自然基底,因其能捕捉其内在的旋转对称性。基于此,我们刻画了任意球对称输入分布下的学习复杂度。引入两类估计器——基于张量展开和在线 SGD——分别实现最优样本复杂度或最优运行时间,并论证两者同时最优在一般情况下可能不存在。当特化到高斯输入时,理论不仅复现并澄清了已有结果,还揭示了此前被忽视的新现象。

原文摘要 · Abstract (English)

We study the problem of learning single-index models, where the label $y \in \mathbb{R}$ depends on the input $\boldsymbol{x} \in \mathbb{R}^d$ only through an unknown one-dimensional projection $\langle \boldsymbol{w}_*,\boldsymbol{x}\rangle$. Prior work has shown that under Gaussian inputs, the statistical and computational complexity of recovering $\boldsymbol{w}_*$ is governed by the Hermite expansion of the link function. In this paper, we propose a new perspective: we argue that $spherical$ $harmonics$ -- rather than $Hermite$ $polynomials$ -- provide the natural basis for this problem, as they capture its intrinsic $rotational$ $symmetry$. Building on this insight, we characterize the complexity of learning single-index models under arbitrary spherically symmetric input distributions. We introduce two families of estimators -- based on tensor unfolding and online SGD -- that respectively achieve either optimal sample complexity or optimal runtime, and argue that estimators achieving both may not exist in general. When specialized to Gaussian inputs, our theory not only recovers and clarifies existing results but also reveals new phenomena that had previously been overlooked.

单指标模型球谐函数学习复杂度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。