arXiv:2609.07031cs.LGstat.ML2026-09

提出统一高效算法,解决有限与无限对称性下的精确不变学习问题。

Efficient Learning and Symmetry Discovery under Exact Invariances

  • 设计多项式时间算法,统一处理有限与无限群的精确不变性。
  • 在有限维特征空间中可准确识别对称性,样本复杂度达理论最优。
  • 适合几何机器学习、对称性发现等场景,理论严谨且实用性强。

在具有群不变性的学习任务中,其计算基础仍不明确。尽管已有研究证明在已知有限群的情况下可多项式时间实现精确不变性,但无限群和未知对称性的情况仍待解决。本文首次提出统一的多项式时间算法,适用于有限与无限群,运行时间仅依赖于数据维度和样本量,与群无关,并具备强泛化性能。此外,在对称性未知的发现设置中,针对有限群的子群格结构,我们证明了可从数据中精确识别对称性并用于学习,该算法在有限维特征空间中能准确恢复底层对称性,达到已知对称性情况下的最小最大样本复杂度,且运行时间多项式于数据维度与样本数。分析基于随机凯莱图和扩张器理论,可能具独立研究价值。

原文摘要 · Abstract (English)

Learning with group invariances is central to many scientific and geometric learning problems, yet its computational foundations remain poorly understood. Even for classical supervised regression settings, it has been unclear whether one can efficiently compute a regression function that is exactly invariant to a given group action. Recent work showed that exact invariance can be enforced in polynomial time when the underlying group is finite and known, but left open the cases of infinite groups and unknown symmetries. In this paper, we resolve both challenges. First, we present the first polynomial-time algorithm for learning with exact group invariances that applies uniformly to finite and infinite groups. The runtime is polynomial in the data dimension and sample size, and independent of the group, while achieving strong generalization guarantees. This provides a computational explanation for the empirical success of invariant and equivariant methods in geometric machine learning and partially answers a recent open question in the literature. Second, we study learning in the symmetry discovery setting, where the invariance group is unknown. Focusing on the subgroup lattice of a finite group, we show that exact symmetries can be identified from data and exploited for learning in polynomial time. For regression over finite-dimensional feature spaces, our algorithm provably recovers the underlying symmetry, matches the minimax-optimal sample complexity of the known-symmetry setting, and runs in time polynomial in the data dimension and sample size. Our analysis relies on tools from random Cayley graphs and expander theory, which may be of independent interest.

对称性学习不变性算法设计几何学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。