arXiv:2603.19486cs.LG2026-03中稿 · ICLR

一个模型同时支持多种对称性,通过调节输入实现灵活切换。

Any-Subgroup Equivariant Networks via Symmetry Breaking

  • 用可调输入打破对称性,让模型动态适配不同子群对称性。
  • 在图、图像和序列任务中,单模型表现优于多个专用模型。
  • 理论保证通用性,适用于多模态基础模型构建。

将对称性作为归纳偏置(即等变性)常能提升几何数据(如网格、集合、图)的泛化能力。然而,现有等变架构通常高度受限,仅针对预设对称性设计,无法适应其他对称性数据。这阻碍了可处理多样化数据的灵活、多模态基础模型的发展。本文提出单一模型——任意子群等变网络(ASEN),通过调节特定辅助输入特征,即可同时对多个群实现等变。我们从全置换等变的基础模型出发,通过使用自同构群为目标子群的对称性破坏输入来获得子群等变性。由于精确找到目标自同构群的输入计算困难,我们转而采用近似对称性破坏,借助2-闭包概念推导出高效算法。理论上,我们的子群等变网络可模拟等变MLP,且若基础模型具备通用性,则其通用性可被保证。实验上,我们在图与图像任务中的对称性选择,以及序列任务的多任务和迁移学习中验证了方法有效性:一个同时对多个置换子群等变的单模型,性能优于多个独立等变模型和单个非等变模型。

原文摘要 · Abstract (English)

The inclusion of symmetries as an inductive bias, known as equivariance, often improves generalization on geometric data (e.g. grids, sets, and graphs). However, equivariant architectures are usually highly constrained, designed for symmetries chosen a priori, and not applicable to datasets with other symmetries. This precludes the development of flexible, multi-modal foundation models capable of processing diverse data equivariantly. In this work, we build a single model -- the Any-Subgroup Equivariant Network (ASEN) -- that can be simultaneously equivariant to several groups, simply by modulating a certain auxiliary input feature. In particular, we start with a fully permutation-equivariant base model, and then obtain subgroup equivariance by using a symmetry-breaking input whose automorphism group is that subgroup. However, finding an input with the desired automorphism group is computationally hard. We overcome this by relaxing from exact to approximate symmetry breaking, leveraging the notion of 2-closure to derive fast algorithms. Theoretically, we show that our subgroup-equivariant networks can simulate equivariant MLPs, and their universality can be guaranteed if the base model is universal. Empirically, we validate our method on symmetry selection for graph and image tasks, as well as multitask and transfer learning for sequence tasks, showing that a single network equivariant to multiple permutation subgroups outperforms both separate equivariant models and a single non-equivariant model.

等变网络对称性多任务学习图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。