无需先验知识,从数据变换对中自动学习群不变表示。
Equivariance by Contrast: Identifiable Equivariant Embeddings from Unlabeled Finite Group Actions
- 通过对比学习构建可识别的等变嵌入空间
- 在合成数据上实现高保真等变性,支持非阿贝尔群
- 适合研究通用等变学习的科研人员
我们提出等变对比学习(EbC),从观察对 $(oldsymbol{y}, g ullet oldsymbol{y})$ 中学习等变嵌入,其中 $g$ 来自作用于数据的有限群。方法联合学习潜在空间与群表示,使群作用对应可逆线性映射,不依赖特定群的归纳偏置。在无限 dSprites 数据集上验证,该群 $G := (R_m \times \mathbb{Z}_n \times \mathbb{Z}_n)$ 结合离散旋转与周期平移,嵌入表现出高保真等变性,群操作在潜在空间中被精确再现。在合成数据上进一步验证了对非阿贝尔正交群 $O(n)$ 与一般线性群 $GL(n)$ 的适用性,并提供了可识别性理论证明。尽管真实世界数据上的广泛评估尚待未来工作,但本研究首次成功实现了仅凭群作用观测的通用编码器式等变学习,涵盖非平凡非阿贝尔群及用于建模计算机视觉仿射等变性的乘积群。
原文摘要 · Abstract (English)
We propose Equivariance by Contrast (EbC) to learn equivariant embeddings from observation pairs $(\mathbf{y}, g \cdot \mathbf{y})$, where $g$ is drawn from a finite group acting on the data. Our method jointly learns a latent space and a group representation in which group actions correspond to invertible linear maps -- without relying on group-specific inductive biases. We validate our approach on the infinite dSprites dataset with structured transformations defined by the finite group $G:= (R_m \times \mathbb{Z}_n \times \mathbb{Z}_n)$, combining discrete rotations and periodic translations. The resulting embeddings exhibit high-fidelity equivariance, with group operations faithfully reproduced in latent space. On synthetic data, we further validate the approach on the non-abelian orthogonal group $O(n)$ and the general linear group $GL(n)$. We also provide a theoretical proof for identifiability. While broad evaluation across diverse group types on real-world data remains future work, our results constitute the first successful demonstration of general-purpose encoder-only equivariant learning from group action observations alone, including non-trivial non-abelian groups and a product group motivated by modeling affine equivariances in computer vision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。