用群论中的正规子群分离图像中不交换的变换,实现无监督分类。
Learning Conditionally Independent Transformations using Normal Subgroups in Group Theory
- 基于正规子群构建非交换变换的可分离框架
- 在图像几何变换上成功区分旋转与平移等条件独立变换
- 为无监督表示学习提供新理论工具,适合对称性建模研究者
人类无需显式标注即可识别物体及其变换,凸显了无监督表征学习的重要性。无监督表征学习的核心挑战在于分离特征表示中的不同变换。尽管已有代数方法探索,但系统性理论框架仍不完善。现有方法依赖代数独立性分解变换,但主要针对可交换变换,无法处理条件独立但不可交换的情形。本文受伽罗瓦理论启发,利用正规子群对群进行分解,该方法在特定条件下自然扩展了可交换性,并为不可交换变换的分类提供基础。我们提出一种新方法,通过正规子群实现条件独立变换的分离,即使变换不可交换也有效。在图像几何变换实验中,方法成功无监督地分类旋转与平移等变换,表明正规子群分解与表征学习中变换分类存在紧密联系。
原文摘要 · Abstract (English)
Humans develop certain cognitive abilities to recognize objects and their transformations without explicit supervision, highlighting the importance of unsupervised representation learning. A fundamental challenge in unsupervised representation learning is to separate different transformations in learned feature representations. Although algebraic approaches have been explored, a comprehensive theoretical framework remains underdeveloped. Existing methods decompose transformations based on algebraic independence, but these methods primarily focus on commutative transformations and do not extend to cases where transformations are conditionally independent but noncommutative. To extend current representation learning frameworks, we draw inspiration from Galois theory, where the decomposition of groups through normal subgroups provides an approach for the analysis of structured transformations. Normal subgroups naturally extend commutativity under certain conditions and offer a foundation for the categorization of transformations, even when they do not commute. In this paper, we propose a novel approach that leverages normal subgroups to enable the separation of conditionally independent transformations, even in the absence of commutativity. Through experiments on geometric transformations in images, we show that our method successfully categorizes conditionally independent transformations, such as rotation and translation, in an unsupervised manner, suggesting a close link between group decomposition via normal subgroups and transformation categorization in representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。