arXiv:2505.21587cs.LGcs.AI2025-05KDD被引 1

提出CellCLAT框架,解决细胞复杂结构自监督学习中的拓扑保持与冗余消除难题。

CellCLAT: Preserving Topology and Trimming Redundancy in Self-Supervised Cellular Contrastive Learning

  • 通过参数扰动实现无结构破坏的细胞交互噪声注入
  • 采用双层元学习剪枝器移除无关细胞,保留关键高阶语义
  • 首次在细胞复杂结构上实现高效自监督学习,适合图神经网络研究者

自监督拓扑深度学习(TDL)是一个新兴但未充分探索的领域,具有建模单纯复形和细胞复形中高阶交互的潜力。相比单纯复形,细胞复形表达能力更强。然而,自监督学习在细胞TDL中的进展受到两大核心挑战制约:细胞复形固有的外部结构约束,以及细胞表示中的内在语义冗余。前者表明传统图增强方法可能破坏高阶细胞交互完整性;后者强调细胞复形中的拓扑冗余可能削弱任务相关信息。为此,我们提出细胞复形对比学习自适应剪枝框架(CellCLAT),该框架兼顾细胞复形的组合约束并缓解信息冗余。具体而言,我们设计了一种基于参数扰动的增强方法,在不改变底层细胞结构的前提下注入可控噪声,从而在对比学习中保持细胞拓扑;同时引入细胞剪枝调度器,通过双层元学习机制屏蔽无关细胞的梯度贡献,有效去除冗余拓扑元素而保留关键高阶语义。我们提供了理论依据与实证验证,证明CellCLAT在自监督图学习方法上取得显著提升,是该领域的重大尝试。

原文摘要 · Abstract (English)

Self-supervised topological deep learning (TDL) represents a nascent but underexplored area with significant potential for modeling higher-order interactions in simplicial complexes and cellular complexes to derive representations of unlabeled graphs. Compared to simplicial complexes, cellular complexes exhibit greater expressive power. However, the advancement in self-supervised learning for cellular TDL is largely hindered by two core challenges: \textit{extrinsic structural constraints} inherent to cellular complexes, and intrinsic semantic redundancy in cellular representations. The first challenge highlights that traditional graph augmentation techniques may compromise the integrity of higher-order cellular interactions, while the second underscores that topological redundancy in cellular complexes potentially diminish task-relevant information. To address these issues, we introduce Cellular Complex Contrastive Learning with Adaptive Trimming (CellCLAT), a twofold framework designed to adhere to the combinatorial constraints of cellular complexes while mitigating informational redundancy. Specifically, we propose a parameter perturbation-based augmentation method that injects controlled noise into cellular interactions without altering the underlying cellular structures, thereby preserving cellular topology during contrastive learning. Additionally, a cellular trimming scheduler is employed to mask gradient contributions from task-irrelevant cells through a bi-level meta-learning approach, effectively removing redundant topological elements while maintaining critical higher-order semantics. We provide theoretical justification and empirical validation to demonstrate that CellCLAT achieves substantial improvements over existing self-supervised graph learning methods, marking a significant attempt in this domain.

拓扑学习自监督细胞复形对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。