提出新型超图压缩方法,提升大模型训练效率与精度。
Anchor-guided Hypergraph Condensation with Dual-level Discrimination
- 用热核页面排名初始化节点,融合结构信息到特征中
- 通过锚点引导合成超边,实现结构与特征联合优化
- 双层级判别机制无需重复训练,显著降低计算开销
大规模超图的普及给超图神经网络(HNN)训练带来巨大计算挑战。为应对这一问题,超图凝缩(HGC)将大型真实超图压缩为紧凑且信息丰富的合成超图,超越仅处理成对关系的图凝缩(GC)方法。然而,现有HGC方法采用解耦训练架构:结构生成器在原始超图上预训练,但未与凝缩特征共同优化,导致结构错位,降低下游任务性能;此外,基于轨迹的优化方式在精炼阶段引入巨大计算开销,限制凝缩效率。为此,本文提出锚点引导的超图凝缩与双层级判别方法(AHGCDD),包含三个核心组件:(1) 基于热核页面排名(HKPR)的节点初始化模块,将结构知识编码至特征语义;(2) 锚点引导的超边合成策略,实现凝缩特征与结构的联合优化;(3) 理论支撑的双层级判别目标,实现无冗余HNN训练的保真凝缩。大量实验验证了AHGCDD在有效性与效率上的优越性。
原文摘要 · Abstract (English)
The increasing prevalence of large-scale hypergraphs poses significant computational challenges for hypergraph neural network (HNN) training. To address this, hypergraph condensation (HGC) distills large real hypergraphs into compact yet informative synthetic ones, beyond graph condensation (GC) methods limited to pairwise relations. However, existing HGC methods rely on decoupled training architectures, where structure generators are pre-trained on the original hypergraph but not jointly optimized with condensed features during refinement, resulting in misaligned structures that degrade downstream utility. Moreover, trajectory-based optimization incurs substantial computational overhead in refinement, limiting condensation efficiency. To tackle these issues, we propose \textbf{A}nchor-guided \textbf{H}yper\textbf{G}raph \textbf{C}ondensation with \textbf{D}ual-level \textbf{D}iscrimination (\textbf{AHGCDD}), which consists of three key components: (1) a node initialization module based on Heat Kernel PageRank (HKPR) to encode structural knowledge into feature semantics; (2) an anchor-guided hyperedge synthesis strategy for joint optimization of condensed features and structure; (3) a theoretically grounded dual-level discrimination objective for utility-preserving condensation without redundant HNN training. Extensive experiments demonstrate the superior effectiveness and efficiency of AHGCDD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。