利用对称轨道增强特征,提升图神经网络求解带对称性的整数规划问题能力
When GNNs meet symmetry in ILPs: an orbit-based feature augmentation approach
- 基于对称变量的轨道分组,从离散均匀分布采样增强特征
- 在多个测试集上显著提升训练效率与预测准确率
- 适合研究对称性优化或图神经网络在组合优化中应用的读者
整数线性规划(ILP)普遍存在对称性,即变量置换不改变问题结构。近年来,图神经网络(GNN)被用于求解ILP,但经典GNN架构难以区分对称变量,影响预测精度。本文研究了GNN中置换等变性与不变性的特性,揭示其与ILP固有对称性的相互作用是识别困难的原因。为此,提出特征增强的指导原则,并设计一种基于轨道的增强方案:先将对称变量分组,再为每组从离散均匀分布中采样增强特征。实验表明,该方法显著提升训练效率和预测性能。
原文摘要 · Abstract (English)
A common characteristic in integer linear programs (ILPs) is symmetry, allowing variables to be permuted without altering the underlying problem structure. Recently, GNNs have emerged as a promising approach for solving ILPs. However, a significant challenge arises when applying GNNs to ILPs with symmetry: classic GNN architectures struggle to differentiate between symmetric variables, which limits their predictive accuracy. In this work, we investigate the properties of permutation equivariance and invariance in GNNs, particularly in relation to the inherent symmetry of ILP formulations. We reveal that the interaction between these two factors contributes to the difficulty of distinguishing between symmetric variables. To address this challenge, we explore the potential of feature augmentation and propose several guiding principles for constructing augmented features. Building on these principles, we develop an orbit-based augmentation scheme that first groups symmetric variables and then samples augmented features for each group from a discrete uniform distribution. Empirical results demonstrate that our proposed approach significantly enhances both training efficiency and predictive performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。