arXiv:2502.00767cs.LGcs.AI2025-02被引 3

深度学习解法在随机数据上表现好,但对非随机分布数据容易过度贪心。

Learning-Based TSP-Solvers Tend to Be Overly Greedy

  • 用最近邻密度统计量揭示了学习型解法的贪心倾向
  • 在分布外数据上性能显著下降,甚至退化到接近贪心算法
  • 通过分布偏移增强训练,可提升模型泛化能力,适合研究泛化性的学者

深度学习在解决欧几里得旅行商问题(TSP)等组合优化问题上展现出巨大潜力。然而,现有TSP算法的训练与测试实例大多从均匀分布等特定分布中随机生成,导致对学习型算法在分布外(OOD)泛化性能缺乏分析,而这一性能与组合优化中的最坏情况密切相关。本研究提出一种名为‘最近邻密度’的统计度量,验证了随机生成数据的渐近性质,并揭示了学习型求解器倾向于始终选择最近邻节点构建路径的贪心行为。基于该度量,我们设计了可解释的数据增强方法,依赖分布偏移或实例扰动,实证表明学习型求解器在增强数据上的性能大幅下降。进一步地,使用增强数据微调后,模型的泛化能力得到明显提升。结果表明,学习型TSP求解器普遍存在过度贪心的局限性,这对人工智能赋能的组合优化求解器具有深远影响。

原文摘要 · Abstract (English)

Deep learning has shown significant potential in solving combinatorial optimization problems such as the Euclidean traveling salesman problem (TSP). However, most training and test instances for existing TSP algorithms are generated randomly from specific distributions like uniform distribution. This has led to a lack of analysis and understanding of the performance of deep learning algorithms in out-of-distribution (OOD) generalization scenarios, which has a close relationship with the worst-case performance in the combinatorial optimization field. For data-driven algorithms, the statistical properties of randomly generated datasets are critical. This study constructs a statistical measure called nearest-neighbor density to verify the asymptotic properties of randomly generated datasets and reveal the greedy behavior of learning-based solvers, i.e., always choosing the nearest neighbor nodes to construct the solution path. Based on this statistical measure, we develop interpretable data augmentation methods that rely on distribution shifts or instance perturbations and validate that the performance of the learning-based solvers degenerates much on such augmented data. Moreover, fine-tuning learning-based solvers with augmented data further enhances their generalization abilities. In short, we decipher the limitations of learning-based TSP solvers tending to be overly greedy, which may have profound implications for AI-empowered combinatorial optimization solvers.

组合优化深度学习泛化性贪心算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。