arXiv:2409.04367cs.LGcs.AI2024-09中稿 · TMLR被引 12

为参数化算法配置提供理论保障,突破传统方法限制

Algorithm Configuration for Structured Pfaffian Settings

  • 提出Pfaffian GJ框架,扩展经典GJ框架适用范围
  • 证明多种参数化算法的效用函数具可学习的分段结构
  • 适合研究算法自动配置与理论保障的学者

数据驱动的算法设计通过在特定应用领域中调整算法超参数来提升性能。该方法基于目标领域问题实例的分布,通过最大化衡量算法性能的实证效用函数来优化超参数。尽管已有实证支持其有效性,但为多个参数化算法族提供理论保证仍具挑战性,原因在于其效用函数通常具有分段不连续的复杂结构。本文提出改进框架,在分布学习与在线学习设置下为参数化数据驱动算法设计问题提供学习保证。针对分布学习场景,引入了Pfaffian GJ框架,它是经典GJ框架的扩展,可处理涉及佩弗安(Pfaffian)函数的函数类。与仅限于有理函数的GJ框架不同,新框架能处理更广泛且更具应用性的函数类。我们进一步证明,许多感兴趣的参数化算法的效用函数具备‘精细化分段结构’,从而可通过所提框架自动获得学习保证。

原文摘要 · Abstract (English)

Data-driven algorithm design automatically adapts algorithms to specific application domains, achieving better performance. In the context of parameterized algorithms, this approach involves tuning the algorithm's hyperparameters using problem instances drawn from the problem distribution of the target application domain. This can be achieved by maximizing empirical utilities that measure the algorithms' performance as a function of their hyperparameters, using problem instances. While empirical evidence supports the effectiveness of data-driven algorithm design, providing theoretical guarantees for several parameterized families remains challenging. This is due to the intricate behaviors of their corresponding utility functions, which typically admit piecewise discontinuous structures. In this work, we present refined frameworks for providing learning guarantees for parameterized data-driven algorithm design problems in both distributional and online learning settings. For the distributional learning setting, we introduce the \textit{Pfaffian GJ framework}, an extension of the classical \textit{GJ framework}, that is capable of providing learning guarantees for function classes for which the computation involves Pfaffian functions. Unlike the GJ framework, which is limited to function classes with computation characterized by rational functions, our proposed framework can deal with function classes involving Pfaffian functions, which are much more general and widely applicable. We then show that for many parameterized algorithms of interest, their utility function possesses a \textit{refined piecewise structure}, which automatically translates to learning guarantees using our proposed framework.

算法配置理论保障佩弗安函数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。