arXiv:2510.23535cs.LGcs.NE2025-10NeurIPS被引 8

解决算法配置中参数依赖问题,提升自动调优效果

Sequential Multi-Agent Dynamic Algorithm Configuration

  • 按参数依赖顺序设计多智能体强化学习框架
  • 在多目标优化任务中显著优于现有方法
  • 适合需要复杂参数协调的自动化调参场景

动态算法配置(DAC)是自动化机器学习的新趋势,可在执行过程中动态调整算法配置,减轻用户手动调参负担。近期多智能体强化学习(MARL)方法已能处理多个异构超参数的配置,实现复杂算法的多种参数组合。然而,许多复杂算法中的参数存在固有依赖关系(如先确定算子类型再设置其参数),而以往方法未考虑此类依赖,导致结果次优。本文提出顺序多智能体动态算法配置(Seq-MADAC)框架,通过引入序列优势分解网络,利用动作顺序信息建模参数间的依赖关系。实验从合成函数到多目标优化算法配置均表明,该方法在性能上超越当前最优的MARL方法,并在不同问题类别间表现出强泛化能力。该工作为依赖感知的自动化算法配置建立了新范式。代码已开源:https://github.com/lamda-bbo/seq-madac。

原文摘要 · Abstract (English)

Dynamic algorithm configuration (DAC) is a recent trend in automated machine learning, which can dynamically adjust the algorithm's configuration during the execution process and relieve users from tedious trial-and-error tuning tasks. Recently, multi-agent reinforcement learning (MARL) approaches have improved the configuration of multiple heterogeneous hyperparameters, making various parameter configurations for complex algorithms possible. However, many complex algorithms have inherent inter-dependencies among multiple parameters (e.g., determining the operator type first and then the operator's parameter), which are, however, not considered in previous approaches, thus leading to sub-optimal results. In this paper, we propose the sequential multi-agent DAC (Seq-MADAC) framework to address this issue by considering the inherent inter-dependencies of multiple parameters. Specifically, we propose a sequential advantage decomposition network, which can leverage action-order information through sequential advantage decomposition. Experiments from synthetic functions to the configuration of multi-objective optimization algorithms demonstrate Seq-MADAC's superior performance over state-of-the-art MARL methods and show strong generalization across problem classes. Seq-MADAC establishes a new paradigm for the widespread dependency-aware automated algorithm configuration. Our code is available at https://github.com/lamda-bbo/seq-madac.

算法配置多智能体强化学习自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。