arXiv:2511.15199cs.NEcs.LG2025-11被引 2

用强化学习自动决定迁移任务、内容和方式,提升多任务优化效率。

Learning Where, What and How to Transfer: A Multi-Role Reinforcement Learning Approach for Evolutionary Multitasking

  • 设计三类智能体分别决策迁移目标、精英解比例和迁移强度。
  • 在多个任务上实现优于基线的性能,收敛速度更快。
  • 适合需要自适应知识迁移的复杂优化场景。

进化多任务(EMT)算法通常需要针对知识迁移进行定制化设计,以保证多任务优化中的收敛性和最优性。本文探索通过强化学习构建系统化且可泛化的知识迁移策略。首先识别三大挑战:确定迁移任务(where)、迁移内容(what)以及迁移机制(how)。为此,提出一个多角色强化学习框架,三个(组)策略网络作为专用智能体:任务路由智能体采用基于注意力的相似性识别模块,通过注意力分数确定源-目标迁移对;知识控制智能体决定迁移精英解的比例;一组策略适配智能体通过动态调节底层EMT框架中的超参数来控制迁移强度。通过在增强的多任务问题分布上端到端预训练所有网络模块,获得可泛化的元策略。大量验证实验表明,该方法在代表性基线中表现达到领先水平。深入分析不仅揭示了方案的有效性,还提供了系统所学内容的深刻解读。

原文摘要 · Abstract (English)

Evolutionary multitasking (EMT) algorithms typically require tailored designs for knowledge transfer, in order to assure convergence and optimality in multitask optimization. In this paper, we explore designing a systematic and generalizable knowledge transfer policy through Reinforcement Learning. We first identify three major challenges: determining the task to transfer (where), the knowledge to be transferred (what) and the mechanism for the transfer (how). To address these challenges, we formulate a multi-role RL system where three (groups of) policy networks act as specialized agents: a task routing agent incorporates an attention-based similarity recognition module to determine source-target transfer pairs via attention scores; a knowledge control agent determines the proportion of elite solutions to transfer; and a group of strategy adaptation agents control transfer strength by dynamically controlling hyper-parameters in the underlying EMT framework. Through pre-training all network modules end-to-end over an augmented multitask problem distribution, a generalizable meta-policy is obtained. Comprehensive validation experiments show state-of-the-art performance of our method against representative baselines. Further in-depth analysis not only reveals the rationale behind our proposal but also provide insightful interpretations on what the system have learned.

进化计算强化学习多任务优化知识迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。