用图结构优化多任务,实现高效知识迁移与性能提升。
Multi-Task Optimization over Networks of Tasks

- 将任务空间建模为图,节点为任务,边连接参数相近的任务。
- 在4个领域共1.2万个任务上表现优于或等同于现有方法。
- 适合大规模多任务优化,尤其擅长利用任务间拓扑关系。
多任务优化能并行解决大量任务,但现有算法存在明显局限:基于种群的方法扩展性差,且对大规模任务集研究不足;可扩展至数千任务的方法多为MAP-Elites变体,依赖固定离散存档,忽略任务空间拓扑结构。本文提出MONET(Multi-Task Optimization over Networks of Tasks),将任务空间建模为图结构:任务作为节点,任务参数空间中相近的任务通过边连接。该表示支持任务间知识迁移,同时保持高维问题的可处理性,并利用任务空间拓扑。MONET结合社会学习(通过交叉从邻近节点生成候选解)与个体学习(通过突变独立优化自身解)。在四个领域(射箭、机械臂、小车推杆各5,000任务;六足机器人2,000任务)进行评估,结果表明其性能在所有场景中均达到或超过现有MAP-Elites基线。
原文摘要 · Abstract (English)
Multi-task optimization is a powerful approach for solving a large number of tasks in parallel. However, existing algorithms face distinct limitations: Population-based methods scale poorly and remain underexplored for large task sets. Approaches that do scale beyond a thousand tasks are mostly MAP-Elites variants and rely on a fixed, discretized archive that disregards the topology of the task space. We introduce MONET (Multi-Task Optimization over Networks of Tasks), a multi-task optimization algorithm that models the task space as a graph: tasks are nodes, and edges connect tasks in the task parameter space. This representation enables knowledge transfer between tasks and remains tractable for high-dimensional problems while exploiting the topology of the task space. MONET combines social learning, which generates candidates from neighboring nodes via crossover, with individual learning, which refines a node's own solution independently via mutation. We evaluate MONET on four domains (archery, arm, and cartpole with 5,000 tasks each; hexapod with 2,000 tasks) and show that it matches or exceeds the performance of existing MAP-Elites-based baselines across all four domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。