arXiv:2605.01712cs.LG2026-05中稿 · ICIC 2026

让神经网络同时解决多个优化任务,还能自动发现任务间关联。

CoAction: Cross-task Correlation-aware Pareto Set Learning

论文配图:CoAction: Cross-task Correlation-aware Pareto Set Learning
图 1 · 摘自论文原文
  • 用任务感知的Transformer同时处理多个优化任务。
  • 在超体积、范围和稀疏性上表现优于现有方法。
  • 适合需要多目标协同优化的科研与工程场景。

Pareto集学习(PSL)是多目标优化中的新兴范式,通过训练神经网络将偏好向量映射为Pareto最优解。然而,现有方法通常只能一次性解决单一多目标优化问题。这不仅在多任务优化场景中增加计算开销(每个任务需独立建模),还忽略了任务间的潜在关联。为此,我们提出跨任务相关性感知的帕累托集学习框架CoAction,利用任务感知Transformer实现多任务并行处理。通过为每个任务分配特定嵌入向量,模型既能区分不同任务,又能促进任务间知识共享。采用Transformer编码器作为主干结构,利用其自注意力机制捕捉复杂的任务依赖关系。该方法在涵盖基准问题与真实应用的多任务测试套件上进行了评估,结果表明在超体积(Hypervolume)、范围(Range)和稀疏性(Sparsity)指标上均表现出色且具有竞争力。

原文摘要 · Abstract (English)

Pareto set learning (PSL) is an emerging paradigm in multi-objective optimization that trains neural networks to map preference vectors to Pareto optimal solutions. However, existing PSL methods primarily focus on solving a single multi-objective optimization problem at a time. This limitation not only increases computational costs in multi-objective multitask optimization scenarios by requiring a separate model for each task, but also fails to exploit the inter-task correlations across tasks. To address this, we propose a Cross-tAsk correlation-aware Pareto Set Learning (CoAction) framework, which leverages task-aware transformer to handle multiple tasks simultaneously. Specifically, by assigning task-specific embedding vectors to individual tasks, the model effectively distinguishes between tasks while facilitating knowledge sharing among them. We utilize a Transformer encoder as the backbone architecture to leverage its self-attention mechanism for capturing complex task dependencies. The proposed approach is evaluated on comprehensive multitask test suites covering both benchmark problems and real-world applications, demonstrating effectiveness and competitive performance in Hypervolume, Range, and Sparsity.

多目标优化Transformer多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。