arXiv:2602.05036cs.LG2026-02

用控制理论协调图自监督学习中的多个目标,避免冲突与失衡。

Feedback Control for Multi-Objective Graph Self-Supervision

  • 基于反馈控制思想,动态分配各目标的优化资源
  • 在9个数据集上超越现有方法,稳定提升性能
  • 可追踪每个目标的贡献,适合研究多任务训练机制

图自监督学习(SSL)提供了多种预训练目标:互信息、重构、对比学习等,但如何可靠地组合这些目标仍面临目标干扰与训练不稳定的挑战。现有方法依赖每轮更新的加权混合,导致三类失败模式:分歧(冲突引发负迁移)、漂移(目标效用非平稳)和干旱(次要目标被忽视)。本文提出,协调本质上是时间分配问题——决定何时为每个目标分配优化预算,而非仅调整权重。ControlG引入控制理论框架,通过估计各目标难度与相互对抗性,利用帕累托感知的对数超体积规划器设定目标预算,并采用比例-积分-微分(PID)控制器进行调度。在9个数据集上,ControlG持续优于当前最优基线,且生成可审计的学习调度轨迹,揭示各目标对学习的驱动作用。

原文摘要 · Abstract (English)

Can multi-task self-supervised learning on graphs be coordinated without the usual tug-of-war between objectives? Graph self-supervised learning (SSL) offers a growing toolbox of pretext objectives: mutual information, reconstruction, contrastive learning; yet combining them reliably remains a challenge due to objective interference and training instability. Most multi-pretext pipelines use per-update mixing, forcing every parameter update to be a compromise, leading to three failure modes: Disagreement (conflict-induced negative transfer), Drift (nonstationary objective utility), and Drought (hidden starvation of underserved objectives). We argue that coordination is fundamentally a temporal allocation problem: deciding when each objective receives optimization budget, not merely how to weigh them. We introduce ControlG, a control-theoretic framework that recasts multi-objective graph SSL as feedback-controlled temporal allocation by estimating per-objective difficulty and pairwise antagonism, planning target budgets via a Pareto-aware log-hypervolume planner, and scheduling with a Proportional-Integral-Derivative (PID) controller. Across 9 datasets, ControlG consistently outperforms state-of-the-art baselines, while producing an auditable schedule that reveals which objectives drove learning.

图学习自监督多任务优化控制理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。