arXiv:2606.28123cs.LGmath.OC2026-06

证明非仿射聚合会破坏收敛性,仅仿射聚合能保证稳定学习。

Dangerous Liaisons of Convex Learning and Non-Affine Aggregation

  • 证明非仿射聚合无法保持梯度更新单调性
  • 非仿射聚合导致算法稳定性下降,收敛性受损
  • 给出恢复单调性的条件,适用于自适应/隐私/公平等场景

一阶凸优化中的最后迭代收敛性和泛化性依赖于更新算子的单调性。线性平均可保持梯度更新的单调性,但在现代包含自适应、隐私、鲁棒性或公平性约束的系统中,非仿射聚合常破坏该性质。本文证明:仅当聚合规则为正仿射时,聚合梯度的单调性才能被保持。因此,非仿射聚合会阻止稳定收敛并显著降低算法稳定性。我们量化了这些缺陷,并提出恢复单调性的充分条件。研究结果为现代学习系统中观察到的多种失效模式提供了统一理论解释。

原文摘要 · Abstract (English)

Last-iterate convergence and generalization guarantees in first-order convex learning hinge on the monotonicity of the update operator. While linear averaging preserves the monotonicity of gradient updates, this property is often violated when gradients are aggregated non-affinely, as in modern pipelines enforcing constraints like adaptivity, privacy, robustness or fairness. Whether it is possible to design non-affine aggregation rules that maintain monotonicity has remained an open question. We answer this question negatively: we prove that the monotonicity of aggregated gradients is preserved if and only if the aggregation rule is positively affine. Consequently, non-affine aggregation prevents steady convergence and substantially degrade algorithmic stability. We quantify these drawbacks and propose a path forward by identifying sufficient conditions under which monotonicity can be restored. Our results provide a unified theoretical framework explaining the disparate failure modes observed in modern learning systems.

凸优化收敛性聚合机制算法稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。