用误差差距解释弱模型到强模型的性能提升,扩展到分类任务。
Relating Misfit to Gain in Weak-to-Strong Generalization Beyond the Squared Loss
- 基于Bregman散度构建弱-强模型性能增益的误差分析框架。
- 在分类任务中,强模型性能优于弱模型,误差随组合数量k增大而减小。
- 适用于实际场景中非凸模型结构,理论与实验验证兼备。
弱到强泛化范式指用弱AI模型标注的数据训练强AI模型,目标是让强模型在目标任务上表现超越其弱监督者。针对实值回归任务,已有研究通过强弱模型之间的偏差(misfit)定量刻画强模型的性能增益。本文将该分析推广至任意Bregman散度对应的损失函数,并在强模型类为凸的情况下成立。这使得交叉熵损失下的分类任务也可适用。然而在多数实际场景中,强模型类未必凸。为此,本文放宽假设,研究强模型类中k个模型的凸组合情形,在具体分类设置下仍获得基于误差点的性能增益刻画,附加误差项随k增大而消失。理论结果在合成及真实数据集上得到充分实验验证。
原文摘要 · Abstract (English)
The paradigm of weak-to-strong generalization constitutes the training of a strong AI model on data labeled by a weak AI model, with the goal that the strong model nevertheless outperforms its weak supervisor on the target task of interest. For the setting of real-valued regression with the squared loss, recent work quantitatively characterizes the gain in performance of the strong model over the weak model in terms of the misfit between the strong and weak model. We generalize such a characterization to learning tasks whose loss functions correspond to arbitrary Bregman divergences when the strong class is convex. This extends the misfit-based characterization of performance gain in weak-to-strong generalization to classification tasks, as the cross-entropy loss can be expressed in terms of a Bregman divergence. In most practical scenarios, however, the strong model class may not be convex. We therefore weaken this assumption and study weak-to-strong generalization for convex combinations of $k$ strong models in the strong class, in the concrete setting of classification. This allows us to obtain a similar misfit-based characterization of performance gain, upto an additional error term that vanishes as $k$ gets large. Our theoretical findings are supported by thorough experiments on synthetic as well as real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。