用变分贝叶斯优化测试时增强的权重,提升模型鲁棒性。
Test-Time Augmentation Meets Variational Bayes
- 基于各数据增强方法的贡献度,构建加权TTA框架。
- 优化权重以最大化边缘对数似然,提升预测性能。
- 可自动抑制无效增强,适合高可靠性场景应用。
数据增强显著提升机器学习模型的鲁棒性,通常在训练阶段使用。测试时增强(TTA)则在测试阶段利用数据增强,通过对同一实例的多次增强结果取平均得到最终预测。尽管TTA的成效已被实证验证,其性能仍取决于所用增强方法的集合。不同增强方法对性能的贡献程度不一,部分无效增强可能降低预测效果。本文提出一种基于各增强方法贡献度的加权TTA,并将其形式化为变分贝叶斯框架。通过最大化边缘对数似然来优化权重,可有效抑制测试阶段中表现不佳的增强方法,从而提升整体性能。
原文摘要 · Abstract (English)
Data augmentation is known to contribute significantly to the robustness of machine learning models. In most instances, data augmentation is utilized during the training phase. Test-Time Augmentation (TTA) is a technique that instead leverages these data augmentations during the testing phase to achieve robust predictions. More precisely, TTA averages the predictions of multiple data augmentations of an instance to produce a final prediction. Although the effectiveness of TTA has been empirically reported, it can be expected that the predictive performance achieved will depend on the set of data augmentation methods used during testing. In particular, the data augmentation methods applied should make different contributions to performance. That is, it is anticipated that there may be differing degrees of contribution in the set of data augmentation methods used for TTA, and these could have a negative impact on prediction performance. In this study, we consider a weighted version of the TTA based on the contribution of each data augmentation. Some variants of TTA can be regarded as considering the problem of determining the appropriate weighting. We demonstrate that the determination of the coefficients of this weighted TTA can be formalized in a variational Bayesian framework. We also show that optimizing the weights to maximize the marginal log-likelihood suppresses candidates of unwanted data augmentations at the test phase.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。