arXiv:2409.19774cs.CV2024-09被引 5

用增强图像构建独立验证集,提升单源域泛化模型的训练与评估效果。

Crafting Distribution Shifts for Validation and Training in Single Source Domain Generalization

  • 通过多样增强生成模拟目标域分布偏移的独立验证集
  • 验证集性能与测试表现高度相关,方法选择准确率提升15.4%
  • 提出增强边缘图以增加形状偏差,适合追求鲁棒性的研究者

单源域泛化旨在仅使用源域数据训练模型并部署到未知目标域。仅访问源域数据带来两大挑战:如何训练具有泛化能力的模型,以及如何验证其泛化能力。标准做法在训练分布上验证无法准确反映模型泛化能力,而在测试分布上验证则是应避免的错误实践。本文通过综合增强手段对源域图像进行变换,构建一个独立的验证集,覆盖目标域中可能出现的广泛分布偏移。我们证明了多种方法在多个数据集上,验证性能与测试性能高度相关。所提验证方法在方法选择和学习率调优时分别实现15.4%和1.6%的相对准确率提升。此外,我们引入一类新方法,通过增强边缘图提升形状偏差。为在训练中利用增强同时保持验证集独立性,设计了k折验证机制,分离训练与验证所用增强类型。在增强验证集上表现最佳的方法在多个标准基准上达到当前最优性能。代码见:https://github.com/NikosEfth/crafting-shifts

原文摘要 · Abstract (English)

Single-source domain generalization attempts to learn a model on a source domain and deploy it to unseen target domains. Limiting access only to source domain data imposes two key challenges - how to train a model that can generalize and how to verify that it does. The standard practice of validation on the training distribution does not accurately reflect the model's generalization ability, while validation on the test distribution is a malpractice to avoid. In this work, we construct an independent validation set by transforming source domain images with a comprehensive list of augmentations, covering a broad spectrum of potential distribution shifts in target domains. We demonstrate a high correlation between validation and test performance for multiple methods and across various datasets. The proposed validation achieves a relative accuracy improvement over the standard validation equal to 15.4% or 1.6% when used for method selection or learning rate tuning, respectively. Furthermore, we introduce a novel family of methods that increase the shape bias through enhanced edge maps. To benefit from the augmentations during training and preserve the independence of the validation set, a k-fold validation process is designed to separate the augmentation types used in training and validation. The method that achieves the best performance on the augmented validation is selected from the proposed family. It achieves state-of-the-art performance on various standard benchmarks. Code at: https://github.com/NikosEfth/crafting-shifts

域泛化验证方法增强策略形状偏差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。