arXiv:2409.05202cs.LGcs.AI2024-09综述被引 37

系统梳理Mixup数据增强方法及其应用,助力模型泛化与迁移。

A Survey on Mixup Augmentations and Beyond

  • 以统一框架整合多种Mixup方法,明确操作流程
  • 验证其在视觉任务中提升模型性能的普适性
  • 适合关注数据增强与模型泛化的研究人员参考

深度神经网络在过去十年取得了令人瞩目的突破,当大规模标注数据不可得时,数据增强作为正则化技术日益受到关注。在现有方法中,Mixup及其相关数据混合方法因能通过凸组合生成依赖数据的虚拟样本并实现跨领域轻松迁移,被广泛采用。本文全面综述了基础Mixup方法及其应用,首先阐述包含模块的混合训练流程,并提出可容纳多种方法的重构框架,提供直观操作路径。随后系统分析其在视觉下游任务、多模态数据上的应用,并探讨相关理论与定理。同时总结当前研究状态与局限,指明未来高效有效混合方法的发展方向。本综述可为研究人员提供当前Mixup领域的前沿进展,并提供实践指导。配套在线项目已发布于 https://github.com/Westlake-AI/Awesome-Mixup。

原文摘要 · Abstract (English)

As Deep Neural Networks have achieved thrilling breakthroughs in the past decade, data augmentations have garnered increasing attention as regularization techniques when massive labeled data are unavailable. Among existing augmentations, Mixup and relevant data-mixing methods that convexly combine selected samples and the corresponding labels are widely adopted because they yield high performances by generating data-dependent virtual data while easily migrating to various domains. This survey presents a comprehensive review of foundational mixup methods and their applications. We first elaborate on the training pipeline with mixup augmentations as a unified framework containing modules. A reformulated framework could contain various mixup methods and give intuitive operational procedures. Then, we systematically investigate the applications of mixup augmentations on vision downstream tasks, various data modalities, and some analysis \& theorems of mixup. Meanwhile, we conclude the current status and limitations of mixup research and point out further work for effective and efficient mixup augmentations. This survey can provide researchers with the current state of the art in mixup methods and provide some insights and guidance roles in the mixup arena. An online project with this survey is available at https://github.com/Westlake-AI/Awesome-Mixup.

数据增强Mixup深度学习综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。