arXiv:2601.16120stat.MLcs.LG2026-01被引 2

研究合成数据增广在数据不平衡时何时有效、何时有害及应加多少。

Synthetic Augmentation in Imbalanced Learning: When It Helps, When It Hurts, and How Much to Add

  • 提出统一统计框架分析合成增广效果
  • 发现增广可能恶化性能,尤其在局部对称情形
  • 推荐验证调优的合成样本量,避免盲目平衡

数据不平衡常导致标准训练偏向多数类,忽略少数但关键类别。常用方法是用合成样本增广少数类,但两个核心问题仍未解决:合成增广何时有效?应生成多少?本文建立统一统计框架,分析在不平衡数据上使用合成少数类样本训练的模型。理论表明,合成数据并非总有益;在“局部对称”情形下,不平衡非主要误差来源,增广无法提升学习率,反而因生成器不匹配放大误差,导致性能下降。当增广有效(“局部不对称”)时,最优合成样本量取决于生成器准确率及生成器残差偏差与真实类别偏移方向的一致性,可能导致最佳样本量偏离简单平衡。实践中建议采用验证调优的合成样本量(VTSS):在接近完全平衡的区间内,通过最小化平衡验证损失选择合成样本数,允许合理偏离。大量模拟和真实数据实验支持该结论。

原文摘要 · Abstract (English)

Imbalanced classification often causes standard training procedures to prioritize the majority class and perform poorly on rare but important cases. A classic and widely used remedy is to augment the minority class with synthetic samples, but two basic questions remain under-resolved: when does synthetic augmentation actually help, and how many synthetic samples should be generated? We develop a unified statistical framework for synthetic augmentation in imbalanced learning, studying models trained on imbalanced data augmented with synthetic minority samples. Our theory shows that synthetic data is not always beneficial. In a "local symmetry" regime, imbalance is not the dominant source of error, so adding synthetic samples cannot improve learning rates and can even degrade performance by amplifying generator mismatch. When augmentation can help ("local asymmetry"), the optimal synthetic size depends on generator accuracy and on whether the generator's residual mismatch is directionally aligned with the intrinsic majority-minority shift. This structure can make the best synthetic size deviate from naive full balancing. Practically, we recommend Validation-Tuned Synthetic Size (VTSS): select the synthetic size by minimizing balanced validation loss over a range centered near the fully balanced baseline, while allowing meaningful departures. Extensive simulations and real data analysis further support our findings.

数据不平衡合成数据增广策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。