arXiv:2608.10096stat.MLcs.LG2026-08

提出自适应切换策略,让GAN训练更智能地决定何时更新生成器或判别器。

Deciding When to Switch: E-Processes for Adaptive Minimax Training for Generative Adversarial Nets

论文配图:Deciding When to Switch: E-Processes for Adaptive Minimax Training for Generative Adversarial Nets
图 1 · 摘自论文原文
  • 用序贯假设检验建模训练中切换时机问题,基于e过程实现动态决策。
  • 在多种数据集上表现优于固定比例方法,保持严格统计误差控制。
  • 适合需要动态调整训练策略的GAN研究者,尤其关注可靠性与自动化。

现代数据科学催生了大量无法用预设统计模型参数描述的假设检验问题。一个典型例子是优化算法的动态评估,需在训练过程中判断继续更新是否仍有效,或应转入新阶段。这一问题在随机极小极大优化中尤为突出。生成对抗网络(GAN)是经典案例,其训练需反复决定何时在判别器和生成器更新间切换,但现有方法多依赖固定更新比例或启发式规则。本文将切换问题建模为序贯假设检验,提出基于e过程的自适应训练方法。在判别器更新时,通过一个e过程检验零假设:判别器诱导的样本分布与生成分布之间的分离度低于目标水平;在生成器更新时,固定判别器,另一e过程检验相反零假设:该分离度仍高于刷新水平。在给定训练样本条件下,我们证明了可利用经验指标与潜在抽样生成条件e值,并累积为e过程,在自适应模型更新和数据相关切换下提供任意时刻有效的第一类错误控制。在多模态合成分布及图像基准数据集上,该方法在多种主流GAN目标下表现匹配或超越最优固定比例基线。

原文摘要 · Abstract (English)

Modern data science increasingly gives rise to hypothesis-testing problems that are not naturally formulated in terms of parameters within prespecified statistical models. One important example is the dynamic evaluation of optimization algorithms, where decisions must be made during training about whether further updates remain beneficial or the algorithm should switch to a different phase. This issue is particularly relevant in stochastic min-max optimization. Generative adversarial networks (GANs) provide a canonical example, as their training requires repeated decisions about when to switch between discriminator and generator updates, yet existing methods typically rely on fixed update ratios or heuristic criteria. We formulate this switching problem as sequential hypothesis testing and develop an e-process-based adaptive training procedure. During discriminator updates, one e-process tests the null that the discriminator-induced separation between the empirical data distribution and the generator law remains below a target level. During generator updates, with the discriminator fixed, a second e-process tests the reverse null that this separation remains above a refresh level. Conditional on the observed training sample, we prove that fresh empirical indices and latent draws yield conditional e-values that can be accumulated into e-processes, providing anytime-valid Type I error control under adaptive model updates and data-dependent switching. Across multimodal synthetic distributions and image benchmark datasets, the proposed method matches or outperforms the best fixed-ratio baselines under several widely used GAN objectives.

GAN自适应训练统计检验e过程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。