arXiv:2504.00603cs.LGcs.AI2025-04中稿 · IEEE Transactions …被引 3

提出新方法识别并清除生成对抗网络中的有害训练样本,提升生成质量。

Data Cleansing for GANs

  • 通过雅可比矩阵估算生成器与判别器间的间接影响,定位有害样本。
  • 基于Inception Score等指标变化评估样本危害性,移除后性能显著提升。
  • 适用于各类生成任务,尤其适合数据质量参差的场景。

随着生成对抗网络(GAN)应用的扩展,亟需一种统一方法以提升各类生成任务的性能。一个通用策略是识别有害训练样本并将其移除,从而改善模型表现。尽管已有研究在监督学习中成功估计了此类有害样本,但其方法难以直接应用于GAN。主要原因有二:一是传统方法要求样本缺失直接影响模型参数,而GAN中样本仅输入判别器,不直接作用于生成器参数;二是传统方法假设损失变化可量化样本危害性,但常见GAN损失并不总反映生成性能。为解决第一问题,本文提出利用生成器梯度对判别器参数的雅可比矩阵(反之亦然),衡量两模型间的间接影响——即移除判别器训练样本如何改变生成器参数。其次,提出基于生成评估指标(如Inception Score)预期变化的样本评估方案,量化其危害性。实验表明,移除所识别的有害样本后,在多种GAN评价指标上均显著提升生成性能。

原文摘要 · Abstract (English)

As the application of generative adversarial networks (GANs) expands, it becomes increasingly critical to develop a unified approach that improves performance across various generative tasks. One effective strategy that applies to any machine learning task is identifying harmful instances, whose removal improves the performance. While previous studies have successfully estimated these harmful training instances in supervised settings, their approaches are not easily applicable to GANs. The challenge lies in two requirements of the previous approaches that do not apply to GANs. First, previous approaches require that the absence of a training instance directly affects the parameters. However, in the training for GANs, the instances do not directly affect the generator's parameters since they are only fed into the discriminator. Second, previous approaches assume that the change in loss directly quantifies the harmfulness of the instance to a model's performance, while common types of GAN losses do not always reflect the generative performance. To overcome the first challenge, we propose influence estimation methods that use the Jacobian of the generator's gradient with respect to the discriminator's parameters (and vice versa). Such a Jacobian represents the indirect effect between two models: how removing an instance from the discriminator's training changes the generator's parameters. Second, we propose an instance evaluation scheme that measures the harmfulness of each training instance based on how a GAN evaluation metric (e.g., Inception score) is expected to change by the instance's removal. Furthermore, we demonstrate that removing the identified harmful instances significantly improves the generative performance on various GAN evaluation metrics.

GAN数据清洗生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。