arXiv:2509.08972cs.AIcs.LG2025-09被引 1

用自信度筛选训练数据,防止生成模型因自循环而退化。

ForTIFAI: Fending Off Recursive Training Induced Failure for AI Model Collapse

  • 通过截断交叉熵损失,忽略高置信度生成词,过滤机器伪影。
  • 使用TCE训练的模型可承受2.3倍以上合成数据才出现退化。
  • 适合关注合成数据训练下模型鲁棒性的研究者与工程师。

随着生成式AI模型应用日益广泛,合成数据量迅速增长,预计到2030年大部分新训练数据可能为机器生成。这种以合成数据为主导的转变带来了严峻挑战:反复使用合成数据训练会导致模型退化现象,即模型性能随代际训练不断下降,最终失效。尽管模型退化原因逐渐明确,但有效缓解策略仍有限。本文基于自回归模型倾向于生成高置信度(高对数似然)文本序列这一观察,提出截断交叉熵(TCE)损失函数。TCE通过在训练中选择性忽略高置信度标记,有效过滤出可能的机器生成伪影。实验表明,采用TCE训练的模型不仅学习效果良好,且表现出显著更强的抗退化能力,在退化发生前可处理超过2.3倍的合成数据。此外,我们发布了首个混合数据场景下的模型退化动态开源基准。结果表明,基于置信度的训练目标能显著延缓退化时间,为合成数据暴露下的模型鲁棒性提供一种实用且普适的解决方案。

原文摘要 · Abstract (English)

The increasing reliance on generative AI models is rapidly increasing the volume of synthetic data, with some projections suggesting that most available new data for training could be machine-generated by 2030. This shift to a mainly synthetic content presents a critical challenge: repeated training in synthetic data leads to a phenomenon known as model collapse, where model performance degrades over generations of training, eventually rendering the models ineffective. While the causes of model collapse are increasingly understood, effective mitigation strategies remain scarce. We address this challenge by leveraging a key insight: auto-regressive models tend to generate text sequences to which they assign high confidence (i.e., high log-likelihood). Based on this observation, we introduce the Truncated-Cross-Entropy (TCE) loss function. TCE mitigates collapse by selectively ignoring high-confidence tokens during training, effectively filtering out likely machine-generated artifacts from the learning process. Our experiments demonstrate that models trained with TCE not only learn effectively but also exhibit significantly increased resilience, tolerating over 2.3x more synthetic data before the onset of collapse. In addition, we provide an open-source benchmark for collapse dynamics in mixed-data settings. Our results demonstrate that confidence-aware training objectives can substantially delay collapse onset, offering a practical and generalizable tool for model robustness under synthetic-data exposure.

模型退化生成模型合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。