研究多模型交互中生成模型性能下降的临界条件。
When Does Model Collapse Occur in Structured Interactive Learning?

- 用有向图建模多模型交互关系,分析拓扑结构影响。
- 给出模型崩溃发生与否的精确判据,涵盖线性与一般估计量。
- 适用于关注生成模型迭代稳定性的研究人员。
生成式人工智能的普及催生了交互式学习环境,其中模型参数不仅基于自然数据更新,还不断使用其他模型生成的合成输出进行训练。这一范式带来两大挑战:(1) 训练数据不再仅来自目标分布,违背经典统计学习的核心假设;(2) 模型训练过程因反复暴露于彼此的合成输出而相互关联,形成复杂依赖。在此类结构化交互学习环境中实现可靠统计推断仍是开放难题。尤其令人担忧的是模型崩溃现象——生成模型在持续训练于前代模型产生的合成数据时,性能逐步退化。以往研究主要聚焦单一模型自反馈训练,无法刻画多模型交互场景下的性能变化。本文通过引入有向图形式化模型交互模式,揭示模型崩溃的发生取决于交互图的拓扑结构。我们进一步推导出模型崩溃发生的充要条件,并为线性回归提供有限样本结果,对一般M-estimator建立渐近保证。数值实验验证了理论发现。
原文摘要 · Abstract (English)
The proliferation of generative artificial intelligence has given rise to an interactive learning environment, where model parameters are continuously updated using not only data generated by natural processes, but also synthetic outputs produced by other models. This paradigm introduces two major challenges: (1) training data are no longer drawn exclusively from the target population, undermining a core assumption of classical statistical learning, and (2) model training processes become inherently correlated, as models interact with one another through repeated exposure to each other's synthetic outputs in a potentially complex manner. Establishing reliable statistical inference in such structured interactive learning environments therefore remains an important open problem. In particular, there is growing concern about model collapse, a phenomenon in which the performance of generative models progressively degrades as they are trained on synthetic data produced by earlier model generations. Prior work on model collapse primarily focuses on a single model trained on its own output, failing to capture model performance in multi-model interactive settings. In this work, we fill this gap by investigating the performance of generative models in an interactive learning environment with general interaction patterns. In particular, we formalize model interactions using directed graphs and show that the occurrence of model collapse depends critically on the topology of the interaction graph. We further derive an explicit necessary and sufficient condition characterizing when model collapse occurs, and establish finite-sample results for linear regression and asymptotic guarantees for general M-estimators. We support our theoretical findings through extensive numerical experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。