arXiv:2605.15219cs.AIcs.IT2026-05中稿 · outputs reshape fu…

AI知识发现有极限,自进化循环可能陷入无效重复或错误累积。

NOVA: Fundamental Limits of Knowledge Discovery Through AI

  • 将AI知识发现建模为生成、验证、积累、重训的自适应采样过程。
  • 当验证不完美时,假阳性会加速错误传播,导致真知识发现停滞。
  • 锚定基础分布可防止生成偏离,保障长期发现效率,适合研究者参考。

AI能否通过迭代自我改进发现新知识?我们提出NOVA,将‘生成、验证、积累、重训’循环建模为知识空间上的自适应采样过程。给出了累积真实知识覆盖有限域的充分条件,并揭示了违反条件导致的污染、遗忘、探索失败和接受失败。在显式分布模型中,我们识别出递归反馈的相变现象:无锚定反馈可能锁定早期接受结果,使初始可达的有效知识无法被发现。锚定更新至持久基分布可防止无限失真并保证持续暴露。在验证不完美时,我们发现‘污染陷阱’:当易得知识耗尽后,即使微小的假阳性率也会使无效成果的引入快于真实发现。我们证明Good–Turing估计仅是局部批次多样性诊断工具,而非历史未发现有效质量的估计量。当有效基分布具有指数α>1的齐普夫尾时,获得D个不同真实发现的累计生成成本满足R_cum(D)=Θ(c_gen D^α)。锚定重训可维持该标度律所需曝光。最后,我们展示人类引导、生成与验证如何在自主采样停滞时重新引导或扩展发现。

原文摘要 · Abstract (English)

Can AI systems discover new knowledge through iterative self-improvement, and at what cost? We introduce NOVA, which models the ``generate, verify, accumulate, retrain'' loop as an adaptive sampling process over a knowledge space. We give sufficient conditions for accumulated genuine knowledge to cover a finite domain and show how violations produce contamination, forgetting, exploration failure, and acceptance failure. We then analyze how adaptive generation arises from recursive retraining. In an explicit distribution-level model where accepted artifacts influence the next generator, we identify a recursive-feedback phase transition. Unanchored feedback can lock generation onto early accepted artifacts and leave initially reachable valid artifacts undiscovered with positive probability. Anchoring updates to a persistent base distribution prevents unbounded distortion and guarantees continued exposure. Under imperfect verification, we identify a contamination trap: as easy knowledge is exhausted, even small false-positive rates can admit invalid artifacts faster than genuine discoveries. We show that Good--Turing estimation is a local batch-diversity diagnostic, not an estimator of the historically undiscovered valid mass governing long-term progress. Under a Zipf tail with exponent $α>1$, the cumulative generation cost of obtaining $D$ distinct genuine discoveries satisfies $R_{\rm cum}(D)=Θ(c_{\rm gen}D^α)$. When the valid base distribution has such a tail, anchored retraining preserves the exposure needed for this scaling law. Finally, we show how human guidance, generation, and verification can redirect or expand discovery when autonomous sampling stalls because of repetition, vanishing exposure, or unreliable verification.

AI发现知识探索自进化反馈机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。