研究智能爆炸的数学机制,揭示快速迭代中生成时长的关键作用。
The Dynamics of Intelligence Explosions
- 分析智能反馈循环的数学动态,关注生成时长对增长的影响。
- 发现超指数增长不必然导致奇点,存在非奇点的极快增长路径。
- 强调生成时长趋近零是实现奇点增长的必要条件,被广泛忽视。
人工智能正越来越多地用于辅助人工智能研发。在特定条件下,这种反馈循环可能引发智能爆炸,使人工智能能力迅速飙升。本文探讨了最剧烈可能性的数学机制,重点理解其驱动动力。研究表明,趋向垂直渐近线的奇异增长比近期受经济学启发的模型所预测的更难实现;同时,存在一类被忽视但增速超过指数级、却不会导致垂直渐近线的增长模式。文章强调生成时长(即完成一次反馈循环所需时间)这一关键参数的重要性——若生成时长不迅速趋近于零,则无法实现奇异增长。
原文摘要 · Abstract (English)
AI is increasingly being used to help with AI R&D. Under certain conditions this feedback loop might be able to produce an intelligence explosion, with rapidly escalating AI capabilities. I explore the mathematics of the most explosive possibilities, with an eye to understanding what drives the dynamics. I show that singular growth (towards a vertical asymptote) is harder to achieve than would be expected from recent economics-inspired modelling, and that there is an important but neglected class of growth rates that are faster than exponential but don't lead to a vertical asymptote. I draw out the generation time (the time to go around the feedback loop) as a neglected parameter that plays a pivotal role in determining the behaviour of any intelligence explosion --- one cannot have singular growth unless the generation time rapidly approaches zero.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。