用语言游戏打破大模型数据循环,推动超人类智能发展
Language Games as the Pathway to Artificial Superhuman Intelligence
- 构建多智能体语言游戏,动态切换角色提升数据多样性
- 引入多元奖励机制,驱动复杂智能行为涌现
- 规则可变演化,持续注入新奇性,适合研究通用智能的学者
大型语言模型向人工超人类智能(ASI)演进依赖于数据再生,即模型生成、筛选并重新训练新数据以提升能力。然而当前方法易陷入数据再生陷阱:在固定的人类生成分布中闭环优化,导致模型仅重组已有知识而无法探索新领域。本文提出语言游戏作为突破路径,通过三个机制实现数据再生扩展:(1) 角色流动性,使多智能体系统在任务间动态切换角色,增强数据多样性和覆盖;(2) 奖励多样性,嵌入多种反馈标准,驱动复杂智能行为;(3) 规则可塑性,迭代演化交互约束,促进可学习性,持续注入新颖性。将语言游戏扩展为全球社会技术生态系统,人机共演化产生无限数据流,推动开放探索。该框架将数据再生从封闭循环重构为超人类智能的驱动力。
原文摘要 · Abstract (English)
The evolution of large language models (LLMs) toward artificial superhuman intelligence (ASI) hinges on data reproduction, a cyclical process in which models generate, curate and retrain on novel data to refine capabilities. Current methods, however, risk getting stuck in a data reproduction trap: optimizing outputs within fixed human-generated distributions in a closed loop leads to stagnation, as models merely recombine existing knowledge rather than explore new frontiers. In this paper, we propose language games as a pathway to expanded data reproduction, breaking this cycle through three mechanisms: (1) \textit{role fluidity}, which enhances data diversity and coverage by enabling multi-agent systems to dynamically shift roles across tasks; (2) \textit{reward variety}, embedding multiple feedback criteria that can drive complex intelligent behaviors; and (3) \textit{rule plasticity}, iteratively evolving interaction constraints to foster learnability, thereby injecting continual novelty. By scaling language games into global sociotechnical ecosystems, human-AI co-evolution generates unbounded data streams that drive open-ended exploration. This framework redefines data reproduction not as a closed loop but as an engine for superhuman intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。