arXiv:2409.12182cs.AIcond-mat.mtrl-sci2024-09被引 8

用大模型预测生命游戏,不依赖网格结构和边界条件。

LifeGPT: Topology-Agnostic Generative Pretrained Transformer Model for Cellular Automata

  • 用自回归Transformer建模生命游戏,无需预先知道网格大小或边界。
  • 在环面网格上实现近乎完美的规则还原,验证了通用计算潜力。
  • 可递归调用自身生成新状态,适合研究复杂系统演化机制。

康威生命游戏(Life)是细胞自动机中著名的算法,具有高度敏感的初始条件和复杂的涌现行为。在缺乏系统底层拓扑信息的情况下进行建模与预测,是一个重大挑战。为此,我们提出一种仅使用解码器的生成式预训练变压器(LifeGPT),可在未知网格尺寸和周期性边界条件下模拟生命游戏。LifeGPT对拓扑结构无感,实验表明,在足够多样化的训练数据下,该模型能以近似完美精度捕捉图灵完备系统的确定性规则。我们还引入‘自回归自回归’机制,通过LifeGPT递归实现生命游戏演进。结果为在大型语言模型框架内实现真正的通用计算铺平道路,融合数学分析与自然语言处理,并探索人工智能对算法演化过程的情境感知能力。类似的GPT模型有望从真实生物系统中提取兼容细胞自动机的规则集,解决多细胞自组装中的逆问题,推动仿生材料、组织工程与架构化材料设计的发展。

原文摘要 · Abstract (English)

Conway's Game of Life (Life), a well known algorithm within the broader class of cellular automata (CA), exhibits complex emergent dynamics, with extreme sensitivity to initial conditions. Modeling and predicting such intricate behavior without explicit knowledge of the system's underlying topology presents a significant challenge, motivating the development of algorithms that can generalize across various grid configurations and boundary conditions. We develop a decoder-only generative pretrained transformer (GPT) model to solve this problem, showing that our model can simulate Life on a toroidal grid with no prior knowledge on the size of the grid, or its periodic boundary conditions (LifeGPT). LifeGPT is topology-agnostic with respect to its training data and our results show that a GPT model is capable of capturing the deterministic rules of a Turing-complete system with near-perfect accuracy, given sufficiently diverse training data. We also introduce the idea of an `autoregressive autoregressor' to recursively implement Life using LifeGPT. Our results pave the path towards true universal computation within a large language model framework, synthesizing of mathematical analysis with natural language processing, and probing AI systems for situational awareness about the evolution of such algorithms without ever having to compute them. Similar GPTs could potentially solve inverse problems in multicellular self-assembly by extracting CA-compatible rulesets from real-world biological systems to create new predictive models, which would have significant consequences for the fields of bioinspired materials, tissue engineering, and architected materials design.

生命游戏生成模型细胞自动机通用计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。