用粗网格NCA+轻量解码器实现任意分辨率的自组织生成。
Neural Cellular Automata: From Cells to Pixels

- 用粗网格演化+隐式解码,突破分辨率瓶颈。
- 支持2D/3D网格与网格域的实时高分辨率输出。
- 保留生物启发的自组织特性,适合生成纹理与形态。
神经元胞自动机(NCAs)是受生物启发的动力系统,其中相同细胞通过迭代应用学习到的局部更新规则,自组织形成复杂模式,展现出再生、鲁棒性和自发动力学。尽管在纹理合成和形态发生中表现优异,现有NCAs仍受限于低分辨率输出。这主要源于:(1) 训练时间和内存随网格尺寸呈二次增长;(2) 信息严格局部传播,阻碍长程通信;(3) 高分辨率实时推理计算开销大。本文通过将一个在粗网格上演化的NCA与轻量级隐式解码器结合,将细胞状态与局部坐标映射为外观属性,使同一模型可生成任意分辨率输出。由于解码器与NCA更新均为局部操作,推理高度并行。为高效监督高分辨率输出,引入任务特异性损失,用于形态发生(从种子生长)和纹理合成,额外内存与计算开销极小。实验表明,该混合模型在2D/3D网格与网格域上均能实现实时高分辨率生成,并保持NCAs典型的自组织行为。
原文摘要 · Abstract (English)
Neural Cellular Automata (NCAs) are bio-inspired dynamical systems in which identical cells iteratively apply a learned local update rule to self-organize into complex patterns, exhibiting regeneration, robustness, and spontaneous dynamics. Despite their success in texture synthesis and morphogenesis, NCAs remain largely confined to low-resolution outputs. This limitation stems from (1) training time and memory requirements that grow quadratically with grid size, (2) the strictly local propagation of information that impedes long-range cell communication, and (3) the heavy compute demands of real-time inference at high resolution. In this work, we overcome this limitation by pairing an NCA that evolves on a coarse grid with a lightweight implicit decoder that maps cell states and local coordinates to appearance attributes, enabling the same model to render outputs at arbitrary resolution. Moreover, because both the decoder and NCA updates are local, inference remains highly parallelizable. To supervise high-resolution outputs efficiently, we introduce task-specific losses for morphogenesis (growth from a seed) and texture synthesis with minimal additional memory and computation overhead. Our experiments across 2D/3D grids and mesh domains demonstrate that our hybrid models produce high-resolution outputs in real-time, and preserve the characteristic self-organizing behavior of NCAs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。