arXiv:2603.12244cs.LGcs.AI2026-03

提出可分解神经架构,统一建模物理、语言与感知中的复杂系统。

Separable neural architectures as a primitive for unified predictive and generative intelligence

  • 用低阶组件分解高维映射,通过约束交互阶数与张量秩实现结构化建模
  • 在湍流建模、语言生成等4个领域验证了其预测与生成能力
  • 适合需要统一处理确定性与分布式表示的跨领域智能系统研究

物理、语言与感知系统常具有可分解结构,但传统神经网络多为整体模型,未显式利用该结构。分离神经架构(SNA)形式化了一类统一加性、二次及张量分解模型的表征类别。通过限制交互阶数和张量秩,SNA 引入结构性归纳偏置,将高维映射分解为低元组件。分离性未必是系统本身的属性,而常在表达系统的坐标或表征中涌现。关键的是,这种坐标感知的表述揭示了混沌时空动力学与语言自回归之间的结构类比。通过将连续物理状态视为平滑可分解嵌入,SNA 实现对混沌系统的分布建模,缓解确定性算子的非物理解漂移问题,同时适用于离散序列。该方法在四个领域得到验证:基于强化学习的自主路径点导航、多功能微结构逆向生成、湍流分布建模及神经语言建模。结果表明,分离神经架构是一种适用于预测与生成智能的跨领域通用原语,能统一确定性与分布表示。

原文摘要 · Abstract (English)

Intelligent systems across physics, language and perception often exhibit factorisable structure, yet are typically modelled by monolithic neural architectures that do not explicitly exploit this structure. The separable neural architecture (SNA) addresses this by formalising a representational class that unifies additive, quadratic and tensor-decomposed neural models. By constraining interaction order and tensor rank, SNAs impose a structural inductive bias that factorises high-dimensional mappings into low-arity components. Separability need not be a property of the system itself: it often emerges in the coordinates or representations through which the system is expressed. Crucially, this coordinate-aware formulation reveals a structural analogy between chaotic spatiotemporal dynamics and linguistic autoregression. By treating continuous physical states as smooth, separable embeddings, SNAs enable distributional modelling of chaotic systems. This approach mitigates the nonphysical drift characteristics of deterministic operators whilst remaining applicable to discrete sequences. The compositional versatility of this approach is demonstrated across four domains: autonomous waypoint navigation via reinforcement learning, inverse generation of multifunctional microstructures, distributional modelling of turbulent flow and neural language modelling. These results establish the separable neural architecture as a domain-agnostic primitive for predictive and generative intelligence, capable of unifying both deterministic and distributional representations.

神经架构可分解生成建模跨领域

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。