基于杨-巴克斯特方程设计可稳定处理长序列的混合层。
An Integrable Token Mixing Layer from the Generalized Yang Baxter Equation
- 利用杨-巴克斯特代数构造保范正交映射，保证计算稳定。
- 生成的转移矩阵可交换，实现顺序无关推理与灵活长度适配。
- 采用谱循环生成器，支持长序列泛化，适合高精度序列建模。
YB Mixer 是一种源自自由费米子与广义杨-巴克斯特结构的序列标记混合层。它基于可积系统中的核心原理：局部代数约束确保全局计算稳定性。通过伊辛交换代数，该方法构建了自由费米子结构，形成精确保范的正交映射。该代数还生成可交换的转移矩阵，使推理过程顺序无关，并能适应任意可变预算。为提升模型对更长序列的泛化能力，采用谱循环生成器，维持系统的关键正交性与可交换性。最终实现一种高度稳定且数学严谨的序列处理架构。
原文摘要 · Abstract (English)
The YB Mixer is a sequence token mixing layer derived from free fermion and generalized Yang Baxter structures. It applies a core principle from integrable systems where a local algebraic constraint guarantees global computational stability. By using the Ising exchange algebra the mixer creates a free fermionic structure that acts as an exactly norm preserving orthogonal map. This algebra also produces commuting transfer matrices which allow inference to be order free and adaptable to any variable budget. To ensure the model can generalize to longer sequence lengths it uses a spectral circulant generator. This generator maintains the crucial orthogonal and commuting properties of the system. The result is a highly stable and mathematically grounded architecture for sequence processing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。