arXiv:2606.18315cs.LGcs.AI2026-06

用动态系统设计高效序列生成器,实现低延迟高精度闭环控制。

Ghost Attractor Networks: Basin-Structured Dynamical Decoders for Closed-Loop Sequential Generation

论文配图:Ghost Attractor Networks: Basin-Structured Dynamical Decoders for Closed-Loop Sequential Generation
图 1 · 摘自论文原文
  • 构建基于势能场的动态解码器,天然形成稳定吸引盆结构。
  • 参数量仅230万却达到10.7亿参数扩散模型的精度,延迟降低32倍。
  • 适合需要稳定状态记忆的机器人动作生成等闭环任务。

大规模Transformer与扩散解码器在序列生成中内存开销随序列长度增长,且需迭代计算。用小型前馈解码器虽提升效率,但产生的隐状态无结构,难以支持闭环控制中的相位条件动作生成与跨步隐状态传递。本文提出幽灵吸引子网络(Ghost Attractor Networks),一种理论推导的动态解码器,其隐状态在学习到的势能场驱动下演化,自动生成吸引盆结构。三个目标(多模态、单次通过切换、恒定内存)推动采用势能-漂移形式,模式转换表现为鞍结分岔与幽灵吸引子逃逸。层级相空间分解分离一阶吸引盆收敛与二阶本体感知精炼。实验表明,端到端训练的幽灵解码器在1430个样本上,5步积分内梯度范数下降67%。作为机器人动作解码器,230万参数的幽灵模型在离线任务中性能媲美10.7亿参数的扩散Transformer,参数减少462倍,延迟降低32倍;优于五种200万参数替代方案(MLP、Neural ODE、CVAE、Transformer、1步扩散),误差降低5.9至29%。在LIBERO-10闭环基准测试中,幽灵模型的相位条件控制使成功率提升13.5个百分点,持久隐状态集成最终达成95.7%成功率。

原文摘要 · Abstract (English)

Sequential output generation with large-scale Transformer and diffusion decoders pays a memory cost that grows with sequence length, plus iterative per-step computation. Replacing them with small feed-forward decoders restores efficiency but produces unstructured latent representations that limit closed-loop control: phase-conditioned action generation and cross-step latent carry-over both require a latent geometry with stable basins. This article proposes Ghost Attractor Networks, a theoretically derived dynamical decoder whose latent evolves under a learned potential with drift and produces a basin-attractor structure by construction. Three desiderata (multi-modality, decoder-level single-pass switching, and constant memory) motivate the potential-drift form, and mode transitions arise as saddle-node bifurcations with ghost-attractor escape. A hierarchical phase-space decomposition separates first-order basin convergence from second-order proprioceptive refinement. Empirically, a Ghost trained end-to-end with a behavioral-cloning and contrastive objective exhibits the predicted gradient-flow contraction in its potential, with the gradient norm decaying by 67 percent across five integration steps on 1430 held-out samples. Ghost is evaluated as a robotic action decoder. A 2.3-million-parameter Ghost matches the offline accuracy of a 1.07-billion-parameter Diffusion Transformer at 462 times fewer parameters and 32 times lower latency, and beats five alternative 2M-parameter decoders (MLP, Neural ODE, CVAE, Transformer, 1-step Diffusion) on offline mean squared error by 5.9 to 29 percent. On the LIBERO-10 closed-loop benchmark, phase conditioning on Ghost's basin-structured latent yields a 13.5 percentage-point success-rate gain over a feed-forward MLP baseline, and persistent-latent ensembling reaches a 95.7 percent final success rate.

序列生成动态系统机器人控制低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。