arXiv:2603.13781cs.RO2026-03

通过谱分解分离慢变与高频动态,提升机器人操控的实时控制精度。

KoopmanFlow: Spectrally Decoupled Generative Control Policy via Koopman Structural Bias

  • 引入柯尔莫哥洛夫结构先验,分叉生成慢变轨迹与高频残差
  • 在接触密集任务中显著优于现有基线,实现敏捷扰动抑制
  • 适合需要高精度实时控制的复杂机器人任务

生成式控制策略(GCPs)在机器人操作中潜力巨大,但难以同时建模稳定的全局运动和高频局部修正。现有架构虽提取多尺度空间特征,其概率流微分方程却采用统一时间积分步长。压缩为单步以支持实时滚动时域控制(RHC)时,均匀求解器会数学上平滑低频稳态中纠缠的稀疏高频瞬态。为在不累积流水线误差的前提下解耦这些动态,我们提出KoopmanFlow,一种基于柯尔莫哥洛夫启发结构归纳偏置的参数高效生成策略。在统一多模态潜在空间中结合视觉上下文,KoopmanFlow在终端阶段进行分叉:因视觉条件先于谱分解,两个分支均受视觉引导但时间特性不同。宏观分支通过单步一致性训练锚定慢变轨迹,瞬态分支则利用流匹配隔离由突发视觉信号(如接触或遮挡)激发的高频残差。在显式谱先验指导下,通过新颖的非对称一致性目标优化,建立融合共训练机制,使变异分支可吸收局部动态而不产生多阶段误差积累。大量实验表明,KoopmanFlow在需敏捷扰动抑制的接触密集任务中显著超越当前最优基线。通过牺牲少量延迟缓冲换取更丰富的结构先验,KoopmanFlow在实时部署限制内实现了更高的控制保真度与参数效率。

原文摘要 · Abstract (English)

Generative Control Policies (GCPs) show immense promise in robotic manipulation but struggle to simultaneously model stable global motions and high-frequency local corrections. While modern architectures extract multi-scale spatial features, their underlying Probability Flow ODEs apply a uniform temporal integration schedule. Compressed to a single step for real-time Receding Horizon Control (RHC), uniform ODE solvers mathematically smooth over sparse, high-frequency transients entangled within low-frequency steady states. To decouple these dynamics without accumulating pipelined errors, we introduce KoopmanFlow, a parameter-efficient generative policy guided by a Koopman-inspired structural inductive bias. Operating in a unified multimodal latent space with visual context, KoopmanFlow bifurcates generation at the terminal stage. Because visual conditioning occurs before spectral decomposition, both branches are visually guided yet temporally specialized. A macroscopic branch anchors slow-varying trajectories via single-step Consistency Training, while a transient branch uses Flow Matching to isolate high-frequency residuals stimulated by sudden visual cues (e.g., contacts or occlusions). Guided by an explicit spectral prior and optimized via a novel asymmetric consistency objective, KoopmanFlow establishes a fused co-training mechanism. This allows the variant branch to absorb localized dynamics without multi-stage error accumulation. Extensive experiments show KoopmanFlow significantly outperforms state-of-the-art baselines in contact-rich tasks requiring agile disturbance rejection. By trading a surplus latency buffer for a richer structural prior, KoopmanFlow achieves superior control fidelity and parameter efficiency within real-time deployment limits.

生成控制机器人谱方法实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。