arXiv:2502.00754cs.LGcs.CV2025-02ICLR被引 3

让图像中的动态系统在潜空间连续演化,提升建模精度

Continuity-Preserving Convolutional Autoencoders for Learning Continuous Latent Dynamical Models from Images

  • 通过强化卷积核连续性,确保潜变量随时间平滑变化
  • 在多类场景下显著提升潜空间动态模型的准确性
  • 适合需要高保真动态建模的视觉系统研究者

连续动力系统是众多科学与工程领域的基石。尽管机器学习能从轨迹数据中建模这些系统,但当轨迹以图像形式采集时,像素级观测具有离散性,导致传统卷积自编码器产生的潜变量在时间上不连续。为此,本文提出连续性保持卷积自编码器(CpAE),从离散图像帧中学习连续潜态及其对应的连续潜动力学模型。我们给出了从图像帧学习动力学的数学框架,揭示了先前方法的问题,并提出通过促进卷积核连续性来保持潜态连续性的新思路。该方法使潜变量能随底层动力学连续演变,从而构建更准确的潜动力学模型。大量实验证明了CpAE在多种场景下的有效性。

原文摘要 · Abstract (English)

Continuous dynamical systems are cornerstones of many scientific and engineering disciplines. While machine learning offers powerful tools to model these systems from trajectory data, challenges arise when these trajectories are captured as images, resulting in pixel-level observations that are discrete in nature. Consequently, a naive application of a convolutional autoencoder can result in latent coordinates that are discontinuous in time. To resolve this, we propose continuity-preserving convolutional autoencoders (CpAEs) to learn continuous latent states and their corresponding continuous latent dynamical models from discrete image frames. We present a mathematical formulation for learning dynamics from image frames, which illustrates issues with previous approaches and motivates our methodology based on promoting the continuity of convolution filters, thereby preserving the continuity of the latent states. This approach enables CpAEs to produce latent states that evolve continuously with the underlying dynamics, leading to more accurate latent dynamical models. Extensive experiments across various scenarios demonstrate the effectiveness of CpAEs.

潜空间建模连续动态图像序列自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。