从视频中无监督估计物理系统参数,无需标签且更稳定。
Learning Physics From Video: Unsupervised Physical Parameter Estimation for Continuous Dynamical Systems
- 用隐空间KL散度损失替代帧预测,避免无效解
- 在75个真实场景视频上验证,精度优于现有方法
- 适用于非运动类连续动力系统,对初始化不敏感
从观测视频中提取物理动力系统参数是自然科学的关键。现有方法依赖大规模带标签数据训练监督深度网络,但标签难以获取。部分无监督方法虽存在,却需长期训练、易受初始值影响,仅适用于运动类系统,且多在合成数据上评估。本文提出一种无监督方法,可从单段视频中估计已知连续动力方程的物理参数,适用于多种动力系统,且对初始化鲁棒。通过在隐空间引入基于KL散度的损失函数,避免了帧预测需求,减少模型规模与计算量,防止收敛至平凡解。首先在合成数据上评估,随后构建真实世界数据集Delfys75(含75个视频,覆盖五类动力系统),用于真实场景验证。结果表明,该方法在真实视频上参数估计精度显著优于现有方法。代码与数据已公开:https://github.com/Alejandro-neuro/Learning_physics_from_video。
原文摘要 · Abstract (English)
Extracting physical dynamical system parameters from recorded observations is key in natural science. Current methods for automatic parameter estimation from video train supervised deep networks on large datasets. Such datasets require labels, which are difficult to acquire. While some unsupervised techniques--which depend on frame prediction--exist, they suffer from long training times, initialization instabilities, only consider motion-based dynamical systems, and are evaluated mainly on synthetic data. In this work, we propose an unsupervised method to estimate the physical parameters of known, continuous governing equations from single videos suitable for different dynamical systems beyond motion and robust to initialization. Moreover, we remove the need for frame prediction by implementing a KL-divergence-based loss function in the latent space, which avoids convergence to trivial solutions and reduces model size and compute. We first evaluate our model on synthetic data, as commonly done. After which, we take the field closer to reality by recording Delfys75: our own real-world dataset of 75 videos for five different types of dynamical systems to evaluate our method and others. Our method compares favorably to others. %, yet, and real-world video datasets and demonstrate improved parameter estimation accuracy compared to existing methods. Code and data are available online:https://github.com/Alejandro-neuro/Learning_physics_from_video.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。