arXiv:2506.03290cs.CV2025-06CVPR

用微分方程动态调整计算步数,仅一步就超越传统多步模型。

Learning Optical Flow Field via Neural Ordinary Differential Equation

  • 用神经微分方程建模光流变化率,实现连续更新。
  • 在多个基准上优于基线模型,仅需一步即达最优性能。
  • 适合需要高效高精度光流估计的实时应用。

近期光流估计方法使用神经网络预测从一张图像到另一张图像的位置映射。这些网络通常包含特征提取器、相关体积和若干精修步骤。现有方法通过固定步数的循环神经层(如GRU)模拟经典优化算法的迭代过程,但固定步数难以适配不同输入数据。本文提出一种新方法:利用神经微分方程(Neural ODE)预测光流的导数,以连续模型捕捉平衡过程,并根据输入数据动态调整计算步数。通过特定神经结构、求解器及超参数设置,该模型可复现传统递归单元的全部更新行为,具备更强通用性。在多个光流基准上的大量实验表明,本方法显著优于基线与现有模型,且仅需单次精修步骤即可达到最佳性能。

原文摘要 · Abstract (English)

Recent works on optical flow estimation use neural networks to predict the flow field that maps positions of one image to positions of the other. These networks consist of a feature extractor, a correlation volume, and finally several refinement steps. These refinement steps mimic the iterative refinements performed by classical optimization algorithms and are usually implemented by neural layers (e.g., GRU) which are recurrently executed for a fixed and pre-determined number of steps. However, relying on a fixed number of steps may result in suboptimal performance because it is not tailored to the input data. In this paper, we introduce a novel approach for predicting the derivative of the flow using a continuous model, namely neural ordinary differential equations (ODE). One key advantage of this approach is its capacity to model an equilibrium process, dynamically adjusting the number of compute steps based on the data at hand. By following a particular neural architecture, ODE solver, and associated hyperparameters, our proposed model can replicate the exact same updates as recurrent cells used in existing works, offering greater generality. Through extensive experimental analysis on optical flow benchmarks, we demonstrate that our approach achieves an impressive improvement over baseline and existing models, all while requiring only a single refinement step.

光流估计神经ODE连续模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。