arXiv:2503.12348cs.CV2025-03中稿 · Frontiers of Compu…被引 2

无需训练,单图即可生成多组可能的运动流分布。

ProbDiffFlow: An Efficient Learning-Free Framework for Probabilistic Single-Image Optical Flow Estimation

  • 用扩散模型生成多种可能的未来帧,再合成运动流
  • 在真实与合成数据集上精度和多样性均优于现有方法
  • 适合需要不确定性感知的自动驾驶与视频分析场景

本文研究单图像光流估计,该任务在自主导航、动作识别和影视制作中至关重要。传统方法依赖连续帧,但实际采集常受限或受场景干扰。现有单图方法存在两大缺陷:(1) 需要标注训练数据,导致任务特定;(2) 输出确定性结果,无法体现运动不确定性。为此,我们提出 ProbDiffFlow,一种无需训练的框架,可从单张图像估计光流分布。其采用“由合成推估计”范式:先用扩散模型生成多样化的未来帧,再通过预训练光流模型从合成样本中估计运动,最后聚合为概率化光流分布。该设计避免了任务特异性训练,同时捕捉多种合理运动模式。在合成与真实数据集上的实验表明,ProbDiffFlow 在精度、多样性与效率上均优于现有单图及双帧基线方法。

原文摘要 · Abstract (English)

This paper studies optical flow estimation, a critical task in motion analysis with applications in autonomous navigation, action recognition, and film production. Traditional optical flow methods require consecutive frames, which are often unavailable due to limitations in data acquisition or real-world scene disruptions. Thus, single-frame optical flow estimation is emerging in the literature. However, existing single-frame approaches suffer from two major limitations: (1) they rely on labeled training data, making them task-specific, and (2) they produce deterministic predictions, failing to capture motion uncertainty. To overcome these challenges, we propose ProbDiffFlow, a training-free framework that estimates optical flow distributions from a single image. Instead of directly predicting motion, ProbDiffFlow follows an estimation-by-synthesis paradigm: it first generates diverse plausible future frames using a diffusion-based model, then estimates motion from these synthesized samples using a pre-trained optical flow model, and finally aggregates the results into a probabilistic flow distribution. This design eliminates the need for task-specific training while capturing multiple plausible motions. Experiments on both synthetic and real-world datasets demonstrate that ProbDiffFlow achieves superior accuracy, diversity, and efficiency, outperforming existing single-image and two-frame baselines.

光流估计扩散模型不确定性建模单图推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。