发现高对比光流的拓扑结构,揭示运动边界的关键位置。
An Extended Topological Model For High-Contrast Optical Flow
- 用圆丛理论构建3维流形模型,解释旧模型无法验证的原因。
- 99%高对比光流样本集中在二值阶跃边缘环上,而非旧环面模型。
- 适合研究视觉推理中拓扑与几何关系的学者。
本文针对从Sintel数据集采样的3×3高对比光流块,在密集核心子集中识别出低维模型。利用近似与离散圆丛理论,我们发现一个3维流形,其边界为先前提出的光流环面,同时包含与二值阶跃边缘图像块对应的分离圆环。该3维流形模型解释了为何先前环面模型无法通过直接方法(如简单持久同调计算)验证。我们还表明,几乎全部对比度范数排名前1%的光流块均位于上述二值阶跃边缘环族附近,而非光流环面;这些高频出现的块集中在运动边界处,对目标分割与跟踪等计算机视觉任务尤为重要。研究揭示了视觉数据推断中拓扑与几何之间的微妙相互作用。
原文摘要 · Abstract (English)
In this paper, we identify low-dimensional models for dense core subsets in the space of $3\times 3$ high-contrast optical flow patches sampled from the Sintel dataset. In particular, we leverage the theory of approximate and discrete circle bundles to identify a 3-manifold whose boundary is a previously proposed optical flow torus, together with disjoint circles corresponding to pairs of binary step-edge range image patches. The 3-manifold model we introduce provides an explanation for why the previously-proposed torus model could not be verified with direct methods (e.g., a straightforward persistent homology computation). We also demonstrate that nearly all optical flow patches in the top 1 percent by contrast norm are found near the family of binary step-edge circles described above, rather than the optical flow torus, and that these frequently occurring patches are concentrated near motion boundaries (which are of particular importance for computer vision tasks such as object segmentation and tracking). Our findings offer insights on the subtle interplay between topology and geometry in inference for visual data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。