arXiv:2607.19986cs.CV2026-07

用生成式方法解决立体匹配模糊问题,提升细节与泛化能力。

STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching

论文配图:STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching
图 1 · 摘自论文原文
  • 分阶段渐进式网络融合多尺度匹配线索
  • 频域解耦扩散变换器缓解对应模糊性
  • 零样本泛化下仍保持高精度,适合复杂场景

立体匹配是三维重建的基础任务。尽管取得显著进展,现有方法通常将立体匹配建模为确定性回归问题,将多模态分布简化为单点估计,导致回归均值偏差,在模糊区域表现不佳。本文提出一种先验引导的生成式框架,将确定性匹配回归与生成分布建模有机结合。基于此框架,提出StereoFlow,包含三个关键组件:(i) 两阶段渐进级联匹配网络,逐步生成多分辨率立体条件并提供互补匹配线索;(ii) 频率解耦架构的像素扩散变换器(StereoDiT),用于建模对应关系模糊性;(iii) 少步流匹配目标(过渡流匹配,Transition Flow Matching),实现高效优化。实验表明,StereoFlow在多个基准测试中达到多项新纪录,包括Scene Flow、KITTI、ETH3D和Middlebury,尤其在病态、不连续区域表现出强几何一致性与丰富细粒度细节,并具备零样本泛化能力。

原文摘要 · Abstract (English)

Stereo matching is a fundamental task in 3D reconstruction. Despite remarkable advances, the prevailing paradigms formulate stereo matching as a deterministic regression problem, collapsing the multimodal distribution modeling into a single-point estimation. This formulation suffers from a regression-to-mean bias, frequently struggling with ambiguous regions. In contrast, we introduce a prior-guided generative framework that integrates deterministic matching regression and generative distribution modeling within a complementary formulation. Built upon this formulation, we introduce StereoFlow through three key components: (i) a two-stage progressive cascade matching network that progressively produces multi-resolution stereo conditions with complementary matching cues; (ii) a pixel diffusion transformer (termed StereoDiT) with a frequency-decoupled architecture for modeling correspondence ambiguity; (iii) a few-step flow matching objective (termed Transition Flow Matching) for efficient optimization. In summary, \textsc{\textbf{StereoFlow}} achieves strong geometric consistency and rich fine-grained details in ill-posed, discontinuous regions and under zero-shot generalization. Extensive experiments demonstrate that the proposed StereoFlow establishes multiple state-of-the-art results across benchmarks, including Scene Flow, KITTI, ETH3D, and Middlebury.

立体匹配生成模型扩散模型三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。