arXiv:2505.18024cs.CV2025-05被引 6

提出小波分解的立体匹配框架,解决高频信息迭代中退化问题。

A Wavelet-based Stereo Matching Framework for Solving Frequency Convergence Inconsistency

  • 用小波变换分离图像高低频成分,分别处理
  • 在KITTI 2015/2012上全指标排名第一
  • 适合远距离细纹理、边缘等复杂场景

我们发现现有迭代方法在低频和高频区域的端点误差(EPE)收敛不一致,导致迭代过程中高频信息退化(如边缘和细物体)。根本原因在于当前方法未区分高低频成分,一并优化。为此,提出基于小波的立体匹配框架(Wavelet-Stereo):首先使用离散小波变换显式分解图像为高低频成分;随后将二者输入两个不同的多尺度频率特征提取器;最后设计一种新型基于LSTM的高频保持更新算子,包含迭代频率适配器,可逐次微调初始高频特征,实现自适应精细化。通过分离处理高低频信息,本框架能同时提升边缘处高频细节与平滑区域低频信息,特别适用于远距离存在精细纹理与细节的挑战性场景。大量实验表明,Wavelet-Stereo性能超越现有最优方法,在KITTI 2015和KITTI 2012排行榜上几乎所有指标均位列第一。代码与预训练模型已开源(https://github.com/SIA-IDE/Wavelet-Stereo),以促进进一步研究与应用。

原文摘要 · Abstract (English)

We find that the EPE evaluation metrics of RAFT-stereo converge inconsistently in the low and high frequency regions, resulting high frequency degradation (e.g., edges and thin objects) during the iterative process. The underlying reason for the limited performance of current iterative methods is that it optimizes all frequency components together without distinguishing between high and low frequencies. We propose a wavelet-based stereo matching framework (Wavelet-Stereo) for solving frequency convergence inconsistency. Specifically, we first explicitly decompose an image into high and low frequency components using discrete wavelet transform. Then, the high-frequency and low-frequency components are fed into two different multi-scale frequency feature extractors. Finally, we propose a novel LSTM-based high-frequency preservation update operator containing an iterative frequency adapter to provide adaptive refined high-frequency features at different iteration steps by fine-tuning the initial high-frequency features. By processing high and low frequency components separately, our framework can simultaneously refine high-frequency information in edges and low-frequency information in smooth regions, which is especially suitable for challenging scenes with fine details and textures in the distance. Extensive experiments demonstrate that our Wavelet-Stereo outperforms the state-of-the-art methods and ranks 1st on both the KITTI 2015 and KITTI 2012 leaderboards for almost all metrics. We will provide code and pre-trained models to encourage further exploration, application, and development of our innovative framework (https://github.com/SIA-IDE/Wavelet-Stereo).

立体匹配小波变换高频保持KITTI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。