提出高效全局匹配模型,实现高精度深度估计且无需调优。
{S\textsuperscript{2}M\textsuperscript{2}}: Scalable Stereo Matching Model for Reliable Depth Estimation
- 用多分辨率Transformer建模长程对应关系,避免传统迭代搜索缺陷。
- 在Middlebury v3和ETH3D上达到新SOTA,细节重建质量优秀。
- 适合需要高鲁棒性与效率的自动驾驶、机器人视觉场景。
追求一种能在不同分辨率和视差范围下通用、无需特定数据集微调的立体匹配模型时,发现一个根本性权衡:迭代局部搜索方法虽在受限基准上表现优异,但其机制天然限制了真实泛化所需的全局一致性;而全局匹配架构理论上更鲁棒,却因计算和内存开销过大长期不可行。本文提出{S\textsuperscript{2}M\textsuperscript{2}}——一种无需成本体过滤或深层精修堆叠的全局匹配架构,在保持高效率的同时实现最先进的准确率。设计融合多分辨率Transformer以增强长程对应能力,并采用新型损失函数将概率集中在合理匹配上,从而实现对视差、遮挡和置信度的更稳健联合估计。该模型在Middlebury v3和ETH3D基准上建立新SOTA,多数指标显著优于以往方法,同时以竞争性效率重建高质量细节。
原文摘要 · Abstract (English)
The pursuit of a generalizable stereo matching model, capable of performing well across varying resolutions and disparity ranges without dataset-specific fine-tuning, has revealed a fundamental trade-off. Iterative local search methods achieve high scores on constrained benchmarks, but their core mechanism inherently limits the global consistency required for true generalization. However, global matching architectures, while theoretically more robust, have historically been rendered infeasible by prohibitive computational and memory costs. We resolve this dilemma with {S\textsuperscript{2}M\textsuperscript{2}}: a global matching architecture that achieves state-of-the-art accuracy and high efficiency without relying on cost volume filtering or deep refinement stacks. Our design integrates a multi-resolution transformer for robust long-range correspondence, trained with a novel loss function that concentrates probability on feasible matches. This approach enables a more robust joint estimation of disparity, occlusion, and confidence. {S\textsuperscript{2}M\textsuperscript{2}} establishes a new state of the art on Middlebury v3 and ETH3D benchmarks, significantly outperforming prior methods in most metrics while reconstructing high-quality details with competitive efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。