轻量级立体匹配模型LAS2,实现快速推理与强零样本泛化。
Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching

- 采用纯2D代价聚合架构,优化实际推理延迟而非理论计算量。
- 在H200和Orin上分别比Fast-FoundationStereo快1.8倍和2.7倍,精度更高。
- 适合移动端、嵌入式等资源受限场景的高效立体匹配应用。
近期立体匹配方法虽取得显著精度提升,但常依赖大模型、高计算或额外基础模型先验,难以部署于资源受限平台。相比之下,高效模型虽推理快,却普遍被认为零样本泛化能力弱。本文挑战这一假设,提出Lite Any Stereo V2(LAS2),一套超轻量级的高效零样本立体匹配模型系列。从架构与训练两方面设计:架构上,基于实际部署场景重思高效设计,提出仅使用2D的代价聚合框架,以真实推理延迟为优化目标;训练上,采用三阶段策略,结合合成监督、自蒸馏与真实世界知识蒸馏。为增强真实伪标签可靠性,引入伪标签过滤与误差钳制操作,实现更平滑的合成到真实迁移。我们构建了多版本LAS2模型,包括不同效率预算下的前馈变体及更高精度的迭代变体。大量实验表明,LAS2在高效立体匹配中达到最先进精度,同时显著降低延迟。具体而言,LAS2-H在零样本性能上优于迭代方法Fast-FoundationStereo,且在H200和Orin上分别提速1.8倍和2.7倍。
原文摘要 · Abstract (English)
Recent advances in stereo matching have achieved remarkable accuracy, but often rely on large models, heavy computation, or additional foundation-model priors, making them difficult to deploy on resource-constrained platforms. In contrast, efficient stereo models offer faster inference but are commonly considered less capable of strong zero-shot generalization. In this paper, we challenge this assumption by introducing Lite Any Stereo V2 (LAS2), an ultra-fast model series designed for efficient zero-shot stereo matching. LAS2 is developed from both architecture and training perspectives. Architecturally, we revisit efficient stereo design under practical deployment settings and propose a 2D-only cost aggregation framework, optimized for real inference latency rather than theoretical MACs alone. For training, we develop a three-stage strategy that combines synthetic supervision, self-distillation, and real-world knowledge distillation. To improve the reliability of real-world pseudo supervision, we further introduce pseudo-label filtering and an error-clamping operation, enabling smoother synthetic-to-real transfer. We instantiate LAS2 as a family of models, including feed-forward variants for different efficiency budgets and an iterative variant for higher accuracy. Extensive experiments show that LAS2 achieves state-of-the-art accuracy among efficient stereo methods while maintaining significantly lower latency. Specifically, LAS2-H achieves stronger overall zero-shot performance than the iterative method Fast-FoundationStereo, with 1.8x and 2.7x faster inference on H200 and Orin, respectively. The project page, demos, and code are available at https://tomtomtommi.github.io/LiteAnyStereoV2/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。