轻量化立体匹配网络,专为内河无人船导航设计
A Lightweight Target-Driven Network of Stereo Matching for Inland Waterways
- 用目标图像几何特征构建4D代价体,提升匹配效率
- 仅370万参数,实测在内河场景下精度领先
- 适合资源受限的水上无人设备部署使用
内河水域的立体匹配是无人水面艇(USV)自主导航的关键技术,需对左右相机图像进行像素级匹配。由于内河环境存在纹理模糊、空间尺度大及平台算力受限等问题,需引入目标图像的几何特征实现高效的目标驱动匹配。为此,本文提出轻量级目标驱动立体匹配网络LTNet。设计了一种轻量高效的4D代价体——几何目标体(GTV),通过移位目标特征作为滤波特征体,充分提取目标图像的几何信息。针对水道中普遍存在的纹理干扰与遮挡问题,提出左右一致性精修(LRR)模块,利用左右视差的像素级差异引入软约束,在网络中间阶段提升预测准确性。同时,采用知识蒸馏增强模型在USVInland数据集上的泛化能力。此外,构建新基准数据集Spring以验证LTNet在多场景下的适用性。在两个数据集上的实验表明,LTNet仅需3.7M参数即取得具有竞争力的性能。代码已开源:https://github.com/Open-YiQingZhou/LTNet。
原文摘要 · Abstract (English)
Stereo matching for inland waterways is one of the key technologies for the autonomous navigation of Unmanned Surface Vehicles (USVs), which involves dividing the stereo images into reference images and target images for pixel-level matching. However, due to the challenges of the inland waterway environment, such as blurred textures, large spatial scales, and computational resource constraints of the USVs platform, the participation of geometric features from the target image is required for efficient target-driven matching. Based on this target-driven concept, we propose a lightweight target-driven stereo matching neural network, named LTNet. Specifically, a lightweight and efficient 4D cost volume, named the Geometry Target Volume (GTV), is designed to fully utilize the geometric information of target features by employing the shifted target features as the filtered feature volume. Subsequently, to address the substantial texture interference and object occlusions present in the waterway environment, a Left-Right Consistency Refinement (LRR) module is proposed. The \text{LRR} utilizes the pixel-level differences in left and right disparities to introduce soft constraints, thereby enhancing the accuracy of predictions during the intermediate stages of the network. Moreover, knowledge distillation is utilized to enhance the generalization capability of lightweight models on the USVInland dataset. Furthermore, a new large-scale benchmark, named Spring, is utilized to validate the applicability of LTNet across various scenarios. In experiments on the aforementioned two datasets, LTNet achieves competitive results, with only 3.7M parameters. The code is available at https://github.com/Open-YiQingZhou/LTNet .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。