用深度学习特征提升视觉惯性定位,实测在多种场景下表现优于传统方法。
DL-VINS-Factory: A Modular Framework for Learned Visual Front-Ends in Visual-Inertial SLAM

- 融合深度学习特征与光流/描述子匹配,统一构建视觉前端模块
- 单目模式下最高降低5%位姿误差,立体视觉下最多减少12%闭环误差
- 支持嵌入式实时运行,适合无人机、机器人等移动设备部署
深度学习特征在视觉匹配中表现优异,但在紧密耦合的视觉惯性SLAM(VI-SLAM)中的实际价值仍不明确。本文提出DL-VINS-Factory,一个统一框架,集成ALIKED、RaCo、SuperPoint、XFeat等学习型特征提取器,搭配Lucas-Kanade光流跟踪或LightGlue描述子匹配。所有前端共享滑动窗口Ceres后端,可选AnyLoc DINOv2-VLAD回环检测与4-自由度位姿图优化。在涵盖室内、非结构化室外、剧烈运动及视觉退化条件的四个数据集上进行评估。结果显示,学习型前端适用于实时嵌入式VI-SLAM,但并非始终优于经典方法。相较于对应GFTT+LK基线,ALIKED+LG在单目里程计中使EuRoC ATE降低5%,在双目加回环下降低7%;在NTU-VIRAL数据集(剧烈飞行运动)中,双目配置下回环闭合ATE减少12%。在Botanic Garden数据集,光流跟踪更优,但学习型关键点仍显著优于基线:SuperPoint+LK使灰度相机ATE降低29%,RaCo+LK使RGB相机ATE降低38%。在SubT-MRS中,改进程度因情况而异。使用TensorRT加速于Jetson AGX Orin平台,所有有效配置在单目模式下实现29–47 FPS,双目模式下18–33 FPS(EuRoC与NTU-VIRAL)。AnyLoc比BRIEF+DBoW2多识别约2–7倍有效回环。代码已开源:https://github.com/limshoonkit/DL-VINS-Factory-ROS2/
原文摘要 · Abstract (English)
Deep-learning features excel in visual matching, yet their practical value in tightly coupled visual-inertial SLAM (VI-SLAM) remains insufficiently characterized. We present DL-VINS-Factory, a unified framework that integrates learned feature extractors (ALIKED, RaCo, SuperPoint, XFeat) with either Lucas--Kanade (LK) optical-flow tracking or LightGlue (LG) descriptor matching. All front-ends share a sliding-window Ceres back-end, with optional AnyLoc DINOv2-VLAD loop closure, and 4-DoF pose-graph optimization. We benchmark the system across the four datasets covering indoor, unstructured outdoor, aggressive-motion, and visually degraded conditions. Results show that learned front-ends are viable for real-time embedded VI-SLAM, but are not universally superior to classical tracking. Relative to the corresponding GFTT+LK baseline, ALIKED+LG reduces EuRoC ATE by $5\%$ in monocular odometry and by $7\%$ in stereo with loop-closure. On NTU-VIRAL, where aggressive aerial motion increases inter-frame viewpoint change, ALIKED+LG stereo reduces loop-closed ATE by $12\%$. In Botanic Garden dataset, optical-flow tracking remains preferable, but learned keypoints still improve over the baseline GFTT, in which SuperPoint+LK reduces grayscale camera ATE by $29\%$, while RaCo+LK reduces RGB camera ATE by $38\%$. On SubT-MRS, learned front-ends display varying degree of improvement based on individual cases. With TensorRT acceleration on a Jetson AGX Orin, all valid configurations run in real time between $29$--$47$ FPS in monocular mode and $18$--$33$ FPS in stereo mode for the EuRoC and NTU-VIRAL datasets. AnyLoc further confirms roughly $2$--$7\times$ more valid loops than BRIEF+DBoW2. The implementation is open-sourced at https://github.com/limshoonkit/DL-VINS-Factory-ROS2/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。