用强化学习动态调控视觉惯性里程计,兼顾精度与效率。
Dual-Agent Reinforcement Learning for Adaptive and Cost-Aware Visual-Inertial Odometry
- 设计双智能体强化学习框架,根据惯性数据智能控制视觉前端运行时机和融合强度。
- 在EuRoC和TUM-VI数据集上,精度优于多数现有系统,速度提升1.77倍,显存更低。
- 适合资源受限设备部署,尤其适用于机器人导航与增强现实场景。
视觉惯性里程计(VIO)是实现鲁棒自运动估计的关键组件,支撑机器人自主导航和增强现实中的实时6自由度追踪。现有方法面临显著权衡:滤波类方法高效但易漂移,优化类方法虽准确却依赖计算开销巨大的视觉惯性捆绑调整(VIBA),难以在资源受限平台运行。本文不完全摒弃VIBA,而是减少其调用频率与强度。将现代VIO中的两个核心决策——何时运行视觉前端、多大程度信任其输出——建模为序列决策问题,并通过轻量级强化学习(RL)求解。提出一种双分支轻量级RL策略:(1)选择智能体仅基于高频IMU数据智能控制整个视觉里程计流水线的开启;(2)融合智能体先通过监督网络估计鲁棒速度状态,再由RL策略自适应融合完整(位置、速度、姿态)状态。在EuRoC MAV和TUM-VI数据集上的统一评估表明,该方法在精度-效率-内存权衡上优于以往基于GPU的VO/VIO系统:平均绝对轨迹误差(ATE)最优,运行速度最高提升1.77倍,显存占用更低。相比经典优化型VIO,本方法在保持相近轨迹精度的同时,显著降低计算负载。
原文摘要 · Abstract (English)
Visual-Inertial Odometry (VIO) is a critical component for robust ego-motion estimation, enabling foundational capabilities such as autonomous navigation in robotics and real-time 6-DoF tracking for augmented reality. Existing methods face a well-known trade-off: filter-based approaches are efficient but prone to drift, while optimization-based methods, though accurate, rely on computationally prohibitive Visual-Inertial Bundle Adjustment (VIBA) that is difficult to run on resource-constrained platforms. Rather than removing VIBA altogether, we aim to reduce how often and how heavily it must be invoked. To this end, we cast two key design choices in modern VIO, when to run the visual frontend and how strongly to trust its output, as sequential decision problems, and solve them with lightweight reinforcement learning (RL) agents. Our framework introduces a lightweight, dual-pronged RL policy that serves as our core contribution: (1) a Select Agent intelligently gates the entire VO pipeline based only on high-frequency IMU data; and (2) a composite Fusion Agent that first estimates a robust velocity state via a supervised network, before an RL policy adaptively fuses the full (p, v, q) state. Experiments on the EuRoC MAV and TUM-VI datasets show that, in our unified evaluation, the proposed method achieves a more favorable accuracy-efficiency-memory trade-off than prior GPU-based VO/VIO systems: it attains the best average ATE while running up to 1.77 times faster and using less GPU memory. Compared to classical optimization-based VIO systems, our approach maintains competitive trajectory accuracy while substantially reducing computational load.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。