用AI自动调节视觉里程计参数,让机器人在不同环境更稳定高效
Image-Conditioned Adaptive Parameter Tuning for Visual Odometry Frontends
- 基于图像内容的强化学习,动态调整特征检测与跟踪参数
- 实测特征轨迹长度提升3倍,计算成本降低3倍,全在仿真中训练
- 适合部署于资源受限的机器人,尤其复杂光照或纹理变化场景
资源受限的自主机器人依赖稀疏直接或半直接视觉(惯性)里程计(VO)流水线,因其在精度、鲁棒性与计算成本间取得良好平衡。然而,多数系统性能高度依赖于人工调优的超参数,涵盖特征检测、跟踪和异常值剔除。这些参数通常在部署时固定不变,尽管其最优值随场景特性(如纹理密度、光照、运动模糊、传感器噪声)变化,导致真实环境中表现脆弱。本文提出首个图像条件的强化学习框架,实现VO前端参数的在线自适应调节,将专家经验嵌入系统。核心思想是将前端配置建模为序列决策问题,学习一个直接从视觉输入映射到特征检测与跟踪参数的策略。该策略使用轻量级纹理感知CNN编码器,并在训练中引入特权评判器。不同于以往仅依赖内部VO统计的强化学习方法,本方法能观测图像内容,在跟踪恶化前主动调整参数。在TartanAirV2和TUM RGB-D数据集上的实验表明,即使全部在仿真中训练,仍实现特征轨迹长度提升3倍、计算成本降低3倍。
原文摘要 · Abstract (English)
Resource-constrained autonomous robots rely on sparse direct and semi-direct visual-(inertial)-odometry (VO) pipelines, as they provide a favorable tradeoff between accuracy, robustness, and computational cost. However, the performance of most systems depends critically on hand-tuned hyperparameters governing feature detection, tracking, and outlier rejection. These parameters are typically fixed during deployment, even though their optimal values vary with scene characteristics such as texture density, illumination, motion blur, and sensor noise, leading to brittle performance in real-world environments. We propose the first image-conditioned reinforcement learning framework for online tuning of VO frontend parameters, effectively embedding the expert into the system. Our key idea is to formulate the frontend configuration as a sequential decision-making problem and learn a policy that directly maps visual input to feature detection and tracking parameters. The policy uses a lightweight texture-aware CNN encoder and a privileged critic during training. Unlike prior RL-based approaches that rely solely on internal VO statistics, our method observes the image content and proactively adapts parameters before tracking degrades. Experiments on TartanAirV2 and TUM RGB-D show 3x longer feature tracks and 3x lower computational cost, despite training entirely in simulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。