用可编程光源提升机器人低光环境下的感知稳定性。
Adaptive Illumination Control for Robot Perception
- 分拆光照与环境光,合成多强度光照数据用于训练。
- 优化光照序列,在保证定位精度前提下降低能耗。
- 实现实时控制策略,适用于移动机器人在线运行。
机器人在低光照或高动态范围条件下感知性能通常依赖下游改进——如更鲁棒的特征提取、图像增强或闭环曝光控制。然而这些方法受限于原始捕获图像质量。另一种方案是利用机载可编程光源补充环境光以改善成像效果。但其影响难以预测:光照与深度、表面反照率及场景几何呈非线性交互,既可揭示结构,也可能引发镜面高光和过曝等失败模式。本文提出 Lightning 框架,结合重光照、离线优化与模仿学习,分三阶段实现闭环光照控制。首先训练协同光照分解(CLID)模型,将机器人观测分解为环境成分与光照贡献场,实现物理一致的多强度场景合成,无需重复运行轨迹即可生成密集多强度训练数据。其次基于合成样本构建离线最优强度调度(OIS)问题,权衡视觉SLAM相关图像效用、功耗与时间平滑性。最后通过行为克隆将理想解提炼为实时控制器(ILC),支持在移动机器人上在线运行,指令离散光照强度。评估表明,Lightning 显著提升SLAM轨迹鲁棒性,同时减少不必要的光照功耗。
原文摘要 · Abstract (English)
Robot perception under low light or high dynamic range is usually improved downstream - via more robust feature extraction, image enhancement, or closed-loop exposure control. However, all of these approaches are limited by the image captured these conditions. An alternate approach is to utilize a programmable onboard light that adds to ambient illumination and improves captured images. However, it is not straightforward to predict its impact on image formation. Illumination interacts nonlinearly with depth, surface reflectance, and scene geometry. It can both reveal structure and induce failure modes such as specular highlights and saturation. We introduce Lightning, a closed-loop illumination-control framework for visual SLAM that combines relighting, offline optimization, and imitation learning. This is performed in three stages. First, we train a Co-Located Illumination Decomposition (CLID) relighting model that decomposes a robot observation into an ambient component and a light-contribution field. CLID enables physically consistent synthesis of the same scene under alternative light intensities and thereby creates dense multi-intensity training data without requiring us to repeatedly re-run trajectories. Second, using these synthesized candidates, we formulate an offline Optimal Intensity Schedule (OIS) problem that selects illumination levels over a sequence trading off SLAM-relevant image utility against power consumption and temporal smoothness. Third, we distill this ideal solution into a real-time controller through behavior cloning, producing an Illumination Control Policy (ILC) that generalizes beyond the initial training distribution and runs online on a mobile robot to command discrete light-intensity levels. Across our evaluation, Lightning substantially improves SLAM trajectory robustness while reducing unnecessary illumination power.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。