arXiv:2602.10547cs.RO2026-02

让机器人根据环境动态调整多光谱传感器参数,省电又高效。

ReSPEC: A Framework for Online Multispectral Sensor Reconfiguration in Dynamic Environments

  • 用强化学习实时调节传感器采样率和分辨率
  • 实测降低29.3%显卡负载,精度仅降5.3%
  • 适合嵌入式机器人在复杂环境节能感知

多传感器融合是鲁棒机器人感知的核心,但现有系统大多采用静态配置,无论场景是否需要,固定频率和精度采集所有模态数据。这种僵化设计浪费带宽、计算与能耗,无法在光照差或遮挡等挑战条件下优先使用关键传感器。尽管强化学习与模态感知融合有进展,但以往工作主要集中在推理时调整特征权重,忽略了传感器数据采集的物理成本。本文提出ReSPEC框架,将感知、学习与执行整合为闭环重配置机制。任务特定检测骨干网络提取多光谱特征(如RGB、红外、毫米波、深度),并输出各模态的定量贡献评分。这些评分传给强化学习代理,动态调整传感器配置,包括采样频率、分辨率、感知范围等。信息量低的传感器被降采样或关闭,关键传感器则在环境变化中提升采样精度。我们在移动探测车平台实现并评估该框架,结果显示自适应控制使GPU负载降低29.3%,精度仅下降5.3%,相比启发式基线。这表明资源感知的自适应感知对嵌入式机器人平台具有巨大潜力。

原文摘要 · Abstract (English)

Multi-sensor fusion is central to robust robotic perception, yet most existing systems operate under static sensor configurations, collecting all modalities at fixed rates and fidelity regardless of their situational utility. This rigidity wastes bandwidth, computation, and energy, and prevents systems from prioritizing sensors under challenging conditions such as poor lighting or occlusion. Recent advances in reinforcement learning (RL) and modality-aware fusion suggest the potential for adaptive perception, but prior efforts have largely focused on re-weighting features at inference time, ignoring the physical cost of sensor data collection. We introduce a framework that unifies sensing, learning, and actuation into a closed reconfiguration loop. A task-specific detection backbone extracts multispectral features (e.g. RGB, IR, mmWave, depth) and produces quantitative contribution scores for each modality. These scores are passed to an RL agent, which dynamically adjusts sensor configurations, including sampling frequency, resolution, sensing range, and etc., in real time. Less informative sensors are down-sampled or deactivated, while critical sensors are sampled at higher fidelity as environmental conditions evolve. We implement and evaluate this framework on a mobile rover, showing that adaptive control reduces GPU load by 29.3\% with only a 5.3\% accuracy drop compared to a heuristic baseline. These results highlight the potential of resource-aware adaptive sensing for embedded robotic platforms.

机器人感知自适应传感强化学习多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。