arXiv:2602.12288eess.SYcs.AI2026-02被引 3

让机器人操作基础设施时更省电,还能自动规划能耗。

Energy-Aware Reinforcement Learning for Robotic Manipulation of Articulated Components in Infrastructure Operation and Maintenance

  • 用3D感知和点云编码生成通用几何表示,适配不同关节部件。
  • 在控制中显式约束能耗,训练后能耗降低16%-30%,成功率高。
  • 适合长期部署的智能运维场景,尤其关注能效与可扩展性。

随着智能基础设施与智慧城市的发展,运营维护(O&M)对机器人操作关节部件(如门、抽屉、管道阀)提出了安全、高效、节能的要求。现有方法多聚焦抓取或特定对象操作,极少将执行能耗纳入多目标优化,限制了其在真实环境中的长期适用性。本文提出一种无结构依赖、能源感知的强化学习框架,结合部件引导的3D感知、加权点采样与PointNet编码,获得跨异构关节部件的紧凑几何表征。将操作建模为带约束的马尔可夫决策过程(CMDP),通过基于拉格朗日的约束软演员-评论家算法显式建模并调控执行能耗。策略在该框架下端到端训练,实现长周期能耗预算内有效操作。实验表明,在典型运维任务中能耗降低16%-30%,成功步数减少16%-32%,成功率稳定,验证了方案在智能基础设施运维中的可扩展性与可持续性。

原文摘要 · Abstract (English)

With the growth of intelligent civil infrastructure and smart cities, operation and maintenance (O&M) increasingly requires safe, efficient, and energy-conscious robotic manipulation of articulated components, including access doors, service drawers, and pipeline valves. However, existing robotic approaches either focus primarily on grasping or target object-specific articulated manipulation, and they rarely incorporate explicit actuation energy into multi-objective optimisation, which limits their scalability and suitability for long-term deployment in real O&M settings. Therefore, this paper proposes an articulation-agnostic and energy-aware reinforcement learning framework for robotic manipulation in intelligent infrastructure O&M. The method combines part-guided 3D perception, weighted point sampling, and PointNet-based encoding to obtain a compact geometric representation that generalises across heterogeneous articulated objects. Manipulation is formulated as a Constrained Markov Decision Process (CMDP), in which actuation energy is explicitly modelled and regulated via a Lagrangian-based constrained Soft Actor-Critic scheme. The policy is trained end-to-end under this CMDP formulation, enabling effective articulated-object operation while satisfying a long-horizon energy budget. Experiments on representative O&M tasks demonstrate 16%-30% reductions in energy consumption, 16%-32% fewer steps to success, and consistently high success rates, indicating a scalable and sustainable solution for infrastructure O&M manipulation.

机器人操作能耗优化强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。