多机器人协作动态调整视角,提升建筑机器人作业视觉感知能力。
Adaptive Visual Perception for Robotic Construction Process: A Multi-Robot Coordination Framework
- 多台监控机器人自适应调整位置,优化对主机器人及环境的视野覆盖。
- 实验验证了在预制木框架安装中系统可行,视角选择方法鲁棒性强。
- 适合关注建筑机器人视觉感知与多机协同的工程与自动化研究者。
建筑机器人在非结构化工地上作业,有效视觉感知对保障安全与顺畅运行至关重要。由于需处理大型构件且作业范围广,车载摄像头常因遮挡无法完整观测,需依赖多台环境相机覆盖大范围任务空间。本研究提出一种多机器人协同框架:由配备相机的监控机器人团队自适应调整姿态,实时感知主施工机器人及其周围环境。设计了一种视角选择方法,综合考虑视觉覆盖范围、相机与目标距离以及未来作业区域的可视性,以优化视角配置。通过预制木框架安装案例验证系统可行性,并在多种场景下测试视角选择方法的性能与鲁棒性。该研究推动了建筑机器人作业过程中的视觉感知技术发展,为计算机视觉赋能实时自适应与响应提供路径,有助于实现非结构化工地中建筑机器人的安全高效运行。
原文摘要 · Abstract (English)
Construction robots operate in unstructured construction sites, where effective visual perception is crucial for ensuring safe and seamless operations. However, construction robots often handle large elements and perform tasks across expansive areas, resulting in occluded views from onboard cameras and necessitating the use of multiple environmental cameras to capture the large task space. This study proposes a multi-robot coordination framework in which a team of supervising robots equipped with cameras adaptively adjust their poses to visually perceive the operation of the primary construction robot and its surrounding environment. A viewpoint selection method is proposed to determine each supervising robot's camera viewpoint, optimizing visual coverage and proximity while considering the visibility of the upcoming construction robot operation. A case study on prefabricated wooden frame installation demonstrates the system's feasibility, and further experiments are conducted to validate the performance and robustness of the proposed viewpoint selection method across various settings. This research advances visual perception of robotic construction processes and paves the way for integrating computer vision techniques to enable real-time adaption and responsiveness. Such advancements contribute to the safe and efficient operation of construction robots in inherently unstructured construction sites.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。