用混合感知与扩散模型实现少样本下钢筋节点精准自动绑扎
Hybrid Perception and Equivariant Diffusion for Robust Multi-Node Rebar Tying
- 结合几何分析与旋转等变扩散模型,实现复杂环境下的钢筋节点识别
- 仅需5-10次示范训练,即可生成避障高效的动作序列
- 适合工地自动化场景,大幅降低数据与调参需求
钢筋绑扎是混凝土施工中重复性高但关键的任务,通常由人工完成,存在较大人体工学风险。近年来机器人操作技术有望实现自动化,但在密集钢筋节点中准确估计绑扎位姿仍具挑战。本文提出一种融合几何感知与SE(3)上的等变去噪扩散模型(Diffusion-EDFs)的混合感知与运动规划方法,支持少样本下多节点钢筋绑扎。感知模块采用基于密度的聚类(DBSCAN)、几何特征提取与主成分分析(PCA),在复杂无序环境中分割钢筋、识别节点并估算方向向量以实现顺序排序。运动规划器基于Diffusion-EDFs,仅需5-10次示范即能生成优化避障与效率的末端执行器序列姿态。系统在单层、多层及杂乱钢筋网格上验证,表现出高节点检测成功率与精确的顺序绑扎能力。相比依赖大数据或大量人工调参的传统方法,本方案显著降低数据需求,实现鲁棒、高效且可适应的多节点绑扎,凸显了混合感知与扩散驱动规划在施工现场自动化中的潜力,提升安全与劳动效率。
原文摘要 · Abstract (English)
Rebar tying is a repetitive but critical task in reinforced concrete construction, typically performed manually at considerable ergonomic risk. Recent advances in robotic manipulation hold the potential to automate the tying process, yet face challenges in accurately estimating tying poses in congested rebar nodes. In this paper, we introduce a hybrid perception and motion planning approach that integrates geometry-based perception with Equivariant Denoising Diffusion on SE(3) (Diffusion-EDFs) to enable robust multi-node rebar tying with minimal training data. Our perception module utilizes density-based clustering (DBSCAN), geometry-based node feature extraction, and principal component analysis (PCA) to segment rebar bars, identify rebar nodes, and estimate orientation vectors for sequential ranking, even in complex, unstructured environments. The motion planner, based on Diffusion-EDFs, is trained on as few as 5-10 demonstrations to generate sequential end-effector poses that optimize collision avoidance and tying efficiency. The proposed system is validated on various rebar meshes, including single-layer, multi-layer, and cluttered configurations, demonstrating high success rates in node detection and accurate sequential tying. Compared with conventional approaches that rely on large datasets or extensive manual parameter tuning, our method achieves robust, efficient, and adaptable multi-node tying while significantly reducing data requirements. This result underscores the potential of hybrid perception and diffusion-driven planning to enhance automation in on-site construction tasks, improving both safety and labor efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。