用一套野外成像系统,实现砂石骨料多场景形态分析。
Field imaging framework for morphological characterization of aggregates with computer vision: Algorithms and applications
- 设计野外成像系统,结合分割与体积估算算法处理单个骨料。
- 建立2D实例分割与3D重建-分割-补全流程,精准分析堆场形态。
- 适用于工地现场,适合土木工程与材料研究者使用。
建筑骨料(如砂石、碎石、块石)是建筑业的核心材料。当前表征方法主要依赖人工目视和测量,现有成像技术仅适用于规则尺寸且环境受控的骨料。本文提出一种多场景野外成像框架,解决上述挑战:针对孤立无重叠骨料,设计野外成像系统并开发分割与体积估算算法;针对堆场2D图像,建立自动化2D实例分割与形态分析方法;针对堆场3D点云,构建集成的3D重建-分割-补全(RSC-3D)流程,包括多视角图像重建、实例分割及未见侧面形状补全。基于重建模型构建3D骨料粒子库,并生成两个数据集:含真实标注的合成堆场数据集,以及通过多视角射线投射生成的部分-完整形状对数据集。分别在两组数据上训练先进的3D实例分割网络与3D形状补全网络。该方法在真实堆场中应用并经真实数据验证,能有效捕捉并预测骨料未暴露侧面的形态。
原文摘要 · Abstract (English)
Construction aggregates, including sand and gravel, crushed stone and riprap, are the core building blocks of the construction industry. State-of-the-practice characterization methods mainly relies on visual inspection and manual measurement. State-of-the-art aggregate imaging methods have limitations that are only applicable to regular-sized aggregates under well-controlled conditions. This dissertation addresses these major challenges by developing a field imaging framework for the morphological characterization of aggregates as a multi-scenario solution. For individual and non-overlapping aggregates, a field imaging system was designed and the associated segmentation and volume estimation algorithms were developed. For 2D image analyses of aggregates in stockpiles, an automated 2D instance segmentation and morphological analysis approach was established. For 3D point cloud analyses of aggregate stockpiles, an integrated 3D Reconstruction-Segmentation-Completion (RSC-3D) approach was established: 3D reconstruction procedures from multi-view images, 3D stockpile instance segmentation, and 3D shape completion to predict the unseen sides. First, a 3D reconstruction procedure was developed to obtain high-fidelity 3D models of collected aggregate samples, based on which a 3D aggregate particle library was constructed. Next, two datasets were derived from the 3D particle library for 3D learning: a synthetic dataset of aggregate stockpiles with ground-truth instance labels, and a dataset of partial-complete shape pairs, developed with varying-view raycasting schemes. A state-of-the-art 3D instance segmentation network and a 3D shape completion network were trained on the datasets, respectively. The application of the integrated approach was demonstrated on real stockpiles and validated with ground-truth, showing good performance in capturing and predicting the unseen sides of aggregates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。