arXiv:2503.22125cs.CV2025-03被引 1

用神经网络分割积木建房图像,为自动造房提供算法基础。

Semantic segmentation for building houses from wooden cubes

  • 对比U-Net(light)、LinkNet和PSPNet三模型进行语义分割
  • 在4类数据集上达78%平均交并比,44类数据集仅17%交并比
  • 结果可支撑自动化建房流程设计,适合机器人施工研究者

自动化建造是提升效率、降低成本和减少错误的有前景领域。本文对三种神经网络模型(U-Net(light)、LinkNet、PSPNet)在语义分割中的表现进行了对比分析。为此构建了两个专用数据集:第一个含4类(背景、地基、墙体、屋顶),用于基础评估;第二个含44类,每块木立方体独立标注。所有模型使用相同超参数训练,并以平均交并比(MeanIoU)和F1分数评估。结果显示,U-Net(light)在第一数据集上表现最佳,取得78%的平均交并比和87%的F1分数;在第二数据集上分别为17%和25%。低性能源于数据量有限、分割复杂及类别不平衡,导致难以精准识别单个立方体。此外,所有实验均出现过拟合现象,训练集准确率高但验证集显著下降。本工作为自动生成分阶段建房计划奠定基础,未来将扩展数据集并引入正则化与早停等方法缓解过拟合,下一步将开发基于机械臂的积木建房分步规划算法。

原文摘要 · Abstract (English)

Automated construction is one of the most promising areas that can improve efficiency, reduce costs and minimize errors in the process of building construction. In this paper, a comparative analysis of three neural network models for semantic segmentation, U-Net(light), LinkNet and PSPNet, is performed. Two specialized datasets with images of houses built from wooden cubes were created for the experiments. The first dataset contains 4 classes (background, foundation, walls, roof ) and is designed for basic model evaluation, while the second dataset includes 44 classes where each cube is labeled as a separate object. The models were trained with the same hyperparameters and their accuracy was evaluated using MeanIoU and F1 Score metrics. According to the results obtained, U-Net(light) showed the best performance with 78% MeanIoU and 87% F1 Score on the first dataset and 17% and 25% respectively on the second dataset. The poor results on the second dataset are due to the limited amount of data, the complexity of the partitioning and the imbalance of classes, making it difficult to accurately select individual cubes. In addition, overtraining was observed in all experiments, manifested by high accuracy on the training dataset and its significant decrease on the validation dataset. The present work is the basis for the development of algorithms for automatic generation of staged building plans, which can be further scaled to design complete buildings. Future research is planned to extend the datasets and apply methods to combat overfitting (L1/L2 regularization, Early Stopping). The next stage of work will be the development of algorithms for automatic generation of a step-by-step plan for building houses from cubes using manipulators. Index Terms-Deep Learning, Computer vision, CNN, Semantic segmentation, Construction materials.

语义分割自动化建造积木建房深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。