用随机几何模型生成合成图像,解决工业质检和混凝土裂缝分割的数据难题
Simulation of microstructures and machine learning
- 基于随机几何模型生成逼真合成图像,自动提供标注真值
- 成功模拟多种缺陷结构,显著降低人工标注成本与不一致性
- 适用于数据稀缺场景,如混凝土三维裂缝分割与工业质检
机器学习在图像处理中展现出强大潜力,可替代复杂算法开发。但其依赖大量代表性图像数据及真实标签,而真实数据常因标注成本高、不一致或样本不均衡成为瓶颈。本文针对工业光学质检与混凝土3D图像裂缝分割两个场景:前者需涵盖所有缺陷类型但训练数据分布不均;后者难以实现人工标注。通过基于随机几何模型生成的合成图像,可灵活生成多样结构,天然体现内部变异,且无需标注即可获得真值。该方法有效缓解数据短缺问题,但也引发新问题:真实数据的关键特征需达到何种保真度才能保证模型泛化能力。
原文摘要 · Abstract (English)
Machine learning offers attractive solutions to challenging image processing tasks. Tedious development and parametrization of algorithmic solutions can be replaced by training a convolutional neural network or a random forest with a high potential to generalize. However, machine learning methods rely on huge amounts of representative image data along with a ground truth, usually obtained by manual annotation. Thus, limited availability of training data is a critical bottleneck. We discuss two use cases: optical quality control in industrial production and segmenting crack structures in 3D images of concrete. For optical quality control, all defect types have to be trained but are typically not evenly represented in the training data. Additionally, manual annotation is costly and often inconsistent. It is nearly impossible in the second case: segmentation of crack systems in 3D images of concrete. Synthetic images, generated based on realizations of stochastic geometry models, offer an elegant way out. A wide variety of structure types can be generated. The within structure variation is naturally captured by the stochastic nature of the models and the ground truth is for free. Many new questions arise. In particular, which characteristics of the real image data have to be met to which degree of fidelity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。