用合成图像提升电力设备缺陷检测,减少人工标注量。
Integrating Artificial Intelligence Models and Synthetic Image Data for Enhanced Asset Inspection and Defect Identification
- 结合3D建模与真实无人机图像生成逼真缺陷数据。
- 引入2000张合成图像后检测性能提升67%,准确率达92%。
- 适合电力、基建等需要罕见缺陷样本的工业场景。
过去电力行业依赖现场巡检发现设备缺陷,近年开始采用无人机巡检。尽管积累了大量无人机影像数据,但用于自动化缺陷检测仍需大量人工标注。本文提出一种新方案:将合成缺陷图像与人工标注的真实图像结合。该方法显著提升检测性能,减少标注工时,并可生成真实数据不足的稀有缺陷图像。通过Maya和Unreal Engine构建高保真3D模型与2D渲染图,合成图像融入训练流程以增强真实数据。本研究实现端到端的资产与缺陷检测AI系统。实验显示,资产检测模型准确率达92%,加入约2000张2K分辨率合成图像后性能提升67%;缺陷检测模型在两批次图像上准确率为73%。分析表明,合成数据可有效替代真实标注数据训练缺陷检测模型。
原文摘要 · Abstract (English)
In the past utilities relied on in-field inspections to identify asset defects. Recently, utilities have started using drone-based inspections to enhance the field-inspection process. We consider a vast repository of drone images, providing a wealth of information about asset health and potential issues. However, making the collected imagery data useful for automated defect detection requires significant manual labeling effort. We propose a novel solution that combines synthetic asset defect images with manually labeled drone images. This solution has several benefits: improves performance of defect detection, reduces the number of hours spent on manual labeling, and enables the capability to generate realistic images of rare defects where not enough real-world data is available. We employ a workflow that combines 3D modeling tools such as Maya and Unreal Engine to create photorealistic 3D models and 2D renderings of defective assets and their surroundings. These synthetic images are then integrated into our training pipeline augmenting the real data. This study implements an end-to-end Artificial Intelligence solution to detect assets and asset defects from the combined imagery repository. The unique contribution of this research lies in the application of advanced computer vision models and the generation of photorealistic 3D renderings of defective assets, aiming to transform the asset inspection process. Our asset detection model has achieved an accuracy of 92 percent, we achieved a performance lift of 67 percent when introducing approximately 2,000 synthetic images of 2k resolution. In our tests, the defect detection model achieved an accuracy of 73 percent across two batches of images. Our analysis demonstrated that synthetic data can be successfully used in place of real-world manually labeled data to train defect detection model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。