多视角系统实时识别汽车型号与缺陷,准确率达93%
Multi-View Camera System for Variant-Aware Autonomous Vehicle Inspection and Defect Detection
- 11个同步相机环绕拍摄,分模块处理零件、车型、标识和划痕
- 93%验证准确率,86%缺陷检出率,每分钟可检测3.3辆汽车
- 适合汽车制造厂部署,结果可解释,支持不同车型统一质检
确保每辆现代生产线出厂的车辆符合正确的车型规格且无可见缺陷,正变得日益复杂。我们提出自动化车辆质检(AVI)平台,这是一个端到端的多视角感知系统,结合深度学习检测器与语义规则引擎,实现实时的车型感知质量控制。11个同步相机对每辆车完成360°全景拍摄;特定任务视图被路由至专用模块:YOLOv8用于零部件检测,EfficientNet用于燃油车/电动车分类,Gemini-1.5 Flash用于徽标文字识别,YOLOv8-Seg用于划痕凹陷分割。一个视图感知融合层标准化证据,而基于VIN的规则引擎将检测特征与预期清单比对,生成约300毫秒内的可解释通过/失败报告。在包含四个不同车型的原始设备制造商(OEM)数据集及公开划痕凹陷图像的混合数据集上,AVI达到93%的验证准确率、86%的缺陷检测召回率,且维持3.3辆/分钟的处理速度,显著优于单视角或无分割基线。据我们所知,这是首个在工业部署场景中公开报告的、统一多相机特征验证与缺陷检测的系统。
原文摘要 · Abstract (English)
Ensuring that every vehicle leaving a modern production line is built to the correct \emph{variant} specification and is free from visible defects is an increasingly complex challenge. We present the \textbf{Automated Vehicle Inspection (AVI)} platform, an end-to-end, \emph{multi-view} perception system that couples deep-learning detectors with a semantic rule engine to deliver \emph{variant-aware} quality control in real time. Eleven synchronized cameras capture a full 360° sweep of each vehicle; task-specific views are then routed to specialised modules: YOLOv8 for part detection, EfficientNet for ICE/EV classification, Gemini-1.5 Flash for mascot OCR, and YOLOv8-Seg for scratch-and-dent segmentation. A view-aware fusion layer standardises evidence, while a VIN-conditioned rule engine compares detected features against the expected manifest, producing an interpretable pass/fail report in \(\approx\! 300\,\text{ms}\). On a mixed data set of Original Equipment Manufacturer(OEM) vehicle data sets of four distinct models plus public scratch/dent images, AVI achieves \textbf{93\%} verification accuracy, \textbf{86 \%} defect-detection recall, and sustains \(\mathbf{3.3}\) vehicles/min, surpassing single-view or no segmentation baselines by large margins. To our knowledge, this is the first publicly reported system that unifies multi-camera feature validation with defect detection in a deployable automotive setting in industry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。