用180张图微调SAM,实现只需框选就能精准分割路面病害。
PaveSAM Segment Anything for Pavement Distress
- 基于框提示微调SAM掩码解码器,实现零样本路面病害分割。
- 仅需180张图像微调,即可在未见病害上达到高精度分割。
- 适合交通工程、智能巡检领域研究者快速构建病害数据集。
基于计算机视觉的自动化路面监测可比人工方法更高效、准确地分析路面状况。精确分割是量化路面缺陷严重程度和范围的关键,进而影响养护优先级决策。现有深度学习分割模型多依赖像素级标注,成本高昂。尽管零样本分割模型可对未见类别生成像素标签,但在裂缝不规则性和纹理背景干扰下表现不佳。本研究提出零样本分割模型PaveSAM,支持通过边界框提示进行路面病害分割。仅用180张图像微调SAM的掩码解码器,即实现高效分割,显著降低标注成本。该方法无需训练数据,具备强泛化能力,首次将SAM成功应用于路面病害分割。研究者可利用已有带边界框标注的开源路面病害图像生成分割掩码,大幅提升数据集多样性与可用性。
原文摘要 · Abstract (English)
Automated pavement monitoring using computer vision can analyze pavement conditions more efficiently and accurately than manual methods. Accurate segmentation is essential for quantifying the severity and extent of pavement defects and consequently, the overall condition index used for prioritizing rehabilitation and maintenance activities. Deep learning-based segmentation models are however, often supervised and require pixel-level annotations, which can be costly and time-consuming. While the recent evolution of zero-shot segmentation models can generate pixel-wise labels for unseen classes without any training data, they struggle with irregularities of cracks and textured pavement backgrounds. This research proposes a zero-shot segmentation model, PaveSAM, that can segment pavement distresses using bounding box prompts. By retraining SAM's mask decoder with just 180 images, pavement distress segmentation is revolutionized, enabling efficient distress segmentation using bounding box prompts, a capability not found in current segmentation models. This not only drastically reduces labeling efforts and costs but also showcases our model's high performance with minimal input, establishing the pioneering use of SAM in pavement distress segmentation. Furthermore, researchers can use existing open-source pavement distress images annotated with bounding boxes to create segmentation masks, which increases the availability and diversity of segmentation pavement distress datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。