arXiv:2412.03880cs.LGcs.CE2024-12被引 1

用自监督学习在少量标注数据下实现桥梁健康监测异常检测

Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data

  • 通过自监督预训练+微调框架,利用大量无标签数据提升模型性能
  • 在仅少量标注数据下,F1分数显著高于传统监督学习方法
  • 适合标签稀缺的大型结构健康监测场景,可作初步异常筛查工具

结构健康监测(SHM)近年来发展迅速,积累了海量监测数据。但数据中不可避免存在异常,严重影响其有效利用。深度学习虽已用于桥梁SHM异常检测,但多数模型需大量标注数据,而人工标注成本高、耗时长,难以适用于大规模SHM数据集。为此,本文探索自监督学习(SSL)——一种结合无监督预训练与有监督微调的新范式。该框架仅需少量标注数据进行微调,同时充分利用大量无标签SHM数据进行预训练。在两座在役桥梁的SHM数据上对比主流SSL方法,结果表明:在标注数据极少的情况下,SSL显著提升异常检测性能,相比传统监督训练获得更高F1分数。研究验证了SSL在大规模SHM数据上的有效性与优势,为标签稀缺场景提供了高效异常检测工具。

原文摘要 · Abstract (English)

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective utilization. Recently, deep learning has emerged as an efficient and effective approach for anomaly detection in bridge SHM. Despite its progress, many deep learning models require large amounts of labeled data for training. The process of labeling data, however, is labor-intensive, time-consuming, and often impractical for large-scale SHM datasets. To address these challenges, this work explores the use of self-supervised learning (SSL), an emerging paradigm that combines unsupervised pre-training and supervised fine-tuning. The SSL-based framework aims to learn from only a very small quantity of labeled data by fine-tuning, while making the best use of the vast amount of unlabeled SHM data by pre-training. Mainstream SSL methods are compared and validated on the SHM data of two in-service bridges. Comparative analysis demonstrates that SSL techniques boost data anomaly detection performance, achieving increased F1 scores compared to conventional supervised training, especially given a very limited amount of labeled data. This work manifests the effectiveness and superiority of SSL techniques on large-scale SHM data, providing an efficient tool for preliminary anomaly detection with scarce label information.

自监督学习异常检测结构健康监测小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。