arXiv:2605.30388cs.LG2026-05

为无监督海事异常检测设计新评估指标,提升模型可靠性。

A Novel Evaluation Metric for Unsupervised Learning in AIS-Based Maritime Anomaly Detection: MADQI

  • 用空间与行为特征结合的四维指标评估无标签数据中的异常检测效果。
  • 在真实AIS数据上获得80.37%的综合评分,极端异常检测得分高达0.907。
  • 适合海事安全、智能航运等领域的无监督异常检测研究者使用。

本文提出一种新的系统性框架,用于检测基于自动识别系统(AIS)的海事数据中的异常行为,包括速度异常、位置跳跃、时间断层和转向角度异常。尽管孤立森林等无监督学习算法广泛应用于异常检测,但缺乏系统且有意义的评估手段。为此,本文提出一个名为海事异常检测质量指数(MADQI)的新质量度量指标。MADQI是一个无需标签数据的复合指标,通过霍弗林距离分析空间与行为特征来识别异常。该框架整合了四个相互关联的指标:异常率一致性(ARC)、物理合理性得分(PPS)、得分分布分离度(SDS)和极端案例证据(ECE),并通过多块评估与自适应缩放实现自动归一化。在真实AIS数据集上的实验表明,该框架获得80.37%的MADQI得分,表现出良好的异常检测能力。其中,ECE和ARC分别达到0.907和1.000,证明其在极端异常识别和异常率稳定性方面表现优异。整体结果验证了该框架在无监督海事异常检测评估中的有效性与可靠性。

原文摘要 · Abstract (English)

This paper introduces a new systematic framework for detecting anomalies in maritime Automatic Identification System (AIS) datasets. These anomalies include abnormal vessel behaviours related to speed, position jumps, time gaps, and turn angles. Although unsupervised learning algorithms such as Isolation Forest are widely used for detecting anomalous vessel movements, they often lack systematic and meaningful evaluation measures. To address this limitation, we propose a novel quality metric called Maritime Anomaly Detection Quality Index (MADQI). The prosed MADQI is a composite index designed to evaluate the anomaly detection performance of machine learning models without requiring labelled data. The proposed framework uses Haversine distance calculations to analyse AIS datasets and identify anomalies based on their spatial and behavioural characteristics. The proposed MADQI evaluation framework integrates four interconnected metrics: Anomaly Rate Consistency (ARC), Physical Plausibility Score (PPS), Score Distribution Separation (SDS), and Extreme Case Evidence (ECE). These metrics are combined through automatic normalisation using multi-chunk evaluation and adaptive scaling techniques. Experimental results on the AIS dataset show that the proposed framework achieved a MADQI score of 80.37%, demonstrating its effectiveness for unsupervised anomaly detection. In particular, the algorithm performed strongly in identifying abnormal vessel behaviour. Among the individual MADQI components, ECE and ARC achieved scores of 0.907 and 1.000, respectively, indicating excellent capability in detecting extreme anomalies and maintaining anomaly rate consistency. Overall, these results are encouraging and demonstrate that the proposed framework provides a reliable and meaningful approach for evaluating unsupervised anomaly detection in maritime AIS data.

异常检测AIS数据无监督学习海事安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。