结合主动学习与迁移学习,提升跨域时序异常检测效果
Active Learning and Transfer Learning for Anomaly Detection in Time-Series Data
- 用主动学习挑选关键样本,配合迁移学习适应新领域
- 性能随标注样本增加而提升,但增速逐渐变缓
- 适合资源有限下需高效标注的工业异常检测场景
本文研究将主动学习与迁移学习结合用于跨域时序数据异常检测的有效性。结果表明,聚类与主动学习存在交互作用,通常单个聚类(即不使用聚类)表现最佳。主动学习引入新样本可提升模型性能,但改进速度低于文献报道,原因在于实验设计中采样池与测试池使用了不同数据样本。我们评估了在多个数据集上迁移学习与主动学习组合的上限性能,发现性能初期提升明显,但随着目标样本不断加入训练,性能逐渐趋于平缓。这一下降趋势可能说明主动学习能有效排序样本,优先选择高价值样本,后期加入的低价值样本导致性能增长放缓。综合来看,主动学习有效,但模型性能提升与标注样本数量呈线性平缓关系。
原文摘要 · Abstract (English)
This paper examines the effectiveness of combining active learning and transfer learning for anomaly detection in cross-domain time-series data. Our results indicate that there is an interaction between clustering and active learning and in general the best performance is achieved using a single cluster (in other words when clustering is not applied). Also, we find that adding new samples to the training set using active learning does improve model performance but that in general, the rate of improvement is slower than the results reported in the literature suggest. We attribute this difference to an improved experimental design where distinct data samples are used for the sampling and testing pools. Finally, we assess the ceiling performance of transfer learning in combination with active learning across several datasets and find that performance does initially improve but eventually begins to tail off as more target points are selected for inclusion in training. This tail-off in performance may indicate that the active learning process is doing a good job of sequencing data points for selection, pushing the less useful points towards the end of the selection process and that this tail-off occurs when these less useful points are eventually added. Taken together our results indicate that active learning is effective but that the improvement in model performance follows a linear flat function concerning the number of points selected and labelled.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。