arXiv:2409.15608cs.LG2024-09

用深度学习检测噪声数据中的拐点,准确率优于现有方法。

Deep Learning Approach for Knee Point Detection on Noisy Data

  • 基于归一化数据定义曲率,改进拐点数学表达
  • 在多类合成数据上实现最优F1分数,支持单/多拐点
  • 适用于系统性能优化等需要精准拐点识别的场景

曲线上的拐点是其上升后趋于平缓的点,在计算机系统中,该点标志着资源增加不再显著提升性能,常代表决策最优位置。然而,在噪声数据中识别拐点极具挑战性。以往工作均基于原始尺度数据定义拐点,本文则基于归一化数据提出离散点曲率的数学定义,建立连续函数曲率的离散推广,并讨论归一化对曲率与拐点位置的影响。由于缺乏真实标签和基准数据集,方法评估困难,为此本文构建模拟真实场景的合成数据:选取具备所需特性的函数并引入符合分布的噪声。进一步提出一种基于卷积神经网络(CNN)的U-Net-like架构的深度学习方法,以精准检测底层真实分布的拐点。实验表明,该模型在所有合成数据集上均优于现有方法,无论样本含单个或多个拐点,且在全部测试集上达到最高F1得分。

原文摘要 · Abstract (English)

A knee point on a curve is the one where the curve levels off after an increase. In a computer system, it marks the point at which the system's performance is no longer improving significantly despite adding extra resources. Thus a knee point often represents an optimal point for decision. However, identifying knee points in noisy data is a challenging task. All previous works defined knee points based on the data in the original scale. However, in this work, we define knee points based on normalized data and provide a mathematical definition of curvature for normalized discrete data points, based on the mathematical definition of curvature for continuous functions. The impact of normalization exerted on curvature and the location of knee points are also discussed. Nevertheless, assessing the effectiveness of methods is difficult in the absence of ground truth data and benchmark datasets, which makes comparing existing methods challenging. In view of this, we create synthetic data that simulate real-world scenarios. We achieve this by selecting a set of functions that possess the required characteristics in this research and then introducing noise that satisfies the underlying distribution. In addition, we present a deep-learning approach and employ a Convolutional Neural Network (CNN) with a U-Net-like architecture, to accurately detect the knee point(s) of the underlying true distribution. The proposed model is evaluated against state-of-the-art methods. Experiments show that our network outperforms existing methods in all synthetic datasets, regardless of whether the samples have single or multiple knee points. In fact, our model achieves the best $F_{1}$ scores among all existing methods in all the test sets.

拐点检测深度学习曲线分析噪声鲁棒

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。