arXiv:2409.07629cs.SEcs.AI2024-09中稿 · TSE in October 202…被引 11

提出分治学习框架DaL,解决配置性能预测中的稀疏性难题。

Dividable Configuration Performance Learning

  • 采用分治学习思想,将配置空间划分为多个区域,每区构建局部稀疏模型。
  • 在60组测试中,44次表现不劣于当前最优方法,最高准确率提升1.61倍。
  • 自适应确定最佳划分数,适用于多种系统,提升全局模型性能。

机器/深度学习模型已被广泛用于预测软件系统的配置性能。然而,一个关键但未被解决的挑战是配置空间固有的稀疏性:配置选项(特征)的影响和数据样本分布高度稀疏。本文提出一种模型无关且对稀疏性鲁棒的预测框架DaL,基于新的可分学习范式,通过‘分而学’构建模型。为应对样本稀疏,将配置空间中的样本划分为若干远距离区域,每个区域构建局部稀疏模型(如正则化层次交互神经网络),以处理特征稀疏问题。新给定的配置将被分配至对应区域的模型进行最终预测。此外,DaL无需额外训练或采样即可自适应确定系统与样本规模下的最优划分数量。在12个真实系统和5组训练数据上的实验表明,相比现有最优方法,DaL在60组测试中44次表现不差,最高准确率提升1.61倍;所需样本更少即可达到相同或更好精度;训练开销可接受。特别地,自适应参数d在76.43%的独立运行中达到最优值。结果还证实,可分学习范式比集成学习等类似范式更适用于配置性能预测。实践中,当使用全局模型作为局部模型基础时,DaL显著提升其性能,进一步体现其灵活性。

原文摘要 · Abstract (English)

Machine/deep learning models have been widely adopted for predicting the configuration performance of software systems. However, a crucial yet unaddressed challenge is how to cater for the sparsity inherited from the configuration landscape: the influence of configuration options (features) and the distribution of data samples are highly sparse. In this paper, we propose a model-agnostic and sparsity-robust framework for predicting configuration performance, dubbed DaL, based on the new paradigm of dividable learning that builds a model via "divide-and-learn". To handle sample sparsity, the samples from the configuration landscape are divided into distant divisions, for each of which we build a sparse local model, e.g., regularized Hierarchical Interaction Neural Network, to deal with the feature sparsity. A newly given configuration would then be assigned to the right model of division for the final prediction. Further, DaL adaptively determines the optimal number of divisions required for a system and sample size without any extra training or profiling. Experiment results from 12 real-world systems and five sets of training data reveal that, compared with the state-of-the-art approaches, DaL performs no worse than the best counterpart on 44 out of 60 cases with up to 1.61x improvement on accuracy; requires fewer samples to reach the same/better accuracy; and producing acceptable training overhead. In particular, the mechanism that adapted the parameter d can reach the optimal value for 76.43% of the individual runs. The result also confirms that the paradigm of dividable learning is more suitable than other similar paradigms such as ensemble learning for predicting configuration performance. Practically, DaL considerably improves different global models when using them as the underlying local models, which further strengthens its flexibility.

配置性能稀疏学习分治学习模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。