用多头自注意力提升张量分解,更好预测动态服务质量数据缺失值。
Multi-Head Self-Attending Neural Tucker Factorization
- 基于神经网络与多头自注意机制改进传统张量分解方法。
- 在两个真实QoS数据集上优于现有模型,显著提升缺失值预测准确率。
- 适合处理高维、不完整、动态变化的服务质量数据建模任务。
服务质量(QoS)数据具有动态时间模式,对准确预测缺失值至关重要。这些模式源于用户与服务间随时间演变的交互,因此捕捉数据中固有的时间动态性对于提升预测性能极为重要。随着QoS数据集规模与复杂度增加,现有模型难以提供精准预测,亟需更灵活、动态的方法来更好地揭示大规模QoS数据中的潜在模式。为此,本文提出一种面向高维不完整(HDI)张量的神经网络张量分解方法——多头自注意神经托克西尔分解(MSNTucF)。该模型通过双重设计思想:首先利用神经网络结构扩展传统托克西尔分解框架,其次引入多头自注意模块以强化非线性潜在交互学习能力。在两个来自真实应用的动态QoS数据集上的实证研究表明,所提MSNTucF模型在估计缺失观测值方面显著优于当前最优基准模型,体现出其学习非线性时空表示的强大能力。
原文摘要 · Abstract (English)
Quality-of-service (QoS) data exhibit dynamic temporal patterns that are crucial for accurately predicting missing values. These patterns arise from the evolving interactions between users and services, making it essential to capture the temporal dynamics inherent in such data for improved prediction performance. As the size and complexity of QoS datasets increase, existing models struggle to provide accurate predictions, highlighting the need for more flexible and dynamic methods to better capture the underlying patterns in large-scale QoS data. To address this issue, we introduce a neural network-based tensor factorization approach tailored for learning spatiotemporal representations of high-dimensional and incomplete (HDI) tensors, namely the Multi-head Self-attending Neural Tucker Factorization (MSNTucF). The model is elaborately designed for modeling intricate nonlinear spatiotemporal feature interaction patterns hidden in real world data with a two-fold idea. It first employs a neural network structure to generalize the traditional framework of Tucker factorization and then proposes to leverage a multi-head self-attending module to enforce nonlinear latent interaction learning. In empirical studies on two dynamic QoS datasets from real applications, the proposed MSNTucF model demonstrates superior performance compared to state-of-the-art benchmark models in estimating missing observations. This highlights its ability to learn non-linear spatiotemporal representations of HDI tensors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。