arXiv:2503.23436cs.IR2025-03中稿 · ICIC 2025 oral被引 1

用小波变换捕捉用户兴趣的时频特征,提升长序列推荐效果。

Filtering with Time-frequency Analysis: An Adaptive and Lightweight Model for Sequential Recommender Systems Based on Discrete Wavelet Transform

  • 基于离散小波变换构建自适应时频滤波器,分离多尺度兴趣信号
  • 在多个数据集上优于主流模型,长序列下优势更明显
  • 轻量高效,适合处理长序列推荐场景

序列推荐系统(SRS)旨在建模用户行为序列以捕捉其动态演变的兴趣。近年来基于Transformer的SRS取得了显著进展,但研究发现Transformer中的自注意力机制本质上是低通滤波器,会忽略可能包含有意义兴趣模式的高频信息。为此,我们引入来自数字信号处理领域的离散小波变换(DWT)这一经典时频分析技术,能够有效处理高低频信息。我们设计了一种基于DWT的自适应时频滤波器,将用户兴趣分解为不同频率与时间尺度的信号,并可自动学习各信号权重。进一步地,我们提出DWTRec,一种完全基于该自适应时频滤波器的序列推荐模型。得益于快速DWT算法,DWTRec在理论上具有更低的时间与空间复杂度,且擅长建模长序列。实验表明,该模型在不同领域、稀疏程度及平均序列长度的数据集上均超越现有最优基线模型。尤其当序列变长时,性能提升尤为显著,验证了其在长序列推荐中的优势。

原文摘要 · Abstract (English)

Sequential Recommender Systems (SRS) aim to model sequential behaviors of users to capture their interests which usually evolve over time. Transformer-based SRS have achieved distinguished successes recently. However, studies reveal self-attention mechanism in Transformer-based models is essentially a low-pass filter and ignores high frequency information potentially including meaningful user interest patterns. This motivates us to seek better filtering technologies for SRS, and finally we find Discrete Wavelet Transform (DWT), a famous time-frequency analysis technique from digital signal processing field, can effectively process both low-frequency and high-frequency information. We design an adaptive time-frequency filter with DWT technique, which decomposes user interests into multiple signals with different frequency and time, and can automatically learn weights of these signals. Furthermore, we develop DWTRec, a model for sequential recommendation all based on the adaptive time-frequency filter. Thanks to fast DWT technique, DWTRec has a lower time complexity and space complexity theoretically, and is Proficient in modeling long sequences. Experiments show that our model outperforms state-of-the-art baseline models in datasets with different domains, sparsity levels and average sequence lengths. Especially, our model shows great performance increase in contrast with previous models when the sequence grows longer, which demonstrates another advantage of our model.

序列推荐小波变换时频分析轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。