arXiv:2603.25027cs.IR2026-03中稿 · ACM Web Conference…被引 1

用多项式核替代注意力,实现快速且准确的长序列推荐。

Hyena Operator for Fast Sequential Recommendation

  • 用勒让德多项式设计卷积核,建模长期时间依赖。
  • 在多个数据集上排名精度超越基线,训练速度提升6倍。
  • 适合处理长用户行为序列,兼顾效率与表达能力。

基于注意力的序列推荐模型虽精度高,但复杂度为二次方,难以处理长用户历史。如Hyena等次二次算子在语言建模中表现优异,但在推荐领域潜力未被充分挖掘。我们指出,传统Hyena在稀疏、长序列上的表征能力有限。为此提出HyenaRec,结合基于多项式的核参数化与门控卷积:采用勒让德正交多项式设计卷积核,构建平滑紧凑的长期依赖建模基础;辅以门控机制捕捉短期行为突变,实现全局演化与局部兴趣的平衡。该架构在序列长度上线性扩展,表达力更强。大量实验表明,HyenaRec在多个真实数据集上持续优于注意力、循环网络及其他基线模型,在排序精度上领先;训练速度最快提升6倍,尤其在长序列场景下效率优势显著,且不牺牲精度。结果证明,基于多项式的核参数化是序列推荐中可扩展的注意力替代方案。

原文摘要 · Abstract (English)

Sequential recommendation models, particularly those based on attention, achieve strong accuracy but incur quadratic complexity, making long user histories prohibitively expensive. Sub-quadratic operators such as Hyena provide efficient alternatives in language modeling, but their potential in recommendation remains underexplored. We argue that Hyena faces challenges in recommendation due to limited representation capacity on sparse, long user sequences. To address these challenges, we propose HyenaRec, a novel sequential recommender that integrates polynomial-based kernel parameterization with gated convolutions. Specifically, we design convolutional kernels using Legendre orthogonal polynomials, which provides a smooth and compact basis for modeling long-term temporal dependencies. A complementary gating mechanism captures fine-grained short-term behavioral bursts, yielding a hybrid architecture that balances global temporal evolution with localized user interests under sparse feedback. This construction enhances expressiveness while scaling linearly with sequence length. Extensive experiments on multiple real-world datasets demonstrate that HyenaRec consistently outperforms Attention-, Recurrent-, and other baselines in ranking accuracy. Moreover, it trains significantly faster (up to 6x speedup), with particularly pronounced advantages on long-sequence scenarios where efficiency is maintained without sacrificing accuracy. These results highlight polynomial-based kernel parameterization as a principled and scalable alternative to attention for sequential recommendation.

序列推荐高效模型多项式核长序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。