arXiv:2504.06511cs.LG2025-04

用大模型重构电信用户行为建模,支持多模态与时间粒度自适应。

GTS-LUM: Reshaping User Behavior Modeling with LLMs in Telecommunications Industry

  • 采用编码器-适配器-大模型解码器架构,融合多模态数据与时间戳处理。
  • 在真实工业数据集上超越LLM4Rec,提升长期周期行为建模效果。
  • 适合电信行业用户画像、套餐设计等实际场景应用。

随着电信服务商将重点转向用户行为分析以优化套餐设计和营销策略,构建一个统一的端到端框架,以应对长期且具有周期性特征的用户行为序列,同时支持不同时间粒度、多模态输入和异构标签,成为关键挑战。本文提出GTS-LUM,一种新型用户行为建模方法,重新定义电信领域的建模范式。该模型采用(多模态)编码器-适配器-大模型解码器架构,并引入多项电信领域专属创新:通过先进的时间戳处理方法应对不同时间粒度;支持结构化表格与行为共现图等多模态输入,并利用Q-former结构提取语义信息进行对齐;此外,引入前置目标感知机制,突出与目标任务最相关的历史行为。在真实工业数据集上的大量实验验证了该端到端框架的有效性,结果表明GTS-LUM优于推荐系统中流行的LLM4Rec方法,为电信行业用户提供了一种高效且泛化能力强的行为建模解决方案。

原文摘要 · Abstract (English)

As telecommunication service providers shifting their focus to analyzing user behavior for package design and marketing interventions, a critical challenge lies in developing a unified, end-to-end framework capable of modeling long-term and periodic user behavior sequences with diverse time granularities, multi-modal data inputs, and heterogeneous labels. This paper introduces GTS-LUM, a novel user behavior model that redefines modeling paradigms in telecommunication settings. GTS-LUM adopts a (multi-modal) encoder-adapter-LLM decoder architecture, enhanced with several telecom-specific innovations. Specifically, the model incorporates an advanced timestamp processing method to handle varying time granularities. It also supports multi-modal data inputs -- including structured tables and behavior co-occurrence graphs -- and aligns these with semantic information extracted by a tokenizer using a Q-former structure. Additionally, GTS-LUM integrates a front-placed target-aware mechanism to highlight historical behaviors most relevant to the target. Extensive experiments on industrial dataset validate the effectiveness of this end-to-end framework and also demonstrate that GTS-LUM outperforms LLM4Rec approaches which are popular in recommendation systems, offering an effective and generalizing solution for user behavior modeling in telecommunications.

用户行为建模大模型应用电信分析多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。