arXiv:2508.00956cs.LGcs.AI2025-08KDD

用离散令牌统一表示用户行为,存得少、算得快、效果好

FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation

  • 将多源用户数据转为统一离散令牌,用共享与专属码本压缩表征
  • 在多个基准上超越专用模型,存储和计算成本大幅降低
  • 适合需要高效用户建模的工业级推荐系统场景

用户表征学习是大规模网络平台个性化服务的基础。尽管重要,传统连续嵌入方法面临多源数据融合缺乏统一范式、信息密度低导致存储开销大、缺乏多尺度建模粒度等问题。为此,我们提出 FOUNDv2,一种以统一用户量化分词器(U2QT)为核心的用户表征方案。该框架通过两阶段结构,将异构用户数据转化为标准化离散令牌空间:先提取紧凑特征表示,再利用多视角 RQ-VAE 结合共享与源特定码本进行高效离散化。为赋予表征预测能力,进一步设计多尺度对齐目标,捕捉细粒度行为依赖与宏观时间周期性。在多个基准上的实验表明,FOUNDv2 持续优于任务专用基线,同时显著降低存储与计算成本。最终,其在支付宝的大规模部署验证了在多样化工业场景中的可扩展性与高效性。代码已开源:https://github.com/chuanhe1999/FOUNDv2。

原文摘要 · Abstract (English)

User representation learning serves as a fundamental pillar for personalized services on large-scale web platforms. Despite its importance, conventional continuous embedding methods face significant challenges, including the lack of a unified paradigm for multi-source data integration, prohibitive storage overhead due to low information density, and the lack of multi-scale modeling granularity. To overcome these limitations, we introduce FOUNDv2, a comprehensive user representation scheme centered on the Unified User Quantized Tokenizer U2QT) framework. FOUNDv2 transforms heterogeneous user data into a standardized discrete token space through a robust two-stage architecture. Specifically, the framework first extracts compact feature representations and subsequently employs a multi-view RQ-VAE to discretize them into storage-efficient tokens using shared and source-specific codebooks. To empower these representations with predictive intelligence, we further design multi-scale alignment objectives to capture both fine-grained behavioral dependencies and macro-temporal periodicity. Extensive experiments on various benchmarks demonstrate that FOUNDv2 consistently outperforms task-specific baselines while achieving substantial reductions in storage and computational costs. Finally, the large-scale deployment of FOUNDv2 on Alipay validates its practical scalability and efficiency across diverse industrial scenarios. The main code is available at: https://github.com/chuanhe1999/FOUNDv2.

用户表征离散化量化推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。