arXiv:2602.14492cs.CLcs.IR2026-02KDD被引 1

用查询动态生成用户表示,让模型更懂场景需求。

Query as Anchor: Scenario-Adaptive User Representation via Large Language Model

  • 以查询为锚点,动态合成用户表征,突破静态嵌入局限。
  • 在10个支付宝场景中实现最优性能,线上测试验证效果显著。
  • 适合需要精准场景适配的推荐与个性化系统使用。

工业级用户表征学习需兼顾泛化性与任务敏感性,但现有方法多生成静态、通用的嵌入向量,难以在统一向量空间中平衡下游场景的差异需求。异构多源数据还带来噪声和模态冲突,影响表征质量。我们提出Query-as-Anchor框架,将用户建模从静态编码转向动态、查询感知的生成。为增强大模型对用户的理解,我们构建了UserU——一个大规模预训练数据集,对齐多模态行为序列与用户理解语义;并设计Q-Anchor Embedding架构,通过联合对比-自回归优化,将分层粗到细编码器融入双塔大模型,实现查询感知的用户表征。为弥合通用预训练与特定业务逻辑之间的差距,引入基于聚类的软提示微调,强化判别性潜在结构,引导模型注意力聚焦于场景特异性模态。部署方面,将锚定查询置于序列末端,支持KV缓存加速推理,增量延迟可忽略。在10个支付宝工业基准上评估显示,该方法持续达到最先进水平,具备强可扩展性与高效部署能力。在支付宝生产环境的两个真实场景中开展大规模在线A/B测试,进一步验证其实际有效性。代码将公开发布于:https://github.com/JhCircle/Q-Anchor。

原文摘要 · Abstract (English)

Industrial-scale user representation learning requires balancing robust universality with acute task-sensitivity. However, existing paradigms primarily yield static, task-agnostic embeddings that struggle to reconcile the divergent requirements of downstream scenarios within unified vector spaces. Furthermore, heterogeneous multi-source data introduces inherent noise and modality conflicts, degrading representation. We propose Query-as-Anchor, a framework shifting user modeling from static encoding to dynamic, query-aware synthesis. To empower Large Language Models (LLMs) with deep user understanding, we first construct UserU, an industrial-scale pre-training dataset that aligns multi-modal behavioral sequences with user understanding semantics, and our Q-Anchor Embedding architecture integrates hierarchical coarse-to-fine encoders into dual-tower LLMs via joint contrastive-autoregressive optimization for query-aware user representation. To bridge the gap between general pre-training and specialized business logic, we further introduce Cluster-based Soft Prompt Tuning to enforce discriminative latent structures, effectively aligning model attention with scenario-specific modalities. For deployment, anchoring queries at sequence termini enables KV-cache-accelerated inference with negligible incremental latency. Evaluations on 10 Alipay industrial benchmarks show consistent SOTA performance, strong scalability, and efficient deployment. Large-scale online A/B testing in Alipay's production system across two real-world scenarios further validates its practical effectiveness. Our code is prepared for public release and will be available at: https://github.com/JhCircle/Q-Anchor.

用户表征大模型推荐系统动态生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。