用少量模型推理结果,让百亿低活跃用户精准建模。
ScaleToT: Generalizing Structured LLM Reasoning for Billion-Scale Low-Activity User Modeling

- 从少量用户中学习结构化推理链,推广至全量低活跃用户。
- 在线实验提升30天寿命价值6.738%,仅覆盖7.32%人群。
- 适合大规模用户建模场景,显著降低计算成本。
精准用户建模通常依赖丰富的交互历史,但对百亿级低活跃用户而言,此类数据不可用。大语言模型(LLMs)可从静态资料推断潜在用户状态,但在资料稀疏时推理不可靠,且对十亿用户逐一推理代价过高。本文提出ScaleToT,通过小规模LLM处理子集学习结构化推理,并扩展至全体低活跃用户。为提升可靠性,ScaleToT采用熵约束的思维树(ToT)优化机制构建有类型的状态链;为适应稀疏资料,教师生成的链用于监督微调(SFT)和基于结果驱动的段感知隐式奖励策略优化(OSIPO),训练学生模型。随后将学生模型的推理表示迁移到轻量级资料编码器,为其余用户共享推理信号而无需运行大模型。我们在十亿级广告部署中评估其在生命周期价值(LTV)预测的表现:随机在线A/B测试使LT30提升6.738%,离线推理覆盖仅7.32%的潜在人群,相比全量推理大幅降低计算开销。
原文摘要 · Abstract (English)
Accurate user modeling often depends on rich interaction histories, which are unavailable for billions of low-activity users. Large Language Models (LLMs) can infer latent user states from static profiles, but this reasoning becomes unreliable when profiles are sparse, and applying an LLM to billions of users is prohibitively expensive. We present ScaleToT, which learns structured reasoning from a small LLM-processed subset and extends it to the broader low-activity user population. To improve reasoning reliability, ScaleToT constructs typed user-state chains with a bounded entropy-guided Tree-of-Thought (ToT) refinement procedure. To make this structured reasoning usable from sparse profiles, the teacher-curated chains are used to train a student model on static profiles through supervised fine-tuning (SFT) and Outcome-Driven Segment-Aware Implicit Reward Policy Optimization (OSIPO). ScaleToT then transfers the student's reasoning representations to a lightweight profile encoder, providing shared reasoning signals for the remaining users without LLM inference. We evaluate ScaleToT on lifetime value (LTV) prediction in a billion-scale advertising deployment. A randomized online A/B test increased LT30 by 6.738\%, while offline reasoning covered only 7.32\% of the potential population, greatly reducing compute cost compared with full-population reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。