基于长短兴趣建模与自适应净化,提升搜索补全的个性化与安全性。
Personalized Query Auto-Completion for Long and Short-Term Interests with Adaptive Detoxification Generation
- 分层建模用户长短期兴趣,提升个性化表达能力。
- 引入[Reject]标记实现在线净化,生成内容零毒且相关。
- 工业级数据验证,上线后效果显著,已服务数亿用户。
查询自动补全(QAC)在现代搜索系统中至关重要。然而,实际应用面临两大挑战:一是需构建用户层次化的个性化表征,现有方法多将搜索行为视为单一整体表示,在生成场景下表现不足;二是查询前缀通常较短,易含错别字或敏感信息,相比传统文本生成更易生成有害内容,影响用户体验并引发公关风险。为此,我们提出新型模型LaD,同时捕捉用户长期与短期兴趣,并集成自适应净化机制。在LaD中,个性化信息在粗粒度与细粒度层面分层提取,兼顾信息保留与在线生成效率。进一步提出基于拒绝偏好优化(RPO)的在线训练方法,通过在训练与推理中引入特殊标记[Reject],实现动态净化。最终生成结果既无毒性又高度相关。我们在大规模工业数据集上进行实验,并开展线上A/B测试,创下近两年来产品单次实验最大指标提升。该模型已在快手搜索上线,支撑数亿活跃用户的主流量入口。代码已开源:https://github.com/JXZe/LaD。
原文摘要 · Abstract (English)
Query auto-completion (QAC) plays a crucial role in modern search systems. However, in real-world applications, there are two pressing challenges that still need to be addressed. First, there is a need for hierarchical personalized representations for users. Previous approaches have typically used users' search behavior as a single, overall representation, which proves inadequate in more nuanced generative scenarios. Additionally, query prefixes are typically short and may contain typos or sensitive information, increasing the likelihood of generating toxic content compared to traditional text generation tasks. Such toxic content can degrade user experience and lead to public relations issues. Therefore, the second critical challenge is detoxifying QAC systems. To address these two limitations, we propose a novel model (LaD) that captures personalized information from both long-term and short-term interests, incorporating adaptive detoxification. In LaD, personalized information is captured hierarchically at both coarse-grained and fine-grained levels. This approach preserves as much personalized information as possible while enabling online generation within time constraints. To move a futher step, we propose an online training method based on Reject Preference Optimization (RPO). By incorporating a special token [Reject] during both the training and inference processes, the model achieves adaptive detoxification. Consequently, the generated text presented to users is both non-toxic and relevant to the given prefix. We conduct comprehensive experiments on industrial-scale datasets and perform online A/B tests, delivering the largest single-experiment metric improvement in nearly two years of our product. Our model has been deployed on Kuaishou search, driving the primary traffic for hundreds of millions of active users. The code is available at https://github.com/JXZe/LaD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。