用合成前缀缓解搜索补全中的推荐偏见。
Synthetic Prefixes to Mitigate Bias in Real-Time Neural Query Autocomplete
- 从历史查询生成合成前缀,丰富训练数据多样性。
- 部署后均值倒数排名提升,用户参与度显著提高。
- 适合需要低延迟排序的电商搜索场景使用。
我们提出一种以数据为中心的方法,通过合成前缀缓解实时神经查询补全系统中的呈现偏见。这些前缀由未启用补全功能时的完整用户查询生成,从而在训练数据中引入更多样化且更少偏见的样本。该方法解决了来自实时补全交互中行为信号的固有偏见问题,因模型建议会直接影响用户行为。我们的神经排序器针对严格延迟约束优化,采用丰富的特征,包括查询流行度、季节性、模糊匹配分数及上下文信号(如部门偏好、设备类型、与先前查询的垂直对齐)。为支持高效训练,我们提出一种任务特定的列表损失简化方法,利用每前缀仅一个真实选择的结构,将计算复杂度从 $O(n^2)$ 降至 $O(n)$。在大规模电商环境中部署后,系统在均值倒数排名等指标上实现统计显著提升,验证了合成前缀不仅能增强泛化能力,还为其他低延迟排序任务(如相关搜索、查询推荐)提供可扩展的偏见缓解路径。
原文摘要 · Abstract (English)
We introduce a data-centric approach for mitigating presentation bias in real-time neural query autocomplete systems through the use of synthetic prefixes. These prefixes are generated from complete user queries collected during regular search sessions where autocomplete was not active. This allows us to enrich the training data for learning to rank models with more diverse and less biased examples. This method addresses the inherent bias in engagement signals collected from live query autocomplete interactions, where model suggestions influence user behavior. Our neural ranker is optimized for real-time deployment under strict latency constraints and incorporates a rich set of features, including query popularity, seasonality, fuzzy match scores, and contextual signals such as department affinity, device type, and vertical alignment with previous user queries. To support efficient training, we introduce a task-specific simplification of the listwise loss, reducing computational complexity from $O(n^2)$ to $O(n)$ by leveraging the query autocomplete structure of having only one ground-truth selection per prefix. Deployed in a large-scale e-commerce setting, our system demonstrates statistically significant improvements in user engagement, as measured by mean reciprocal rank and related metrics. Our findings show that synthetic prefixes not only improve generalization but also provide a scalable path toward bias mitigation in other low-latency ranking tasks, including related searches and query recommendations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。