Airbnb改进排序算法,在保持可扩展性的同时提升排序准确性。
Beyond Pairwise Learning-To-Rank At Airbnb
- 构建全对比较框架,捕捉物品间的相互影响关系。
- 在线下和线上实验中显著提升用户搜索体验。
- 适合需要高精度排序的工业级搜索系统参考。
排序算法需兼顾可扩展性、准确性和总序一致性,但三者不可兼得,我们称之为排序算法的SAT定理。当前在Airbnb的实践中,采用基于成对学习排序(Pairwise LTR)模型作为基础,其线性扩展性与强性能(如NDCG)使其成为工业应用的理想选择。然而,该方法忽略物品间交互,影响准确性。为此,我们提出一种“真正”的成对排序模型,通过同时比较每个物品与其余所有物品的优劣程度和相似度,构建‘全对比较’框架,实现全局互动建模。该方法虽牺牲部分可扩展性与总序性,但通过策略缓解,并在实际场景中验证了其在用户搜索体验上的显著提升。
原文摘要 · Abstract (English)
There are three fundamental asks from a ranking algorithm: it should scale to handle a large number of items, sort items accurately by their utility, and impose a total order on the items for logical consistency. But here's the catch-no algorithm can achieve all three at the same time. We call this limitation the SAT theorem for ranking algorithms. Given the dilemma, how can we design a practical system that meets user needs? Our current work at Airbnb provides an answer, with a working solution deployed at scale. We start with pairwise learning-to-rank (LTR) models-the bedrock of search ranking tech stacks today. They scale linearly with the number of items ranked and perform strongly on metrics like NDCG by learning from pairwise comparisons. They are at a sweet spot of performance vs. cost, making them an ideal choice for several industrial applications. However, they have a drawback-by ignoring interactions between items, they compromise on accuracy. To improve accuracy, we create a "true" pairwise LTR model-one that captures interactions between items during pairwise comparisons. But accuracy comes at the expense of scalability and total order, and we discuss strategies to counter these challenges. For greater accuracy, we take each item in the search result, and compare it against the rest of the items along two dimensions: (1) Superiority: How strongly do searchers prefer the given item over the remaining ones? (2) Similarity: How similar is the given item to all the other items? This forms the basis of our "all-pairwise" LTR framework, which factors in interactions across all items at once. Looking at items on the search result page all together-superiority and similarity combined-gives us a deeper understanding of what searchers truly want. We quantify the resulting improvements in searcher experience through offline and online experiments at Airbnb.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。