arXiv:2508.20396cs.LG2025-08

用大模型对齐房源图文信息,提升搜索精准度与推荐效果。

BiListing: Modality Alignment for Listings

  • 通过大语言模型和图文预训练模型融合多源异构数据,生成统一嵌入向量。
  • 在真实业务中实现0.425% NDCB提升,带来数千万增量收入。
  • 支持零样本搜索、冷启动场景,适合需要跨模态理解的推荐系统。

Airbnb 是旅行住宿领域的领先平台,长期依赖结构化数据来理解、排序和推荐房源。随着表示学习的发展,从文本和图像中提取丰富信息变得可行。主流方法是为文本和图片创建嵌入向量,用于计算房源间相似性或作为机器学习模型特征。然而,一个Airbnb房源包含多张图片、标题、描述、评论等多种非结构化内容,如何整合这些不同来源的嵌入形成统一表示仍具挑战。本文提出BiListing(双模态房源),利用大语言模型和预训练图文模型对房源的文本与图像进行对齐。该方法可将每条房源的非结构化信息压缩为单一模态嵌入向量,具备零样本搜索能力,有效缓解冷启动问题,并支持单模态或双模态的房源间搜索。我们在线下和线上测试中验证了该嵌入在搜索排序模型中的有效性,成功部署于生产环境,带来0.425%的NDCB提升,驱动数千万美元增量营收。

原文摘要 · Abstract (English)

Airbnb is a leader in offering travel accommodations. Airbnb has historically relied on structured data to understand, rank, and recommend listings to guests due to the limited capabilities and associated complexity arising from extracting meaningful information from text and images. With the rise of representation learning, leveraging rich information from text and photos has become easier. A popular approach has been to create embeddings for text documents and images to enable use cases of computing similarities between listings or using embeddings as features in an ML model. However, an Airbnb listing has diverse unstructured data: multiple images, various unstructured text documents such as title, description, and reviews, making this approach challenging. Specifically, it is a non-trivial task to combine multiple embeddings of different pieces of information to reach a single representation. This paper proposes BiListing, for Bimodal Listing, an approach to align text and photos of a listing by leveraging large-language models and pretrained language-image models. The BiListing approach has several favorable characteristics: capturing unstructured data into a single embedding vector per listing and modality, enabling zero-shot capability to search inventory efficiently in user-friendly semantics, overcoming the cold start problem, and enabling listing-to-listing search along a single modality, or both. We conducted offline and online tests to leverage the BiListing embeddings in the Airbnb search ranking model, and successfully deployed it in production, achieved 0.425% of NDCB gain, and drove tens of millions in incremental revenue.

多模态推荐系统嵌入大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。