arXiv:2510.16803cs.IR2025-10ACL

用少量页面标注实现多模态搜索重排,大幅降本提效。

An Efficient Framework for Whole-Page Reranking via Single-Modal Supervision

  • 利用单模态强排序器引导跨模态相关性对齐
  • 仅需70%-90%标注量,排名效果优于全标注模型
  • 适合追求低成本高精度的搜索系统优化场景

全页重排在塑造搜索引擎用户体验中起关键作用,需融合文档、图像、视频及大模型输出等多模态结果。现有方法依赖大规模人工标注,成本高且复杂,因全页标注需综合评估整体页面并考虑跨模态相关性差异。本文提出SMAR框架,仅用有限全页标注,借助高质量单模态排序器指导模态间相关性对齐,实现有效重排。首先在各模态数据上训练强单模态排序器;然后为每查询选取其部分输出构建候选页面,并进行页面级人工标注;最后使用这些少量标注训练全页重排器,强制保持各模态内部排序一致性。在Qilin与Baidu数据集上的实验表明,SMAR将标注成本降低70%-90%,显著优于基线。在百度APP的离线与在线A/B测试中,标准指标和用户体验指标均有明显提升,充分验证了该方法在真实搜索场景中的有效性与实用价值。

原文摘要 · Abstract (English)

The whole-page reranking plays a critical role in shaping the user experience of search engines, which integrates retrieval results from multiple modalities, such as documents, images, videos, and LLM outputs. Existing methods mainly rely on large-scale human-annotated data, which is costly to obtain and time-consuming. This is because whole-page annotation is far more complex than single-modal: it requires assessing the entire result page while accounting for cross-modal relevance differences. Thus, how to improve whole-page reranking performance while reducing annotation costs is still a key challenge in optimizing search engine result pages(SERP). In this paper, we propose SMAR, a novel whole-page reranking framework that leverages strong Single-modal rankers to guide Modal-wise relevance Alignment for effective Reranking, using only limited whole-page annotation to outperform fully-annotated reranking models. Specifically, high-quality single-modal rankers are first trained on data specific to their respective modalities. Then, for each query, we select a subset of their outputs to construct candidate pages and perform human annotation at the page level. Finally, we train the whole-page reranker using these limited annotations and enforcing consistency with single-modal preferences to maintain ranking quality within each modality. Experiments on the Qilin and Baidu datasets demonstrate that SMAR reduces annotation costs by about 70-90\% while achieving significant ranking improvements compared to baselines. Further offline and online A/B testing on Baidu APPs also shows notable gains in standard ranking metrics as well as user experience indicators, fully validating the effectiveness and practical value of our approach in real-world search scenarios.

搜索重排多模态降本增效标注效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。