arXiv:2602.05448cs.LG2026-02

用锦标赛图实现零样本排序,少用40%资源还能更准。

BlitzRank: Principled Zero-shot Ranking Agents with Tournament Graphs

  • 基于锦标赛图聚合多选比较信息,自动生成额外排序关系。
  • 在14个基准上比现有方法少25%-40%调用大模型次数,精度不降。
  • 支持非传递偏好,适合大模型文档重排序等场景。

通过昂贵的k路比较从n个候选项中选出前m个,是大模型文档重排序、众包评估和赛事设计中的核心问题。现有方法要么依赖丢弃比较信息的启发式策略,要么代价过高。我们提出一种锦标赛图框架,为k路排序提供理论基础。关键观察是每次k项比较会生成$inom{k}{2}$对偏好关系;将这些整合为全局偏好图并计算其传递闭包,即可在无需额外调用前提下获得大量新增排序。我们形式化了当前前m名输出可被认证确定的条件,并设计了一种贪心查询调度策略以最大化信息增益。该框架还能优雅处理现实世界中出现的非传递偏好——由真实评估器产生的环状结构——通过将其合并为等价类,生成有原则的分层排名。在14个基准和5个模型的大模型重排序任务中,BlitzRank实现了帕累托占优:在匹配或超越准确率的同时,比同类方法减少25%-40%的调用成本;相比成对重排序,实现近似质量却仅需七分之一的调用。代码已开源于https://github.com/ContextualAI/BlitzRank。

原文摘要 · Abstract (English)

Selecting the top $m$ from $n$ items via expensive $k$-wise comparisons is central to settings ranging from LLM-based document reranking to crowdsourced evaluation and tournament design. Existing methods either rely on heuristics that discard comparison information, or exploit it at prohibitive cost. We introduce a tournament graph framework that provides a principled foundation for $k$-wise ranking. Our key observation is that each $k$-item comparison reveals an induced tournament of $\binom{k}{2}$ pairwise preferences; aggregating these into a global preference graph and computing its transitive closure yields many additional orderings without further oracle calls. We formalize when the current top-$m$ output is certifiably determined and design a greedy query schedule that maximizes information gain towards identifying the top-$m$ items. The framework also gracefully handles non-transitive preferences -- cycles induced by real-world oracles -- by collapsing them into equivalence classes that yield principled tiered rankings. Applied to LLM reranking across 14 benchmarks and 5 models, BlitzRank achieves Pareto dominance over existing approaches: matching or exceeding accuracy while requiring 25--40% fewer tokens than comparable methods; against pairwise reranking, it achieves near-identical quality with 7$\times$ fewer tokens. Code available at https://github.com/ContextualAI/BlitzRank.

排序算法大模型应用零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。