arXiv:2604.04328cs.AIcs.LG2026-04

用可微方法计算智能体对抗中的稳定集合,解决排名混乱问题。

Soft Tournament Equilibrium

论文配图:Soft Tournament Equilibrium
图 1 · 摘自论文原文
  • 通过概率模型和可微运算学习对抗关系中的核心集合
  • 在循环对抗场景中实现稳定的核心智能体识别,支持连续成员得分
  • 适合评估基于大模型的通用智能体,尤其在非传递性交互中

通用人工智能代理(尤其是基于大语言模型的)评估面临重大挑战,因其交互具有非传递性:例如代理A胜B,B胜C,C胜A。传统线性排序方法在此类循环域中易产生误导且不稳定。本文提出软锦标赛均衡(STE),一种从成对比较数据中直接学习和计算集值锦标赛解的可微框架。STE首先学习一个可能依赖丰富上下文信息的概率锦标赛模型,再利用可微的软可达性和软覆盖算子,计算两个经典锦标赛解——顶循环(Top Cycle)和未覆盖集(Uncovered Set)的连续版本。输出为一组核心代理及其连续成员得分,可在有验证标签或重复采样证据时进行校准。我们建立了理论基础,证明了在零温度极限下与经典解一致,具备康多塞包含性质,并分析了稳定性与样本复杂度。在人工构造的循环核心基准和真实偏好/执行诊断数据上进行了评估。该工作提供了一个自洽的框架,将通用代理评估重新建立在稳健的锦标赛理论基础上,从不稳定的排名转向稳定的集值均衡。

原文摘要 · Abstract (English)

The evaluation of general-purpose artificial agents, particularly those based on LLMs, presents a significant challenge due to the non-transitive nature of their interactions. When agent A defeats B, B defeats C, and C defeats A, traditional ranking methods that force a linear ordering can be misleading and unstable. We argue that for such cyclic domains, the fundamental object of evaluation should not be a ranking alone but a set-valued core, as conceptualized in classical tournament theory. This paper introduces Soft Tournament Equilibrium (STE), a differentiable framework for learning and computing set-valued tournament solutions directly from pairwise comparison data. STE first learns a probabilistic tournament model, potentially conditioned on rich contextual information. It then employs differentiable operators for soft reachability and soft covering to compute continuous analogues of two seminal tournament solutions: the Top Cycle and the Uncovered Set. The output is a set of core agents, each with a continuous membership score that can be calibrated when suitable validation labels or repeated-sampling evidence are available. We develop the theoretical foundation for STE by proving consistency with classical solutions in the zero-temperature limit, establishing Condorcet-inclusion properties, and analyzing stability and sample complexity. We evaluate the method on a planted cyclic core benchmark and on real preference/execution diagnostics. This work provides a self-contained account that re-centers general-agent evaluation on a robust tournament-theoretic foundation, moving from unstable rankings toward stable, set-valued equilibria.

智能体评估锦标赛理论可微学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。