用推理相似性与置信度重分配,让大模型多答案推理更准。
When Does Delegation Beat Majority? A Delegation-Based Aggregator for Multi-Sample LLM Inference

- 按答案熵和推理相似性动态分配权重,实现无监督聚合
- 在MMLU-Pro上比多数投票提升1.5个百分点,非简单题上提升2.24点
- 能识别并纠正几何不连贯的错误多数,适合复杂推理场景
多数投票是多样本大模型推理的默认无监督聚合方式,但会忽略组内答案熵与组间推理几何结构。本文提出基于委托的聚合方法(传播代理投票,PPV):每个答案组根据自身熵置信度保留部分权重(何时),并将剩余权重按推理嵌入相似性分配给其他组(何人);最终通过委托矩阵的稳态分布确定共识答案。该方法无需真实标签或训练。在每题128个样本的MMLU-Pro上,该方法整体领先多数投票1.5个百分点,非简单题上领先2.24个百分点(McNemar检验p ~ 1.0e-14,n = 8,099),可纠正答案簇几何不连贯的错误多数,而正确少数则聚集紧密。我们进一步给出了委托推翻多数的精确条件:二选一模型下,可通过每选项置信度及其向另一选项的权重分配闭式判断,近全票问题有不损害性能的保全特性。该条件在96.5%的非简单题上预测正确胜者,其预测质量差距与实际差距相关系数达r = 0.97。未发现其他无监督集成方法能逼近最优基准。
原文摘要 · Abstract (English)
Majority voting is the default unsupervised aggregator for multi-sample LLM inference, but it discards two signals: within-group answer entropy and between-group reasoning geometry. We aggregate by delegation instead (Propagational Proxy Voting, PPV): each group of samples keeps weight on its own answer in proportion to its entropy-based confidence (When) and routes the rest to peers by reasoning-embedding similarity (Whom); the stationary distribution of the resulting delegation matrix picks the consensus answer. This requires neither gold labels nor training. On MMLU-Pro with 128 samples per question, delegation beats majority by +1.5 pp overall and +2.24 pp on non-trivial questions (McNemar p ~ 1.0e-14, n = 8,099), overturning wrong majorities whose answer cluster is geometrically incoherent while the correct minority is tight. We then characterize exactly when delegation overturns majority: a two-option model gives a closed-form flip condition on each option's confidence and the weight it routes to the other, with a do-no-harm corollary for near-unanimous questions. The condition calls the realized winner on 96.5% of non-trivial questions, and its predicted mass gap tracks the realized gap at r = 0.97. We did not find any other unsupervised ensemble methods that close the oracle gap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。