用群体智能让多个AI模型协作推理,准确率提升25%
Fortytwo: Swarm Inference with Peer-Ranked Consensus
- 多个模型互评打分,按信誉加权选出最优答案
- 在GPQA钻石题上达85.90%,比单一模型高17.21个百分点
- 抗攻击能力强,适合去中心化AI系统部署
当集中式AI遭遇算力瓶颈和训练收益递减时,需构建可水平扩展的推理层以满足需求。我们提出Fortytwo协议,基于群体智能与分布式成对排名共识机制,实现更优的AI推理性能。该方法重新定义了多模型间的协作方式:通过同行评分与信誉加权的共识机制,从异构模型中筛选出高质量响应。采用自定义的Bradley-Terry风格聚合模型进行成对排名,结果显示,相较于多数投票(68.69%),该方案在相同模型集合下于GPQA Diamond上达到85.90%,提升17.21个百分点(相对提升约25.1%)。协议引入链上信誉机制,使节点影响力随实际表现动态调整,形成基于能力的公正共识,有效过滤低质或恶意参与者。为抵御Sybil攻击,Fortytwo采用能力证明机制:节点须完成校准任务并质押信誉方可参与排名,大幅提高多身份攻击成本,同时保持系统开放性。在包括GPQA Diamond、LiveCodeBench和AIME在内的六个挑战性基准测试中,该方案表现出更高准确率,并对对抗性与噪声自由提示具有强鲁棒性(如提示注入攻击下仅下降0.12%,远优于单模型基线的6.20%),兼具实用性与可部署性。这些成果为去中心化AI系统奠定了基础,通过集体智能实现高质量推理的民主化,且不牺牲可靠性与安全性。
原文摘要 · Abstract (English)
As centralized AI hits compute ceilings and diminishing returns from ever-larger training runs, meeting demand requires an inference layer that scales horizontally in both capacity and capability. We present Fortytwo, a novel protocol that leverages swarm intelligence principles and distributed pairwise ranking consensus to achieve superior performance in AI inference. Our approach reimagines collaboration among AI nodes using swarm inference: a peer-ranked, reputation-weighted consensus across heterogeneous models that surfaces the highest-quality responses. Using pairwise ranking with a custom Bradley-Terry-style aggregation model, we demonstrate that swarm inference substantially outperforms majority voting, achieving 85.90% on GPQA Diamond versus 68.69% for majority voting with the same model set - an improvement of +17.21 percentage points (approximately +25.1% relative). The protocol incorporates on-chain reputation so node influence adapts to demonstrated accuracy over time, yielding a meritocratic consensus that filters low-quality or malicious participants. To resist Sybil attacks, Fortytwo employs proof-of-capability in its consensus: nodes must successfully complete calibration/test requests and stake reputation to enter ranking rounds, making multi-identity attacks economically unattractive while preserving openness. Across six challenging benchmarks, including GPQA Diamond, LiveCodeBench, and AIME, our evaluation indicates higher accuracy and strong resilience to adversarial and noisy free-form prompting (e.g., prompt-injection degradation of only 0.12% versus 6.20% for a monolithic single-model baseline), while retaining practical deployability. Together, these results establish a foundation for decentralized AI systems - democratizing access to high-quality inference through collective intelligence without sacrificing reliability or security.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。