无需评估模型,通过语义聚类选出最主流的生成结果
ModeX: Evaluator-Free Best-of-N Selection for Open-Ended Generation
- 用相似性图+谱聚类找生成文本中的语义主导模式
- 在摘要、代码、数学推理任务上超越单次生成和多路径方法
- 适合追求高效高质量生成的开发者与研究者
从多个随机生成结果中选择高质量输出仍是大语言模型在开放任务中的核心挑战。尽管Best-of-N和自一致性方法表明聚合多个生成结果可提升性能,但现有方法通常依赖外部评估器、奖励模型或精确字符串匹配投票,限制了其适用性和效率。我们提出无评估器的最佳选择框架ModeX,通过识别生成文本间的语义主导共识(即模态输出)来推广多数投票机制。ModeX构建候选生成结果的相似性图,并递归应用谱聚类以选出代表性的中心点,无需额外推理或辅助模型。我们进一步将该原则实例化为更高效的ModeX-Lite,引入早期剪枝机制。在文本摘要、代码生成和数学推理等开放任务中,我们的方法持续优于标准单路径与多路径基线,提供了一种计算高效的鲁棒开放生成解决方案。代码已开源:https://github.com/deeplearning-wisc/ModeX。
原文摘要 · Abstract (English)
Selecting a single high-quality output from multiple stochastic generations remains a fundamental challenge for large language models (LLMs), particularly in open-ended tasks where no canonical answer exists. While Best-of-N and self-consistency methods show that aggregating multiple generations can improve performance, existing approaches typically rely on external evaluators, reward models, or exact string-match voting, limiting their applicability and efficiency. We propose Mode Extraction (ModeX), an evaluator-free Best-of-N selection framework that generalizes majority voting to open-ended text generation by identifying the modal output representing the dominant semantic consensus among generated texts. ModeX constructs a similarity graph over candidate generations and recursively applies spectral clustering to select a representative centroid, without requiring additional inference or auxiliary models. We further instantiate this selection principle as ModeX-Lite, an improved version of ModeX with early pruning for efficiency. Across open-ended tasks -- including text summarization, code generation, and mathematical reasoning -- our approaches consistently outperform standard single- and multi-path baselines, providing a computationally efficient solution for robust open-ended text generation. Code is released in https://github.com/deeplearning-wisc/ModeX.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。