arXiv:2509.23067cs.CLcs.AI2025-09被引 7

不用自评就能高效改进大模型,解决开放任务难题。

Semantic Voting: A Self-Evaluation-Free Approach for Efficient LLM Self-Improvement on Unverifiable Open-ended Tasks

  • 用语义相似度代替精确匹配,实现轻量级投票
  • 计算开销降低,性能优于传统自评方法
  • 适合资源有限但需持续优化的开放任务场景

监督数据成本上升推动了大语言模型(LLMs)自提升研究。针对可验证任务,直接使用多数投票等无监督信号生成伪标签已证明有效,但其在不可验证任务(如翻译)中受限于响应的开放性。因此,当前主流依赖自评机制(如自判分和熵最小化)生成伪标签,但此类方法常导致高计算开销和过度自信问题。为此,本文提出一种无需自评的新型方法,专为不可验证任务设计,兼具轻量与高效。受可验证任务中多数投票启发,我们提出语义投票机制,将硬匹配(精确匹配)放松为软匹配(语义相似性),通过轻量级句向量模型量化语义相似度,从而缓解自评带来的高开销与固有偏差。大量实验表明,该方法在多种模型架构与任务上均显著提升计算效率,且整体性能优于现有自评方法。

原文摘要 · Abstract (English)

The rising cost of acquiring supervised data has driven significant interest in self-improvement for large language models (LLMs). Straightforward unsupervised signals like majority voting have proven effective in generating pseudo-labels for verifiable tasks, while their applicability to unverifiable tasks (e.g., translation) is limited by the open-ended character of responses. As a result, self-evaluation mechanisms (e.g., self-judging and entropy minimization) are predominantly used to derive pseudo-labels. However, self-evaluation relying on LLMs typically incurs high computational overhead and introduces overconfidence issues due to intrinsic biases. To address these challenges, we propose a novel self-evaluation-free approach for unverifiable tasks, designed for lightweight yet effective self-improvement. Inspired by majority voting commonly employed in verifiable tasks, we propose semantic voting as a novel mechanism that relaxes the principle of hard matching (i.e., exact matching) toward soft matching (i.e., semantic similarity). Soft matching is achieved by leveraging a lightweight sentence embedding model to quantify semantic similarity, thereby mitigating excessive computational burden and intrinsic bias-associated limitations of self-evaluation. Comprehensive experiments demonstrate that our method achieves substantial gains in computational efficiency and overall better performance than self-evaluation methods across diverse model architectures and tasks.

大模型自提升语义投票轻量化开放任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。