arXiv:2601.08849cs.CL2026-01中稿 · AAAI

测试文本操控对自动答案匹配的影响,发现常见作弊手段无效且可能降分。

Gaming the Answer Matcher: Examining the Impact of Text Manipulation on Automated Judgment

  • 通过生成冗长、多答案或夹杂错误答案的方式测试模型鲁棒性。
  • 三种操纵策略均未提升得分,反而常导致分数下降。
  • 二分类评分比连续评分更抗攻击,适合参考答案可用场景。

自动化答案匹配利用大语言模型比较自由文本回答与标准答案,是可扩展且对齐的人工评估替代方案。然而其可靠性需抵御猜测或冗长等策略性攻击。本文系统研究三种攻击方式:(1)生成冗长回答;(2)在不确定时提供多个答案;(3)将正确答案置于开头并嵌入矛盾内容。结果表明,这些操纵均未提高得分,反而常降低分数。此外,二分类评分(明确判断对错)比连续评分(评估部分正确性)更具鲁棒性。研究证明,当存在标准答案时,答案匹配机制对低成本文本操控具有较强鲁棒性,是传统LLM裁判或人工评估的可行替代方案。

原文摘要 · Abstract (English)

Automated answer matching, which leverages LLMs to evaluate free-text responses by comparing them to a reference answer, shows substantial promise as a scalable and aligned alternative to human evaluation. However, its reliability requires robustness against strategic attacks such as guesswork or verbosity that may artificially inflate scores without improving actual correctness. In this work, we systematically investigate whether such tactics deceive answer matching models by prompting examinee models to: (1) generate verbose responses, (2) provide multiple answers when unconfident, and (3) embed conflicting answers with the correct answer near the start of their response. Our results show that these manipulations do not increase scores and often reduce them. Additionally, binary scoring (which requires a matcher to answer with a definitive "correct" or "incorrect") is more robust to attacks than continuous scoring (which requires a matcher to determine partial correctness). These findings show that answer matching is generally robust to inexpensive text manipulation and is a viable alternative to traditional LLM-as-a-judge or human evaluation when reference answers are available.

自动评估大模型评测对抗攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。