检测大模型辅导时是否依赖答案密钥,提出掩码验证新方法。
Context-Masked Truncated Reasoning Audits for Answer-Key Dependence in LLM Tutors
- 用截断推理探针检测模型是否依赖隐藏答案键
- 掩码后99.8%的正确答案可被还原,证明依赖存在
- 适用于评估AI辅导系统透明性,研究者必读
大型语言模型(LLM)在生成学生解释时可能访问教师笔记、答案键、评分标准或检索到的解法。我们研究截断推理探针能否区分模型对私有上下文的直接访问与仅通过解释内容携带的答案信息。采用截断推理AUC评估(TRACE),在1000个GSM8K问题上评估仅问题、正确答案键和错误答案键三种情境。当强制回答探针保留私有密钥时,答案键的TRACE AUC从0.375升至0.900,且在1000次中有998次可在无解释情况下恢复正确答案。随后引入上下文掩码重放:以对应问题仅提示为前提,对答案键生成的前缀进行探针测试。掩码使前缀准确率从0.997降至0.126,中位AUC从0.900降至0.375,几乎接近仅问题情境下的0.113和0.375。在746组最终解释均正确的样本中,掩码后的平均AUC差值为-0.0086,95%置信区间包含零。错误密钥仍导致387个错误输出中的272个,表明即使早期前缀证据被掩盖,私有信息仍可影响输出。结果确立上下文掩码对于归因早期答案可用性至关重要。
原文摘要 · Abstract (English)
Large language model (LLM) tutors may have access to teacher notes, answer keys, rubrics, or retrieved solutions while producing student-facing explanations. We study whether truncated reasoning probes can distinguish direct access to such private context from answer information carried by the written explanation. Using Truncated Reasoning AUC Evaluation (TRACE), we evaluate 1000 GSM8K problems under question-only, correct answer-key, and wrong answer-key contexts. When forced-answer probes retain the private key, answer-key TRACE AUC rises from 0.375 to 0.900, and the gold answer is recoverable with no explanation at all in 998 of 1000 cases. We then introduce a context-masked replay: answer-key-generated prefixes are probed under the corresponding question-only prompt. Masking reduces 10\% prefix accuracy from 0.997 to 0.126 and median AUC from 0.900 to 0.375, nearly matching question-only values of 0.113 and 0.375. On 746 pairs where both explanations end correctly, the masked mean AUC difference is $-0.0086$ with a 95\% bootstrap interval spanning zero. Wrong keys still account for 272 of 387 incorrect final responses, showing that private artifacts can influence outputs even when early-prefix evidence disappears after masking. These results establish context masking as necessary for attributing early answer availability to an explanation rather than its hidden input.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。