让大模型从死守规则转向理解人类意图,只需一个简单提示框架。
From Literal to Liberal: A Meta-Prompting Framework for Eliciting Human-Aligned Exception Handling in Large Language Models
- 设计元提示框架,引导模型区分规则与人类意图
- 零样本下达成95%人类对齐率,显著优于基线和思维链
- 适合希望低成本提升AI决策合理性的开发者与研究者
大型语言模型(LLMs)正被广泛用作智能体系统的推理引擎,但其存在严重缺陷:过度严格遵循显式规则,导致决策与人类常识和意图脱节。这种“规则僵化”成为构建可信自主智能体的重大障碍。尽管已有研究显示,通过人类解释进行监督微调(SFT)可缓解此问题,但该方法计算成本高,难以普及。为此,我们提出规则-意图区分(RID)框架,一种低计算量的元提示技术,可在零样本条件下诱导大模型进行符合人类意图的例外处理。该框架为模型提供结构化认知模板,用于任务拆解、规则分类、冲突结果权衡及最终决策的合理性说明。我们在包含20个跨领域场景的自定义基准上评估了该框架,对比基线与思维链(CoT)提示。人工验证结果显示,RID框架在人类对齐得分(HAS)上达到95%,显著高于基线的80%和CoT的75%。此外,其生成的推理过程更高质量、更聚焦目标意图。本工作提供了一种实用、易用且高效的方法,推动大模型从机械执行指令转向目标导向的灵活推理,为更可靠、更务实的AI智能体铺平道路。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly being deployed as the reasoning engines for agentic AI systems, yet they exhibit a critical flaw: a rigid adherence to explicit rules that leads to decisions misaligned with human common sense and intent. This "rule-rigidity" is a significant barrier to building trustworthy autonomous agents. While prior work has shown that supervised fine-tuning (SFT) with human explanations can mitigate this issue, SFT is computationally expensive and inaccessible to many practitioners. To address this gap, we introduce the Rule-Intent Distinction (RID) Framework, a novel, low-compute meta-prompting technique designed to elicit human-aligned exception handling in LLMs in a zero-shot manner. The RID framework provides the model with a structured cognitive schema for deconstructing tasks, classifying rules, weighing conflicting outcomes, and justifying its final decision. We evaluated the RID framework against baseline and Chain-of-Thought (CoT) prompting on a custom benchmark of 20 scenarios requiring nuanced judgment across diverse domains. Our human-verified results demonstrate that the RID framework significantly improves performance, achieving a 95% Human Alignment Score (HAS), compared to 80% for the baseline and 75% for CoT. Furthermore, it consistently produces higher-quality, intent-driven reasoning. This work presents a practical, accessible, and effective method for steering LLMs from literal instruction-following to liberal, goal-oriented reasoning, paving the way for more reliable and pragmatic AI agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。