arXiv:2510.05134cs.AI2025-10

用三阶段框架让小模型精准处理复杂规则系统。

Structuring Reasoning for Complex Rules Beyond Flat Representations

  • 分三步:分析上下文、提取证据、综合判断。
  • 小模型性能媲美甚至超越大模型,准确率显著提升。
  • 适合需要严谨逻辑推理的法律、医疗等场景。

大型语言模型在处理复杂规则系统时面临挑战,通常将相互依赖的规则视为无结构的文本数据,而非逻辑组织的框架,导致推理偏差,忽略关键规则依赖。尽管现有方法如思维链(CoT)推理有一定效果,但缺乏系统化的规则处理方法,且易受序列推理中错误传播的影响。为此,我们提出动态裁决模板(DAT),一种受专家人类推理启发的新框架。DAT将推理过程分为三个有条不紊的阶段:定性分析、证据收集和裁决。在定性分析阶段,模型全面评估上下文环境;证据收集阶段基于预设模板元素([placeholder])有针对性地提取相关信息,并系统验证其符合适用规则;最后在裁决阶段,模型整合已验证的组件形成综合判断。实证结果表明,DAT在复杂规则任务中持续优于传统CoT方法。值得注意的是,小模型使用DAT后表现可媲美甚至超过更大规模的LLM,凸显其在处理复杂规则系统中的高效性与有效性。

原文摘要 · Abstract (English)

Large language models (LLMs) face significant challenges when processing complex rule systems, as they typically treat interdependent rules as unstructured textual data rather than as logically organized frameworks. This limitation results in reasoning divergence, where models often overlook critical rule dependencies essential for accurate interpretation. Although existing approaches such as Chain-of-Thought (CoT) reasoning have shown promise, they lack systematic methodologies for structured rule processing and are particularly susceptible to error propagation through sequential reasoning chains. To address these limitations, we propose the Dynamic Adjudication Template (DAT), a novel framework inspired by expert human reasoning processes. DAT structures the inference mechanism into three methodical stages: qualitative analysis, evidence gathering, and adjudication. During the qualitative analysis phase, the model comprehensively evaluates the contextual landscape. The subsequent evidence gathering phase involves the targeted extraction of pertinent information based on predefined template elements ([placeholder]), followed by systematic verification against applicable rules. Finally, in the adjudication phase, the model synthesizes these validated components to formulate a comprehensive judgment. Empirical results demonstrate that DAT consistently outperforms conventional CoT approaches in complex rule-based tasks. Notably, DAT enables smaller language models to match, and in some cases exceed, the performance of significantly larger LLMs, highlighting its efficiency and effectiveness in managing intricate rule systems.

规则推理逻辑框架小模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。