arXiv:2510.19698cs.AI2025-10

让大模型生成规则并用逻辑回归优化,提升推理可靠性。

RLIE: Rule Generation with Logistic Regression, Iterative Refinement, and Evaluation for Large Language Models

  • 用大模型生成规则,再通过逻辑回归学习权重,实现概率化选择。
  • 直接使用加权规则分类性能优于将规则喂给大模型,准确率更高。
  • 适合需要可解释性与高精度推理的场景,如医疗、金融决策。

大语言模型(LLMs)能以自然语言提出规则,无需预设谓词空间。然而,多数基于LLM的方法忽略了规则间的交互,且未充分探索将LLM与概率规则学习结合以实现鲁棒推理的潜力。本文提出RLIE框架,融合LLM与概率建模,学习一组加权规则。该框架包含四个阶段:(1) 规则生成,由LLM提出并筛选候选规则;(2) 逻辑回归,学习全局选择与校准的权重;(3) 迭代精炼,基于预测误差更新规则集;(4) 评估,将加权规则集作为直接分类器,与将规则注入LLM的方法进行对比。在真实数据集上评估多种推理策略发现:直接使用加权规则性能更优,而将规则、权重及逻辑模型输出提示给LLM反而导致准确率下降。这表明LLM擅长语义生成与理解,但在精确的概率集成上可靠性较低。RLIE揭示了LLM在归纳推理中的潜力与局限,并将其与经典概率规则组合方法结合,实现更可靠的神经符号推理。

原文摘要 · Abstract (English)

Large Language Models (LLMs) can propose rules in natural language, sidestepping the need for a predefined predicate space in traditional rule learning. Yet many LLM-based approaches ignore interactions among rules, and the opportunity to couple LLMs with probabilistic rule learning for robust inference remains underexplored. We present RLIE, a unified framework that integrates LLMs with probabilistic modeling to learn a set of weighted rules. RLIE has four stages: (1) Rule generation, where an LLM proposes and filters candidates; (2) Logistic regression, which learns probabilistic weights for global selection and calibration; (3) Iterative refinement, which updates the rule set using prediction errors; and (4) Evaluation, which compares the weighted rule set as a direct classifier with methods that inject rules into an LLM. We evaluate multiple inference strategies on real-world datasets. Applying rules directly with their learned weights yields superior performance, whereas prompting LLMs with the rules, weights, and logistic-model outputs surprisingly degrades accuracy. This supports the view that LLMs excel at semantic generation and interpretation but are less reliable for precise probabilistic integration. RLIE clarifies the potential and limitations of LLMs for inductive reasoning and couples them with classic probabilistic rule combination methods to enable more reliable neuro-symbolic reasoning.

大模型规则学习概率推理神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。