arXiv:2601.04208cs.CLcs.AI2026-01

用强化学习让大模型生成符合不同人群的可信贷款审批解释。

LLMs for Explainable Business Decision-Making: A Reinforcement Learning Fine-Tuning Approach

  • 用两阶段强化学习优化解释内容与风格,不依赖人工标注
  • 专家版解释更关注风险,用户版更清晰易懂且礼貌
  • 在房贷审批场景中提升预测准确率,适合需要透明决策的企业

人工智能日益用于高影响的消费者交互,但其决策逻辑常不透明。现有可解释AI多依赖事后特征重要性数值,无法提供连贯的决策叙事。大语言模型(LLMs)有望生成自然语言解释,但仍面临三大挑战:解释需既正确又忠实于决策依据;能适配多类受众而不改变原决策规则;需标签高效训练,不依赖大量人工评分的解释语料。为此,我们提出 LEXMA(基于LLM的多受众解释框架),一个基于强化学习的微调方法,可生成叙事驱动、受众适配的解释。LEXMA结合反射增强的监督微调与两阶段群体相对策略优化(GRPO),分别优化决策准确性与受众风格,奖励信号无需人工标注解释。我们在房贷审批场景中验证该方法。结果表明,相较于其他LLM基线,LEXMA显著提升预测性能;人类评估显示,专家版解释更具风险导向性,用户版更清晰、可操作且更礼貌。本研究提出一种低成本、系统化的LLM微调方案,助力业务决策中解释质量提升,具备大规模部署透明AI系统的潜力。

原文摘要 · Abstract (English)

Artificial Intelligence (AI) models increasingly drive high-stakes consumer interactions, yet their decision logic often remains opaque. Prevailing explainable AI techniques rely on post hoc numerical feature attributions, which fail to provide coherent narratives behind model decisions. Large language models (LLMs) present an opportunity to generate natural-language explanations, but three design challenges remain unresolved: explanations must be both decision-correct and faithful to the factors that drive the prediction; they should be able to serve multiple audiences without shifting the underlying decision rule; and they should be trained in a label-efficient way that does not depend on large corpora of human-scored explanations. To address these challenges, we introduce LEXMA (LLM-based EXplanations for Multi-Audience decisions), a reinforcement-learning-based fine-tuning framework that produces narrative-driven, audience-appropriate explanations. LEXMA combines reflection-augmented supervised fine-tuning with two stages of Group Relative Policy Optimization (GRPO). Specifically, it fine-tunes two separate parameter sets to improve decision correctness and satisfy stylistic requirements for different audiences, using reward signals that do not rely on human-annotated explanations. We instantiate LEXMA in the context of mortgage approval decisions. Results demonstrate that LEXMA yields significant improvements in predictive performance compared with other LLM baselines. Moreover, human evaluations show that expert-facing explanations generated by our approach are more risk-focused, and consumer-facing explanations are clearer, more actionable, and more polite. Our study contributes a cost-efficient, systematic LLM fine-tuning approach to enhance explanation quality for business decisions, offering strong potential for scalable deployment of transparent AI systems.

大模型解释可解释AI强化学习信贷决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。