用对抗辩论提升AI分析企业信用的深度与可信度
Structured Debate Improves Corporate Credit Reasoning in Financial AI
- 采用双角色对抗辩论框架,模拟正反观点交锋
- 相比人工专家,处理速度提升显著,报告可读性更高
- 适合金融风控、智能投研等需要高可信决策的场景
本研究探索了基于大模型的非财务数据在企业信用评估中的自动化方法。构建并对比了两种系统:单一代理系统(SAS),由一个LLM代理识别有利与不利还款信号;以及波普尔多代理辩论系统(PMADS),依据卡尔·波普尔辩论协议,将双重视角分析结构化为对抗性论辩。评估从三方面展开:(i) 与人类专家相比的工作效率;(ii) 信贷风险专业人员对系统生成报告的质量与可用性评分;(iii) 通过推理树分析量化推理特征。两者均显著缩短任务完成时间。专业人士认为SAS报告达到基本可用水平,而PMADS报告超越中性基准,在解释充分性、实际应用性和可用性上显著更优。推理树分析显示,PMADS生成更深层、更详尽的结构,而SAS仅产生单层树状结构。结果表明,结构化多代理辩论能增强分析严谨性与感知价值,尽管计算耗时更长。总体而言,以推理为核心的自动化是金融关键决策场景下有前景的AI发展路径。
原文摘要 · Abstract (English)
This study investigated LLM-based automation for analyzing non-financial data in corporate credit evaluation. Two systems were developed and compared: a Single-Agent System (SAS), in which one LLM agent infers favorable and adverse repayment signals, and a Popperian Multi-agent Debate System (PMADS), which structures the dual-perspective analysis as adversarial argumentation under the Karl Popper Debate protocol. Evaluation addressed three fronts: (i) work productivity compared with human experts; (ii) perceived report quality and usability, rated by credit risk professionals for system-generated reports; and (iii) reasoning characteristics quantified via reasoning-tree analysis. Both systems drastically reduced task completion time relative to human experts. Professionals rated SAS reports as adequate, while PMADS reports exceeded neutral benchmarks and scored significantly higher in explanatory adequacy, practical applicability, and usability. Reasoning-tree analysis showed PMADS produced deeper, more elaborated structures, whereas SAS yielded single-layered trees. These findings suggest that structured multi-agent debate enhances analytical rigor and perceived usefulness, though at the cost of longer computation time. Overall, the results demonstrate that reasoning-centered automation represents a promising approach for developing useful AI systems in decision-critical financial contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。