用大模型自动构建符合逻辑的多准则决策模型
Doc2AHP: Inferring Structured Multi-Criteria Decision Models via Semantic Trees with LLMs
- 基于AHP结构约束引导大模型从文档中推理出层级决策树
- 在逻辑完整性和任务准确率上显著优于直接生成基线
- 适合无专家背景的用户快速构建可靠决策系统
尽管大型语言模型在语义理解方面表现出色,但在需要严格逻辑的复杂决策任务中常难以保证结构一致性和推理可靠性。传统决策理论如层次分析法(AHP)虽提供系统化框架,但其构建高度依赖人工领域专家知识,形成“专家瓶颈”,限制了在一般场景下的可扩展性。为此,我们提出Doc2AHP,一种基于AHP原则的新型结构化推理框架。该方法无需大量标注数据或人工干预,利用AHP的结构原则作为约束,在非结构化文档空间中引导大模型进行受限搜索,从而确保父节点与子节点间的逻辑蕴含关系。此外,引入多智能体权重分配机制与自适应一致性优化策略,保障权重分配的数值一致性。实验表明,Doc2AHP不仅使非专家用户能够从零开始构建高质量决策模型,且在逻辑完整性与下游任务准确性上显著优于直接生成基线。
原文摘要 · Abstract (English)
While Large Language Models (LLMs) demonstrate remarkable proficiency in semantic understanding, they often struggle to ensure structural consistency and reasoning reliability in complex decision-making tasks that demand rigorous logic. Although classical decision theories, such as the Analytic Hierarchy Process (AHP), offer systematic rational frameworks, their construction relies heavily on labor-intensive domain expertise, creating an "expert bottleneck" that hinders scalability in general scenarios. To bridge the gap between the generalization capabilities of LLMs and the rigor of decision theory, we propose Doc2AHP, a novel structured inference framework guided by AHP principles. Eliminating the need for extensive annotated data or manual intervention, our approach leverages the structural principles of AHP as constraints to direct the LLM in a constrained search within the unstructured document space, thereby enforcing the logical entailment between parent and child nodes. Furthermore, we introduce a multi-agent weighting mechanism coupled with an adaptive consistency optimization strategy to ensure the numerical consistency of weight allocation. Empirical results demonstrate that Doc2AHP not only empowers non-expert users to construct high-quality decision models from scratch but also significantly outperforms direct generative baselines in both logical completeness and downstream task accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。