arXiv:2606.13756cs.CL2026-06综述被引 5

评测大模型在伊斯兰继承计算中的端到端推理能力

QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning

  • 基于12500个阿拉伯语案例,要求模型完成从识别受益人到分配份额的全流程推理
  • 16支队伍参与,当前模型在法律解释与结构化计算上仍存显著差距
  • 适合关注宗教法律推理、多步逻辑任务的AI研究者

本文综述了作为OSACT7研讨会一部分并同场举办于LREC 2026的QIAS 2026共享任务。该任务旨在评估大语言模型在伊斯兰继承这一宗教与法律领域进行复杂推理的能力。不同于传统问答基准,QIAS 2026聚焦于从自然语言案例出发的端到端推理,要求系统完成从识别合格继承人到准确分配各受益人份额的完整计算过程。为支持评估,任务基于MAWARITH基准数据集,包含12,500个阿拉伯语继承案例,每个案例均标注了中间推理步骤和最终答案。系统提交结果通过MIR-E多阶段指标进行评估,该指标衡量继承推理各主要阶段的表现。共有16支团队参与,采用提示工程、检索增强生成及微调等多种方法。结果显示,伊斯兰继承仍是当前语言模型的高难度基准,尤其在需要精确法律解读与结构化数值推理的阶段表现不足。本文总结了任务设计、数据集、评估框架、参赛系统及主要结果。

原文摘要 · Abstract (English)

This paper presents a comprehensive overview of the QIAS 2026 shared task, organized as part of the OSACT7 Workshop and co-located with LREC 2026. The shared task was designed to evaluate the ability of large language models to perform complex reasoning in the religious and legal domain of Islamic inheritance. Unlike conventional question-answering benchmarks, QIAS 2026 focuses on end-to-end reasoning from natural language cases, requiring systems to perform the full inheritance calculation process, from identifying the eligible heirs to assigning the correct share to each beneficiary. To support this evaluation, the task was based on the MAWARITH benchmark, a dataset of $12{,}500$ Arabic inheritance cases annotated with intermediate reasoning steps and final answers. System submissions were evaluated using MIR-E, a multi-step metric that measures performance across the main stages of inheritance reasoning. A total of $16$ teams participated in the shared task, investigating a range of approaches, including prompting-based methods, retrieval-augmented generation, and fine-tuning strategies. The results show that Islamic inheritance remains a highly challenging benchmark for current language models, especially in stages that require precise legal interpretation and structured numerical reasoning. This overview summarizes the task design, dataset, evaluation framework, participating systems, and main results.

宗教推理多步推理法律AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。