测试大模型在奥地利增值税法中的法律推理能力,发现合理配置后可辅助税务顾问。
Using Large Language Models for Legal Decision-Making in Austrian Value-Added Tax Law: An Experimental Study
- 用微调和检索增强生成提升大模型表现
- 真实案例中准确率显著高于教材案例
- 适合税务咨询自动化初期辅助,非完全替代
本文对大型语言模型(LLMs)在奥地利及欧盟增值税(VAT)法律框架内辅助法律决策的能力进行了实验评估。在税务咨询实践中,客户常以自然语言描述案件,使大模型成为支持自动化决策、减轻税务人员负担的有力候选。然而,大模型易产生幻觉,影响法律分析的严谨性。实验聚焦于微调与检索增强生成(RAG)两种提升性能的方法,在教材案例与某税务咨询公司的真实案例上系统测试,以确定最佳配置并评估其法律推理能力。结果表明,合理配置的大模型可有效辅助税务专业人士完成增值税任务,并提供有法律依据的决策理由。尽管如此,当前模型仍难以处理隐含客户知识和特定背景材料,凸显未来需整合结构化背景信息的需求。
原文摘要 · Abstract (English)
This paper provides an experimental evaluation of the capability of large language models (LLMs) to assist in legal decision-making within the framework of Austrian and European Union value-added tax (VAT) law. In tax consulting practice, clients often describe cases in natural language, making LLMs a prime candidate for supporting automated decision-making and reducing the workload of tax professionals. Given the requirement for legally grounded and well-justified analyses, the propensity of LLMs to hallucinate presents a considerable challenge. The experiments focus on two common methods for enhancing LLM performance: fine-tuning and retrieval-augmented generation (RAG). In this study, these methods are applied on both textbook cases and real-world cases from a tax consulting firm to systematically determine the best configurations of LLM-based systems and assess the legal-reasoning capabilities of LLMs. The findings highlight the potential of using LLMs to support tax consultants by automating routine tasks and providing initial analyses, although current prototypes are not ready for full automation due to the sensitivity of the legal domain. The findings indicate that LLMs, when properly configured, can effectively support tax professionals in VAT tasks and provide legally grounded justifications for decisions. However, limitations remain regarding the handling of implicit client knowledge and context-specific documentation, underscoring the need for future integration of structured background information.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。