arXiv:2603.04982cs.CYcs.AI2026-03被引 2

训练能提升律师用AI做法律分析的效率和准确性。

Training for Technology: Adoption and Productive Use of Generative AI in Legal Analysis

  • 给法学生提供简短培训后,更多人主动使用AI模型。
  • 受训者答题更准确,得分比未训练者高0.27分(约一个等级)。
  • 对高能力者尤其重要:不培训反而会降低表现。

我们通过随机实验研究了针对性用户培训是否能释放生成式人工智能在专业场景中的生产力。164名法学生在三种条件下完成案例识别测试:无生成式AI访问、可选使用大语言模型(LLM),或在简短培训后使用LLM。未受训的用户使用LLM反而表现更差:答案更短,错误引用案例更多,得分略低但多数差异未达显著水平。培训逆转了这一趋势:受训者采用率更高(41% vs. 26%;p = 0.044),得分高出0.27分(p = 0.027),规则引用更准确(p = 0.014)。主策略分析表明,培训主要通过提高采用率起作用——采用率下界(1.06)超过有效性上界(0.42)——尽管置信区间较宽。研究挑战了‘生成式AI主要惠及低技能者’的观点:无培训时,高能力者选择回避,低能力者虽采用但效率低下。要实现生成式AI的生产力提升,必须同时投入资源于访问与培训。

原文摘要 · Abstract (English)

Can targeted user training unlock the productive potential of generative artificial intelligence in professional settings? We study this question using a randomized experiment in which 164 law students completed an issue-spotting examination under one of three conditions: no GenAI access, optional access to a large language model (LLM), or LLM access with a brief training intervention. Untrained LLM access proved counterproductive: relative to participants without any LLM access, untrained users wrote significantly shorter answers, committed more case misstatements, and scored marginally lower, though most differences fall short of conventional significance. Training reversed this pattern. Trained participants adopted the LLM at higher rates (41% vs. 26%; p = 0.044), scored 0.27 grade points higher than untrained users--roughly one fine grade--(p = 0.027), and stated applicable rules more accurately (p = 0.014). Principal stratification analysis suggests training operates primarily through adoption rather than effectiveness--the adoption lower bound (1.06) exceeds the effectiveness upper bound (0.42) at strict mean dominance--though confidence intervals are wide. More broadly, these findings challenge the view that GenAI primarily benefits lower-skilled workers: without training, higher-ability practitioners opt out while lower-ability users adopt but unproductively. Realizing GenAI's productivity gains requires investment in both access and instruction.

生成式AI法律AI用户培训

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。