用大模型自动生成可解释的文本生成规则系统,更快更准还少幻觉。
Leveraging Large Language Models for Building Interpretable Rule-Based Data-to-Text Systems
- 用大模型自动转换数据为可读规则,纯Python实现
- 在WebNLG上比直接调用大模型更好,比BART少幻觉
- 运行时仅需单核CPU,速度远超神经网络方法
我们提出一种简单方法,利用大语言模型(LLM)自动构建一个完全可解释的基于规则的数据到文本系统,使用纯Python实现。在WebNLG数据集上的实验表明,该系统生成的文本质量优于相同大模型直接生成的结果(根据BLEU和BLEURT指标),且产生的幻觉少于在同一数据上微调的BART模型。此外,在运行时,该方法所需的处理时间仅为神经方法的极小部分,仅需单个CPU核心即可完成。
原文摘要 · Abstract (English)
We introduce a simple approach that uses a large language model (LLM) to automatically implement a fully interpretable rule-based data-to-text system in pure Python. Experimental evaluation on the WebNLG dataset showed that such a constructed system produces text of better quality (according to the BLEU and BLEURT metrics) than the same LLM prompted to directly produce outputs, and produces fewer hallucinations than a BART language model fine-tuned on the same data. Furthermore, at runtime, the approach generates text in a fraction of the processing time required by neural approaches, using only a single CPU
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。