用语法图生成7亿条韩语法律对话数据,提升聊天机器人准确率。
Generating training datasets for legal chatbots in Korean
- 基于局部语法图生成海量对话语料并自动标注意图。
- 训练模型达91%的F1分数,支持精准法律问答。
- 适合法律AI开发者和多语言对话系统研究者。
聊天机器人可通过文本或语音与人类交互。法律聊天机器人能提升司法可及性,因律师服务成本高昂,使弱势群体难以获得帮助。然而,深度学习对话系统(聊天机器人)的数据集需涵盖真实用户输入的多样性,这面临技术挑战:需大量数据且需标注以分类用户意图,而标注成本随数据量增加。本文提出不依赖人工标注真实数据,而是联合生成大量语句与高质量标签。该方法基于局部语法图(LGG),捕捉语言学家观察到的词汇与局部语法特征,并根据领域特定分类体系为语句关联标签。我们通过开源Unitex平台,利用LGG生成了7亿条标注语句,用于训练DIET分类器,模型在测试中达到91% F1分数。据此实现名为LIGA的韩语法律聊天机器人,可根据用户问题匹配韩国政府公开的类似案例网页链接。
原文摘要 · Abstract (English)
Chatbots are robots that can communicate with humans using text or voice signals. Legal chatbots improve access to justice, since legal representation and legal advice by lawyers come with a high cost that excludes disadvantaged and vulnerable people. However, capturing the diversity of actual user input in datasets for deep-learning dialog systems (chatbots) is a technical challenge. Diversity requires large volumes of data, which must also be labelled in order to classify the user's intent, while the cost of labelling datasets increases with volume. Instead of labelling large volumes of authentic data from users, our approach consists in jointly generating large volumes of utterances and high-quality labels. The generator of labelled datasets is based on language resources that take the form of local grammar graphs (LGG), which capture and generalize the vocabulary and local syntax observed by linguists in text. The LGGs associate labels to the utterances according to a domain-specific classification system. We tested this approach by implementing LIGA, a legal chatbot in Korean. The chatbot answers users' conversational queries on legal situations by providing information on similar legal cases, made publicly available by the Korean government. We generated labelled utterances from the LGGs with the aid of the open-source Unitex platform. This process produced 700 million utterances. We trained a DIET classifier on a dataset made of these utterances, and the trained model reached 91% f1-score performance. We implemented a chatbot called LIGA, which uses the results of the model to select a link to a web page that documents similar legal cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。