arXiv:2410.10290cs.CLcs.LG2024-10被引 2

用自然语言生成解释的文本分类流水线,提升非专家理解力。

A Multi-Task Text Classification Pipeline with Natural Language Explanations: A User-Centric Evaluation in Sentiment Analysis and Offensive Language Identification in Greek Tweets

  • 双模型流水线:分类器+自然语言解释生成器
  • 在希腊语推文上实现情感与攻击性语言识别,效果良好
  • 适合需要可解释AI的普通用户或实际应用部署

可解释性近年来备受关注。现有方法多生成规则或特征重要性,对非专业人士较难理解。相比之下,自然语言解释更易懂且便于展示。本文提出一种新型文本分类流水线,包含分类模型和自然语言解释生成器,可为任意文本分类任务提供预测与自然语言解释。该流水线依赖真实理由(rationales)训练解释生成器。实验聚焦于希腊语推文中的情感分析与攻击性语言识别,使用希腊语大语言模型生成解释作为训练标签。通过三项指标的用户研究评估,结果在两个数据集上均表现良好。

原文摘要 · Abstract (English)

Interpretability is a topic that has been in the spotlight for the past few years. Most existing interpretability techniques produce interpretations in the form of rules or feature importance. These interpretations, while informative, may be harder to understand for non-expert users and therefore, cannot always be considered as adequate explanations. To that end, explanations in natural language are often preferred, as they are easier to comprehend and also more presentable to end-users. This work introduces an early concept for a novel pipeline that can be used in text classification tasks, offering predictions and explanations in natural language. It comprises of two models: a classifier for labelling the text and an explanation generator which provides the explanation. The proposed pipeline can be adopted by any text classification task, given that ground truth rationales are available to train the explanation generator. Our experiments are centred around the tasks of sentiment analysis and offensive language identification in Greek tweets, using a Greek Large Language Model (LLM) to obtain the necessary explanations that can act as rationales. The experimental evaluation was performed through a user study based on three different metrics and achieved promising results for both datasets.

可解释AI自然语言解释文本分类希腊语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。