研究评论推断评分时,解释性与准确性的关系
Demystifying the Accuracy-Interpretability Trade-Off: A Case Study of Inferring Ratings from Reviews
- 提出复合解释性评分CI,量化模型可解释性
- 发现解释性越强,准确率通常越低但非严格单调
- 适合关注AI决策可信度的NLP应用研究者
可解释机器学习模型能提供决策依据,但性能常不如黑箱模型。这种解释性与性能之间的权衡在关键应用场景中引发广泛讨论,因决策理由对信任与问责至关重要。本文针对自然语言处理中较少被关注的「从评论推断评分」任务,对比分析多种黑箱与可解释模型。通过引入复合解释性(Composite Interpretability, CI)量化指标,可视化不同模型在性能与可解释性间的权衡。结果表明,总体上性能随解释性降低而提升,但该关系并非严格单调;存在某些情况下可解释模型更具优势。
原文摘要 · Abstract (English)
Interpretable machine learning models offer understandable reasoning behind their decision-making process, though they may not always match the performance of their black-box counterparts. This trade-off between interpretability and model performance has sparked discussions around the deployment of AI, particularly in critical applications where knowing the rationale of decision-making is essential for trust and accountability. In this study, we conduct a comparative analysis of several black-box and interpretable models, focusing on a specific NLP use case that has received limited attention: inferring ratings from reviews. Through this use case, we explore the intricate relationship between the performance and interpretability of different models. We introduce a quantitative score called Composite Interpretability (CI) to help visualize the trade-off between interpretability and performance, particularly in the case of composite models. Our results indicate that, in general, the learning performance improves as interpretability decreases, but this relationship is not strictly monotonic, and there are instances where interpretable models are more advantageous.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。