arXiv:2502.09340cs.LG2025-02中稿 · the 4th World Conf…被引 3

剖析可解释模型的瓶颈,指明未来研究方向。

This looks like what? Challenges and Future Research Directions for Part-Prototype Models

  • 分析原型模型如何通过对比输入与原型进行分类
  • 指出原型质量差、泛化能力弱等核心挑战
  • 适合关注模型可解释性与人机协作的研究者

近年来,可解释人工智能(XAI)的兴起推动了内置可解释性模型的研究,其中部件原型模型(PPMs)尤为突出。这类模型通过将输入与学习到的原型比较来分类,并提供“这看起来像那”的人类可理解解释。尽管具备内在可解释性,但PPMs尚未成为后处理解释方法的有力替代方案。本文综述2019至2025年间相关工作,构建了当前PPMs面临挑战的分类体系。分析揭示出一系列开放问题:主要集中在所学原型的质量与数量上;此外还存在任务和场景间泛化能力有限,以及评估不标准化等方法论缺陷。文章提出五大研究方向:提升预测性能、发展理论基础架构、建立人机协作框架、对齐人类概念、定义稳健的评估指标与基准。旨在激发进一步研究,推动内在可解释模型在实际中的应用。被调研论文清单见https://github.com/aix-group/ppm-survey。

原文摘要 · Abstract (English)

The growing interest in eXplainable Artificial Intelligence (XAI) has stimulated research on models with built-in interpretability, among which part-prototype models are particularly prominent. Part-Prototype Models (PPMs) classify inputs by comparing them to learned prototypes and provide human-understandable explanations of the form "this looks like that". Despite this intrinsic interpretability, PPMs have not yet emerged as a competitive alternative to post-hoc explanation methods. This survey reviews work published between 2019 and 2025 and derives a taxonomy of the challenges faced by current PPMs. The analysis reveals a diverse set of open problems. The main issue concerns the quality and number of learned prototypes. Further challenges include limited generalization across tasks and contexts, as well as methodological shortcomings such as non-standardized evaluation. Five broad research directions are identified: improving predictive performance, developing theoretically grounded architectures, establishing frameworks for human-AI collaboration, aligning models with human concepts, and defining robust metrics and benchmarks for evaluation. The survey aims to stimulate further research and promote intrinsically interpretable models for practical applications. A curated list of the surveyed papers is available at https://github.com/aix-group/ppm-survey.

可解释AI原型模型人机协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。