arXiv:2511.19636cs.LGcs.AI2025-11被引 1

探索同一预测性能下的多种模型逻辑,提升可解释性与决策可靠性。

Exploring the Rashomon Set for Concept-Based Models

  • 通过适配器+检查点+概念多样性目标,单次训练生成多组等效模型
  • 在相同精度下实现更高概念多样性,内存消耗仅为基线的1/3
  • 适用于需要可解释性、可信选择或避免误判的高风险场景

在许多机器学习任务中,存在多个预测性能相近但内部逻辑迥异的模型。标准训练仅输出单一模型,难以探索更符合下游需求的替代方案。这些性能相当的模型集合称为Rashomon集。在复杂假设空间(如概念瓶颈模型,CBMs)中探索该集合尤为困难。本文提出一种高效探索CBM Rashomon集的方法:采用专用并行适配器结构,结合检查点机制与概念多样性目标,从一次训练过程中生成多个精度相当的模型。实验表明,本方法在保持高精度的同时,模型多样性显著优于基线,且内存开销仅为基线的三分之一。进一步实验证明,这些多样而准确的模型可用于可信模型选择、解决类别间混淆问题,并实现可靠决策拒绝。

原文摘要 · Abstract (English)

In many machine learning problems, there may exist multiple models that achieve nearly identical predictive performance while relying on fundamentally different internal logic. However, standard training procedures produce a single model, offering no practical way to explore alternatives that may better suit downstream needs. The set of these equally accurate models is known as the Rashomon set. Exploring the Rashomon set is particularly challenging in large and complex hypothesis spaces, such as Concept Bottleneck Models (CBMs), which are widely used in computer vision to make predictions through intermediate, human-understandable concepts. In this paper, we provide a method for efficiently exploring the Rashomon set of CBMs. Our framework introduces a specialized parallel adapter-based construction, combined with a checkpointing scheme and a concept diversity objective, to generate multiple equally accurate CBMs from a single training process. Empirical results show that our method finds models with better diversity than baselines while using much less memory. We further demonstrate that access to these diverse yet accurate CBMs enables trustworthy model selection, resolution of inter-class confusion, and reliable abstention in decision-making.

可解释性概念模型模型多样性决策可靠

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。