arXiv:2410.06243cs.CVcs.AI2024-10被引 4

无需人工标注,自动发现模型漏洞并可视化失败模式。

Unsupervised Model Diagnosis

  • 用生成模型在隐空间搜索反事实方向,自动找关键语义变化。
  • 在分类、分割等任务中准确识别出模型的虚假关联与失效模式。
  • 完全无监督,适合快速评估模型鲁棒性,尤其适用于缺乏标注数据场景。

确保深度视觉系统的可解释性与鲁棒性对可靠部署至关重要。当前评估方法依赖大量人工标注测试集,成本高且覆盖不全。近期模型诊断框架利用用户输入(如文本)评估模型脆弱性,但易受用户领域知识限制。本文提出无监督模型诊断(UMO),借助生成模型在无用户引导下生成语义反事实解释。给定一个可微分的计算机视觉模型(目标模型),UMO 在生成隐空间中优化最具有反事实意义的方向,识别并可视化语义变化,并将这些变化匹配到词典或语言模型等广泛文本源中的属性。我们在多个视觉任务(如分类、分割、关键点检测)上验证该框架。大量实验表明,该无监督方法能准确揭示模型的虚假相关性,并可视化其失败模式,全程无需人工干预。

原文摘要 · Abstract (English)

Ensuring model explainability and robustness is essential for reliable deployment of deep vision systems. Current methods for evaluating robustness rely on collecting and annotating extensive test sets. While this is common practice, the process is labor-intensive and expensive with no guarantee of sufficient coverage across attributes of interest. Recently, model diagnosis frameworks have emerged leveraging user inputs (e.g., text) to assess the vulnerability of the model. However, such dependence on human can introduce bias and limitation given the domain knowledge of particular users. This paper proposes Unsupervised Model Diagnosis (UMO), that leverages generative models to produce semantic counterfactual explanations without any user guidance. Given a differentiable computer vision model (i.e., the target model), UMO optimizes for the most counterfactual directions in a generative latent space. Our approach identifies and visualizes changes in semantics, and then matches these changes to attributes from wide-ranging text sources, such as dictionaries or language models. We validate the framework on multiple vision tasks (e.g., classification, segmentation, keypoint detection). Extensive experiments show that our unsupervised discovery of semantic directions can correctly highlight spurious correlations and visualize the failure mode of target models without any human intervention.

模型诊断无监督学习反事实解释视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。