arXiv:2506.04001cs.LGcs.AI2025-06ICCV被引 2

通过因果引导学习,提升神经网络架构性能预测的准确性与可解释性

CARL: Causality-guided Architecture Representation Learning for an Interpretable Performance Predictor

  • 用子结构提取器分离架构的关键与冗余特征
  • 在五个搜索空间上达到97.67%的CIFAR-10 top-1准确率
  • 适合需要高可解释性的NAS性能预测场景

性能预测器已成为加速神经网络架构搜索(NAS)评估阶段的有力方法。它们通过少量已训练架构及其性能之间的相关性,估算未见过架构的性能。然而,现有方法忽略了有限训练样本与多样化测试样本间的分布偏移,倾向于学习虚假相关性作为预测捷径,导致泛化能力差。为此,我们提出因果引导的架构表示学习(CARL),旨在分离架构中的关键(因果)与冗余(非因果)特征,以实现可泛化的性能预测。具体而言,我们使用子结构提取器将输入架构在隐空间中分解为关键与冗余子结构;随后,通过将关键表示与多样冗余表示配对生成多个干预样本,从而强化关键特征的重要性。在五个NAS搜索空间上的大量实验表明,CARL在准确性和可解释性方面均达到当前最优水平。例如,在CIFAR-10上使用DARTS时,其top-1准确率达到97.67%。

原文摘要 · Abstract (English)

Performance predictors have emerged as a promising method to accelerate the evaluation stage of neural architecture search (NAS). These predictors estimate the performance of unseen architectures by learning from the correlation between a small set of trained architectures and their performance. However, most existing predictors ignore the inherent distribution shift between limited training samples and diverse test samples. Hence, they tend to learn spurious correlations as shortcuts to predictions, leading to poor generalization. To address this, we propose a Causality-guided Architecture Representation Learning (CARL) method aiming to separate critical (causal) and redundant (non-causal) features of architectures for generalizable architecture performance prediction. Specifically, we employ a substructure extractor to split the input architecture into critical and redundant substructures in the latent space. Then, we generate multiple interventional samples by pairing critical representations with diverse redundant representations to prioritize critical features. Extensive experiments on five NAS search spaces demonstrate the state-of-the-art accuracy and superior interpretability of CARL. For instance, CARL achieves 97.67% top-1 accuracy on CIFAR-10 using DARTS.

架构搜索因果学习性能预测可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。