用可解释的RBF网络替代传统投影头,无需标签就能评估模型性能。
Radial Basis Function Networks as Projection Heads in Self-Supervised Learning
- 用高斯径向基函数网络替换MLP投影头,参数具可解释性。
- 提出SNS指标,与线性探测相关性达强至极强,无需标签评估表征质量。
- 适用于希望免标签评估表示能力的研究者,兼容主流SSL框架。
自监督学习通常采用骨干编码器加小型多层感知机(MLP)投影头的结构,训练后抛弃投影头,仅通过昂贵的线性探测在标注数据上评估骨干质量。我们指出该做法计算浪费严重。为此,提出用径向基函数网络(RBFN)替代标准MLP投影头,其学习到的中心与形状参数具有可解释性,可用于无标签评估表征质量。我们引入一种新的无标签质量度量——尺度归一化分离(SNS),仅基于训练中学习的核中心和形状。在五个典型自监督架构(MoCo、SimCLR、BYOL、SwAV、SimSiam)和四个图像分类数据集上,实验表明RBFN投影头是性能相当的即插即用替代方案。建议使用三层高斯径向基函数激活的RBFN结构。SNS与已有逻辑回归度量表现出强至极强正相关,证明训练好的RBFN可作为骨干表征质量的可靠代理。此外,我们发布一个基于Google Open Images V7的全新PyTorch兼容图像分类数据集,以支持可复现的表示学习研究。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) typically relies on a backbone encoder followed by a small multilayer perceptron (MLP) projection head, which is conventionally discarded after training, while backbone quality is assessed via costly linear probing on labeled data. We argue that this approach including discarding the projector is rather computationally wasteful. Instead, we propose replacing the MLP head with a radial basis function network (RBFN), whose interpretable center and shape parameters can be exploited to judge representation quality without labels or a separate classifier. To this end, we introduce Scale-Normalized Separation (SNS), a novel label-free quality metric derived solely from the kernel centers and shapes learned during training. Across five canonical SSL architectures (MoCo, SimCLR, BYOL, SwAV and SimSiam) and four image classification datasets, we show that RBFN projection heads are competitive drop-in replacements for standard MLP projectors. We recommend constructing them with three RBF layers activated by the Gaussian radial basis function. Moreover, SNS exhibits strong to very strong positive correlation with established logistic regression metrics, demonstrating that a trained RBFN projector can act as a reliable proxy for backbone representation quality. We additionally publish a novel PyTorch compatible image classification dataset based on Google's Open Images V7 to facilitate reproducible research into representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。