arXiv:2412.16251cs.LG2024-12中稿 · ed被引 2

用知识一致性提升模型检索准确率,无需训练即可选最优神经网络。

Know2Vec: A Black-Box Proxy for Neural Network Retrieval

  • 通过黑盒接口提取模型决策知识,生成精准向量表示。
  • 在多样化任务上相比现有方法提升检索准确率,最高达15.3%。
  • 适合想快速选型的开发者或资源有限的研究者使用。

对普通用户而言,从零训练神经网络通常困难且耗时。幸运的是,神经网络库允许他们直接使用或在本地微调性能优异的模型。尽管现有模型检索方法试图将模型转化为向量以避免复杂的多轮推理过程,但因向量化不准确及查询数据集与模型间的相关性偏差,仍难选出合适模型。本文从知识一致性视角出发——即模型所掌握的知识是否满足查询任务需求——提出名为Know2Vec的模型检索方案,作为模型库的黑盒检索代理。Know2Vec预先通过黑盒接口访问模型,捕获关键决策知识并保障模型隐私;随后采用有效编码技术将知识转化为精确模型向量;其次,通过探测查询样本内的语义关系,将用户查询任务映射为知识向量;最后,在对齐空间中通过监督学习优化查询向量与模型向量之间的知识一致性,实现推理阶段最适模型的识别。大量实验表明,Know2Vec在多种神经网络检索任务中优于当前最优方法。

原文摘要 · Abstract (English)

For general users, training a neural network from scratch is usually challenging and labor-intensive. Fortunately, neural network zoos enable them to find a well-performing model for directly use or fine-tuning it in their local environments. Although current model retrieval solutions attempt to convert neural network models into vectors to avoid complex multiple inference processes required for model selection, it is still difficult to choose a suitable model due to inaccurate vectorization and biased correlation alignment between the query dataset and models. From the perspective of knowledge consistency, i.e., whether the knowledge possessed by the model can meet the needs of query tasks, we propose a model retrieval scheme, named Know2Vec, that acts as a black-box retrieval proxy for model zoo. Know2Vec first accesses to models via a black-box interface in advance, capturing vital decision knowledge from models while ensuring their privacy. Next, it employs an effective encoding technique to transform the knowledge into precise model vectors. Secondly, it maps the user's query task to a knowledge vector by probing the semantic relationships within query samples. Furthermore, the proxy ensures the knowledge-consistency between query vector and model vectors within their alignment space, which is optimized through the supervised learning with diverse loss functions, and finally it can identify the most suitable model for a given task during the inference stage. Extensive experiments show that our Know2Vec achieves superior retrieval accuracy against the state-of-the-art methods in diverse neural network retrieval tasks.

模型检索黑盒代理知识一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。