arXiv:2412.05842cs.LGcs.AI2024-12被引 2

无需训练数据,就能反推黑盒模型的结构特征

DREAM: Domain-agnostic Reverse Engineering Attributes of Black-box Model

  • 将反向工程建模为分布外泛化问题,构建无领域依赖的元模型
  • 在未知训练数据情况下,仍能准确推断卷积层数等关键属性
  • 适用于任意领域,适合模型安全与可解释性研究者

深度学习模型在部署时通常为黑箱。已有工作表明,通过一系列查询可暴露目标模型的属性(如卷积层数量)。但这些方法假设已知目标模型的训练数据,而现实中难以获取。本文研究无需训练数据的黑盒模型属性反向工程问题,提出通用且理论严谨的DREAM框架,将该问题建模为分布外(OOD)泛化任务,从而学习一个无领域依赖的元模型,以推断未知训练数据的目标模型属性。实验表明,该方法在多个场景下显著优于基线。

原文摘要 · Abstract (English)

Deep learning models are usually black boxes when deployed on machine learning platforms. Prior works have shown that the attributes (e.g., the number of convolutional layers) of a target black-box model can be exposed through a sequence of queries. There is a crucial limitation: these works assume the training dataset of the target model is known beforehand and leverage this dataset for model attribute attack. However, it is difficult to access the training dataset of the target black-box model in reality. Therefore, whether the attributes of a target black-box model could be still revealed in this case is doubtful. In this paper, we investigate a new problem of black-box reverse engineering, without requiring the availability of the target model's training dataset. We put forward a general and principled framework DREAM, by casting this problem as out-of-distribution (OOD) generalization. In this way, we can learn a domain-agnostic meta-model to infer the attributes of the target black-box model with unknown training data. This makes our method one of the kinds that can gracefully apply to an arbitrary domain for model attribute reverse engineering with strong generalization ability. Extensive experimental results demonstrate the superiority of our proposed method over the baselines.

模型反演黑盒分析OOD泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。