挑战硬标签模型提取多项式时间的假设,发现深度增加时攻击失效。
Is the Hard-Label Cryptanalytic Model Extraction Really Polynomial?
- 分析硬标签提取中恒活跃神经元的干扰,揭示其阻碍攻击的关键机制。
- 证明深度增大时观测神经元状态切换需指数级查询,突破多项式假设。
- 提出跨层提取新方法,降低查询复杂度,适用于深层模型攻击场景。
深度神经网络(DNN)作为重要知识产权,其模型提取受到广泛关注。传统攻击依赖精确输出对数,但实际中难以获取;近年研究转向仅提供分类结果(如'狗'或'车')的硬标签设置。Carlini等人(Eurocrypt 2025)声称该设置下模型提取仍可在多项式时间内完成。本文指出:其攻击依赖的关键假设——可忽略恒活跃神经元的影响——在深层网络中不成立。我们发现,即使一个几乎总激活的神经元,若参数未被恢复,也会引入不可忽略误差。而通过观察其状态切换以提取参数,在深度增加时所需查询量呈指数增长。因此,硬标签提取并非总是多项式时间。为此,我们提出跨层提取新攻击:不直接窃取权重和偏置,而是利用跨层交互从深层恢复参数,显著降低查询复杂度,克服现有方法局限。
原文摘要 · Abstract (English)
Deep Neural Networks (DNNs) have attracted significant attention, and their internal models are now considered valuable intellectual assets. Extracting such a model via oracle access to a DNN is conceptually similar to extracting a secret key from a block cipher. Consequently, cryptanalytic techniques, particularly differential-like attacks, have been actively explored. ReLU-based DNNs are the most common and widely deployed architectures. While early works (e.g., Crypto 2020, Eurocrypt 2024) assume access to exact output logits, which are typically not exposed, more recent works (e.g., Asiacrypt 2024, Eurocrypt 2025) focus on the hard-label setting, where only the final classification result (e.g., "dog" or "car") is available. Notably, Carlini et al. (Eurocrypt 2025) showed that model extraction is feasible in polynomial time even under this restricted setting. In this paper, we show that a key assumption underlying their attack becomes increasingly unrealistic as the target depth grows. While prior works noted neurons whose activation states rarely change, we analyze their concrete impact on hard-label extraction: even a single neuron that is (almost) always active can prevent the attack from proceeding unless its parameters are recovered, and ignoring it incurs a non-negligible error. A straightforward solution is to extract these parameters by observing a state switch of such a neuron, but observing such a switch becomes exponentially harder as depth increases, implying that hard-label extraction is not always polynomial time. To address this limitation, we propose a novel attack called cross-layer extraction. Rather than extracting secret parameters (e.g., weights and biases) directly, we exploit cross-layer interactions to recover them from deeper layers, reducing query complexity and addressing limitations of existing approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。