揭示线性回归学习索引的投毒攻击理论极限,为安全防御提供依据。
Mathematical Foundations of Poisoning Attacks on Linear Regression over Cumulative Distribution Functions
- 从理论上证明单点投毒攻击的最优解,验证现有方法的有效性。
- 发现多点攻击中贪心策略非最优,推导出最优攻击应满足的关键性质。
- 提出攻击影响上界计算方法,实证显示贪心策略接近理论最优。
学习索引通过机器学习模型近似累积分布函数(CDF)实现快速检索(Kraska et al., SIGMOD'18)。然而,近期研究指出其易受投毒攻击:向训练数据中注入少量毒化键可显著降低模型精度并损害索引性能(Kornaropoulos et al., SIGMOD'22)。本文对基于线性回归的CDF学习索引的投毒攻击进行严谨理论分析,主要贡献包括:(i) 理论证明最优单点攻击的存在性,并证实现有方法达到最优;(ii) 在多点攻击中,指出贪心策略并非总是最优,并严格推导出最优攻击需满足的核心性质;(iii) 提出计算多点攻击影响上界的算法,并实证表明贪心方法的损失通常接近该上界。本研究深化了对线性回归模型在CDF上攻击策略的理论理解,为学习索引的攻防评估提供了理论基础。
原文摘要 · Abstract (English)
Learned indexes are a class of index data structures that enable fast search by approximating the cumulative distribution function (CDF) using machine learning models (Kraska et al., SIGMOD'18). However, recent studies have shown that learned indexes are vulnerable to poisoning attacks, where injecting a small number of poison keys into the training data can significantly degrade model accuracy and reduce index performance (Kornaropoulos et al., SIGMOD'22). In this work, we provide a rigorous theoretical analysis of poisoning attacks targeting linear regression models over CDFs, one of the most basic regression models and a core component in many learned indexes. Our main contributions are as follows: (i) We present a theoretical proof characterizing the optimal single-point poisoning attack and show that the existing method yields the optimal attack. (ii) We show that in multi-point attacks, the existing greedy approach is not always optimal, and we rigorously derive the key properties that an optimal attack should satisfy. (iii) We propose a method to compute an upper bound of the multi-point poisoning attack's impact and empirically demonstrate that the loss under the greedy approach is often close to this bound. Our study deepens the theoretical understanding of attack strategies against linear regression models on CDFs and provides a foundation for the theoretical evaluation of attacks and defenses on learned indexes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。