提出隐私保护的非迭代审计方案,解决平台与审计方协作难题
P2NIA: Privacy-Preserving Non-Iterative Auditing
- 用合成或本地数据替代API查询,实现非迭代审计
- 在不泄露数据分布的前提下,降低审计偏差
- 适合需要合规审计且重视数据隐私的AI平台
AI立法兴起加剧了对高风险AI系统伦理合规性的评估需求。传统审计依赖平台API,通过分析查询响应来评估公平性,但此方法给平台带来巨大负担:既要维持API接口,又要防范数据泄露。平台与审计方之间缺乏有效协作,导致审计方因不了解平台数据分布而产生估计偏差。为此,本文提出P2NIA,一种新型审计方案,促进审计方与平台之间的互利协作。大量实验表明,P2NIA能有效解决上述双重问题。本工作提出一种隐私保护、非迭代的审计机制,利用合成数据或本地数据进行公平性评估,避免传统API审计带来的挑战。
原文摘要 · Abstract (English)
The emergence of AI legislation has increased the need to assess the ethical compliance of high-risk AI systems. Traditional auditing methods rely on platforms' application programming interfaces (APIs), where responses to queries are examined through the lens of fairness requirements. However, such approaches put a significant burden on platforms, as they are forced to maintain APIs while ensuring privacy, facing the possibility of data leaks. This lack of proper collaboration between the two parties, in turn, causes a significant challenge to the auditor, who is subject to estimation bias as they are unaware of the data distribution of the platform. To address these two issues, we present P2NIA, a novel auditing scheme that proposes a mutually beneficial collaboration for both the auditor and the platform. Extensive experiments demonstrate P2NIA's effectiveness in addressing both issues. In summary, our work introduces a privacy-preserving and non-iterative audit scheme that enhances fairness assessments using synthetic or local data, avoiding the challenges associated with traditional API-based audits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。