提出上下文敏感的数据检测框架,提升敏感信息识别准确率。
Towards Contextual Sensitive Data Detection
- 基于数据类型和领域上下文双重判断敏感性
- 类型上下文降低误报率,召回率达94%(商用工具仅63%)
- 适用于人道主义等非标准数据领域的敏感信息检测
开放数据门户的兴起要求在数据发布前加强敏感信息保护。为此,本文认为敏感性取决于上下文,提出一种上下文敏感数据检测框架,包含两个核心机制:1)类型上下文化,结合数据集或文档整体背景评估数据值的真实敏感性;2)领域上下文化,利用外部领域信息(如数据地理来源)判断敏感性。实验使用语言模型验证:1)类型上下文化显著减少类型驱动检测的误报,召回率达94%,优于商用工具的63%;2)借助敏感规则检索的领域上下文化能有效将检测结果锚定在非标准数据领域的真实语境中。与人道主义数据专家的案例研究显示,基于上下文的解释可为人工审计提供有效指导。代码与标注数据集已开源:https://github.com/trl-lab/sensitive-data-detection。
原文摘要 · Abstract (English)
The emergence of open data portals necessitates more attention to protecting sensitive data before datasets get published and exchanged. To do so effectively, we observe the need to refine and broaden our definitions of sensitive data, and argue that the sensitivity of data depends on its context. Following this definition, we introduce a contextual data sensitivity framework building on two core concepts: 1) type contextualization, which considers the type of the data values at hand within the overall context of the dataset or document to assess their true sensitivity, and 2) domain contextualization, which assesses the sensitivity of data values informed by domain-specific information external to the dataset, such as geographic origin of a dataset. Experiments instrumented with language models confirm that: 1) type-contextualization significantly reduces the number of false positives for type-based sensitive data detection and reaches a recall of 94% compared to 63% with commercial tools, and 2) domain-contextualization leveraging sensitivity rule retrieval effectively grounds sensitive data detection in relevant context in non-standard data domains. A case study with humanitarian data experts also illustrates that context-grounded explanations provide useful guidance in manual data auditing processes. We open-source the implementation of the mechanisms and annotated datasets at https://github.com/trl-lab/sensitive-data-detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。