用大模型+检索增强生成分析隐私政策中的数据流动,自动构建数据图谱。
LADFA: A Framework of Using Large Language Models and Retrieval-Augmented Generation for Personal Data Flow Analysis in Privacy Policies
- 结合大模型与检索增强生成,利用定制知识库提升提取准确率。
- 在10份汽车行业隐私政策上验证,可自动构建个人数据流图谱。
- 框架灵活可扩展,适用于各类文本分析任务,适合隐私合规研究者。
隐私政策帮助公众了解组织的个人数据处理行为,涵盖数据收集、存储及与第三方共享等多个方面。由于法律语言冗长复杂且各行业实践不一,普通人难以全面理解。为实现对隐私政策的自动化、大规模分析,众多研究尝试使用机器学习与自然语言处理技术,包括大语言模型(LLMs)。尽管已有少量研究利用LLMs从隐私政策中提取个人数据流,本文在此基础上进一步融合检索增强生成(RAG)与基于现有研究构建的定制化知识库,提出LADFA——一个端到端计算框架。该框架能处理非结构化隐私政策文本,提取个人数据流并构建数据流图谱,进而支持图谱分析以发现洞察。系统由预处理器、基于LLM的处理器和后处理模块组成。通过针对汽车行业10份隐私政策的案例研究,验证了方法的有效性与准确性。此外,LADFA设计具备灵活性与可定制性,适用于超出隐私政策分析的多种文本分析任务。
原文摘要 · Abstract (English)
Privacy policies help inform people about organisations' personal data processing practices, covering different aspects such as data collection, data storage, and sharing of personal data with third parties. Privacy policies are often difficult for people to fully comprehend due to the lengthy and complex legal language used and inconsistent practices across different sectors and organisations. To help conduct automated and large-scale analyses of privacy policies, many researchers have studied applications of machine learning and natural language processing techniques, including large language models (LLMs). While a limited number of prior studies utilised LLMs for extracting personal data flows from privacy policies, our approach builds on this line of work by combining LLMs with retrieval-augmented generation (RAG) and a customised knowledge base derived from existing studies. This paper presents the development of LADFA, an end-to-end computational framework, which can process unstructured text in a given privacy policy, extract personal data flows and construct a personal data flow graph, and conduct analysis of the data flow graph to facilitate insight discovery. The framework consists of a pre-processor, an LLM-based processor, and a data flow post-processor. We demonstrated and validated the effectiveness and accuracy of the proposed approach by conducting a case study that involved examining ten selected privacy policies from the automotive industry. Moreover, it is worth noting that LADFA is designed to be flexible and customisable, making it suitable for a range of text-based analysis tasks beyond privacy policy analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。