arXiv:2505.04665cs.CLcs.AI2025-05被引 16

用BERT模型提升广告推荐效果,同时保护用户隐私

Personalized Risks and Regulatory Strategies of Large Language Models in Digital Advertising

  • 结合BERT与注意力机制构建广告推荐模型
  • 实测点击率和转化率显著提升,隐私泄露风险降低
  • 适合关注隐私安全的广告平台与合规技术研究者

尽管大语言模型在实验环境下展现出个性化广告推荐潜力,但在实际应用中,如何将推荐系统与用户隐私保护、数据安全措施结合仍需深入探讨。本文研究大语言模型在数字广告中的个性化风险与监管策略。首先阐述大语言模型(特别是基于Transformer架构的自注意力机制)的工作原理及其自然语言理解与生成能力。随后,将BERT(双向编码器表示从变换器)模型与注意力机制结合,构建个性化广告推荐与用户因素风险防护算法。具体流程包括:数据收集与预处理、特征选择与构建、利用BERT进行广告语义嵌入,以及基于用户画像的广告推荐。通过本地模型训练与数据加密,保障用户隐私安全,防止个人数据泄露。设计基于BERT的大语言模型个性化广告推荐实验,并使用真实用户数据验证。结果表明,基于BERT的广告推送可有效提升广告点击率与转化率;同时,通过本地训练与隐私保护机制,用户隐私泄露风险得以显著降低。

原文摘要 · Abstract (English)

Although large language models have demonstrated the potential for personalized advertising recommendations in experimental environments, in actual operations, how advertising recommendation systems can be combined with measures such as user privacy protection and data security is still an area worthy of in-depth discussion. To this end, this paper studies the personalized risks and regulatory strategies of large language models in digital advertising. This study first outlines the principles of Large Language Model (LLM), especially the self-attention mechanism based on the Transformer architecture, and how to enable the model to understand and generate natural language text. Then, the BERT (Bidirectional Encoder Representations from Transformers) model and the attention mechanism are combined to construct an algorithmic model for personalized advertising recommendations and user factor risk protection. The specific steps include: data collection and preprocessing, feature selection and construction, using large language models such as BERT for advertising semantic embedding, and ad recommendations based on user portraits. Then, local model training and data encryption are used to ensure the security of user privacy and avoid the leakage of personal data. This paper designs an experiment for personalized advertising recommendation based on a large language model of BERT and verifies it with real user data. The experimental results show that BERT-based advertising push can effectively improve the click-through rate and conversion rate of advertisements. At the same time, through local model training and privacy protection mechanisms, the risk of user privacy leakage can be reduced to a certain extent.

广告推荐BERT隐私保护大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。