arXiv:2606.13610cs.CLcs.AI2026-06

测试发现一个被污染网页就能让大模型推荐假商品,最高骗过率超七成。

One Polluted Page Is Enough: Evaluating Web Content Pollution in LLM Recommenders

论文配图:One Polluted Page Is Enough: Evaluating Web Content Pollution in LLM Recommenders
图 1 · 摘自论文原文
  • 用伪造内容替换真实网页,测试大模型推荐可靠性。
  • 单页污染使推荐错误率达27%,三页全换时达73.8%。
  • 推理和防御策略均无效,适合关注AI推荐安全的研究者。

搜索增强型大模型通过检索实时网页内容来生成消费推荐,但面临新型风险:生成式引擎优化(GEO)运营商可污染网页内容误导模型。我们提出FORGE(生成环境中的虚假在线推荐),在冻结的检索页面中局部改写真实产品为虚假产品,评估15个品类共225个真实产品在5种消费场景下的推荐错误率。测试涵盖12个商用与开源大模型,全部存在漏洞:单页污染导致最高27%的推荐欺骗率,全顶部3页替换提升至73.8%。漏洞程度因品类而异,模型对产品缺乏稳定先验知识时更易受影响。推理过程非但未缓解风险,反而常生成虚假社交证据强化错误推荐。四种防御手段均不充分:怀疑提示可能加剧漏洞,共识过滤会误杀正品,可信度重排序虽有效但仅能消除六分之一假货。代码与基准已开源。

原文摘要 · Abstract (English)

Search-augmented LLMs increasingly mediate everyday consumer recommendations by retrieving live web content. This creates a new risk: LLM recommenders may consume web content that Generative Engine Optimization (GEO) operators have polluted to mislead them. We ask: to what extent do they become unwitting promoters of fake products? We introduce FORGE (Fake Online Recommendations in Generative Environments), which locally rewrites real products in a frozen set of retrieved web pages into fake ones and measures how often the LLM recommends the fake product, across 225 real products in 15 categories and 5 consumer scenarios. Across 12 commercial and open-weights LLMs, all models are vulnerable: a single polluted page yields fooled rates of up to 27%, while the full top-3 replacement raises this to 73.8%. Vulnerability varies across categories, increasing when models lack stable prior knowledge of the products. Reasoning does not mitigate this vulnerability; instead, it often generates spurious social proof to justify false recommendations. None of the four defenses is adequate: the skepticism prompt can exacerbate vulnerability much like reasoning, the two consensus filters risk suppressing legitimate products, and credibility re-ranking helps every model but removes only a sixth of the fakes. We release the FORGE benchmark and the evaluation code at https://github.com/leoluolol/forge-benchmark.

大模型安全推荐系统虚假信息网页污染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。