用对抗演化框架让广告在对话搜索中更隐蔽,同时提升检测能力。
TeamCMU at Touché: Adversarial Co-Evolution for Advertisement Integration and Detection in Conversational Search
- 构建广告重写与分类器的模块化流水线,实现广告无缝嵌入与识别。
- 合成数据训练的分类器在多种植入策略下仍保持高检测准确率。
- 通过引导优化使广告更隐蔽,适合需要平衡商业与体验的系统设计者。
随着基于大语言模型(LLMs)和检索增强生成(RAG)的对话式搜索引擎兴起,将广告融入生成回复既带来商业机遇,也对用户体验构成挑战。与传统搜索中广告清晰区分不同,生成系统模糊了信息内容与推广材料的界限,引发透明度与信任问题。本文提出一种模块化广告管理流水线,包含广告重写器与鲁棒广告分类器。利用合成数据训练高性能分类器,并用于指导两种互补的广告集成策略:监督微调广告重写器,以及基于最佳-N采样的方法,从多个候选回复中选出最不易被检测到的版本。评估聚焦两大核心问题:分类器对多样广告集成策略的检测效果,以及最优训练方法如何支持一致且低侵入性的广告插入。实验表明,基于营销策略生成的合成数据并结合课程学习训练的分类器,具备强健的检测性能;而通过分类器引导的优化(微调与最佳-N采样)显著提升了广告隐蔽性,实现了更自然的融合。研究成果为开发更智能的广告感知生成式搜索系统与鲁棒广告分类器提供了对抗共进化框架。
原文摘要 · Abstract (English)
As conversational search engines increasingly adopt generation-based paradigms powered by Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), the integration of advertisements into generated responses presents both commercial opportunities and challenges for user experience. Unlike traditional search, where advertisements are clearly delineated, generative systems blur the boundary between informational content and promotional material, raising concerns around transparency and trust. In this work, we propose a modular pipeline for advertisement management in RAG-based conversational systems, consisting of an ad-rewriter for seamless ad integration and a robust ad-classifier for detection. We leverage synthetic data to train high-performing classifiers, which are then used to guide two complementary ad-integration strategies: supervised fine-tuning of the ad-rewriter and a best-of-N sampling approach that selects the least detectable ad-integrated response among multiple candidates. Our evaluation focuses on two core questions: the effectiveness of ad classifiers in detecting diverse ad integration strategies, and the training methods that best support coherent, minimally intrusive ad insertion. Experimental results show that our ad-classifier, trained on synthetic advertisement data inspired by marketing strategies and enhanced through curriculum learning, achieves robust detection performance. Additionally, we demonstrate that classifier-guided optimization, through both fine-tuning and best-of-N sampling, significantly improves ad stealth, enabling more seamless integration. These findings contribute an adversarial co-evolution framework for developing more sophisticated ad-aware generative search systems and robust ad classifiers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。