arXiv:2607.27686cs.AI2026-07

为AI生成回答中的广告设计可量化评估与定价系统

Evaluating and Pricing Advertisements in AI-Generated Responses

论文配图:Evaluating and Pricing Advertisements in AI-Generated Responses
图 1 · 摘自论文原文
  • 用心理模拟构建广告点击意图的监督信号
  • 评估准确率达86%人类偏好一致,优于现有模型
  • 支持广告生成训练与复杂竞价机制设计

随着搜索逐渐转向由大语言模型驱动的回答引擎,广告正被嵌入生成内容中,需同时评估其用户价值与商业价值。核心挑战在于点击意图的缺失:行为日志不可得,人工标注难以校准,前沿大模型评判者将意图混淆于语言流畅度。这一缺口导致精准定价依赖连续意图信号,而生成该信号又需当前不存在的监督数据。本文通过心理基础的代理模拟框架构建缺失监督,并提炼为参数高效的评估器,可预测点击意图及广告质量三个维度,输出平滑可微估计。经显著行为扰动验证,该评估器在相关性敏感度上达79%,超越现有零样本模型(60%-67%);能追踪内容退化程度,对103个虚构产品无误差泛化,且在五名标注者间86%的成对判断中与人类偏好一致,且评估置信度越高,一致性越强。基于此估计构建直接定价层,推导出真实报价最优的唯一支付规则,在best-of-k分配中验证,并扩展至非单调分配。同一可微信号亦可作为广告生成的训练目标。

原文摘要 · Abstract (English)

As search increasingly shifts toward LLM-driven answer engines, advertising is becoming embedded within the generated response itself and should therefore be evaluated for both user utility and commercial value. The key challenge is click-through intent: behavioural logs are unavailable, human annotation resists calibration, and frontier LLM judges conflate intent with linguistic fluency. These gaps compound, as principled pricing presupposes a continuous intent signal, while generating such a signal presupposes supervision that is currently unavailable. We construct the missing supervision through a psychologically grounded agent simulation framework, and distil it into a parameter-efficient evaluator that predicts click-through intent, together with the three companion dimensions of ad quality, as smooth, differentiable estimates. Validated through sign-certain behavioural perturbations, the evaluator surpasses frontier zero-shot judges on relevance sensitivity (79% versus 60-67%), tracks graded content degradation, generalises without error to 103 fictional products, and agrees with human preference in 86% of pairwise judgements across five annotators, with agreement rising in the evaluator's confidence. Upon its estimates we build the pricing layer directly, deriving the unique payment rule under which truthful bidding is optimal, demonstrating it on a best-of-k allocation, and extending the mechanism to non-monotone allocations. The same differentiable signal stands ready as a training objective for ad generation.

广告评估大模型定价机制可微信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。