分析3.7万次推荐运行,发现品牌在AI推荐中的成败与自身知名度层级强相关。
Prominence-Stratified Failure Modes in Retrieval-Augmented Commercial Recommendation: A 37,000-Run Audit
- 按品牌知名度分五层,测试不同层级在AI推荐中的表现差异
- 头部品牌可见但胜率仅25%-41%,中腰部品牌转化率最高达52%
- 小众品牌超半数完全不被召回,营销策略需按层级定制
AI助手如ChatGPT和Claude是推荐引擎而非搜索引擎:它们通过直接推荐品牌来回答商业问题,而非返回链接列表。因此,面向AI的营销远超“出现在搜索结果中”——定位、内容与产品匹配度与可发现性同等重要。本研究对四类模型配置与215个商业导向提示词进行了约3.7万次生产级运行审计,覆盖19个行业,评估对象为包含533个品牌的参考目录,该目录按外部权威数据分为五个知名度层级(L1至L5)。L1为品类领导者,L5为区域性玩家,该分层反映品牌认知范围而非收入或市场份额。不同层级失败模式显著不同:L1品牌几乎总能被检索到,但仅赢得25%-41%的推荐位,优势在于差异化而非曝光;L2挑战者转化率最高(37%-52%),但在Anthropic模型上受人格化替代影响;L3中等市场品牌为转折点,覆盖率降至88%,转化率34%-40%,人格化效应最强;L4专业型与L5区域品牌遭遇灾难性隐身,48%-52%在所有3.7万次运行中未被召回。无统一优化方案适用所有品牌,正确营销投入取决于品牌在知名度阶梯上的位置。
原文摘要 · Abstract (English)
AI assistants like ChatGPT and Claude are recommendation engines, not search engines: they answer commercial queries by directly nominating brands rather than returning a list of links. Marketing to AI is therefore a broader problem than "show up in search" -- positioning, content, and product fit matter as much as discoverability. We audit ~37,000 production runs across four model configurations and 215 commercially-framed prompts spanning 19 sectors, evaluated against a 533-brand reference catalog stratified into five prominence tiers (L1 category leaders to L5 regional players) sourced from external authority lists. The ladder proxies a brand's awareness footprint within its sector, not revenue or market share. The failure mode differs sharply by tier. L1 brands appear in nearly every relevant retrieval but win only 25-41% of the recommendation slots they reach -- the leverage is differentiation, not visibility. L2 challengers carry the highest conversion rates of any tier (37-52%) but lose to persona-mediated substitution on the Anthropic models. L3 mid-market brands are the inflection level: aggregate coverage drops to 88%, conversion to 34-40%, and persona effects peak. L4 specialists and L5 regional players face catastrophic invisibility -- 48-52% never surface in any of the 37,000 runs. No uniform optimization recipe wins; the right marketing investment depends on where the brand sits on the prominence ladder.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。