用少于10%参数量实现大模型高效自适应竞价,兼顾策略与约束。
Strategy-Aware Parameter-Efficient Adaptation for LLM-based Auto-Bidding

- 通过位置增强与文本对齐,融合竞价轨迹与策略文本信息。
- 仅需调整不足10%参数即达到全微调效果,显著降低计算成本。
- 适合需要快速适配多约束场景的广告竞价系统开发者。
广告竞价已从人工策略转向更适应大规模动态拍卖环境的自动化系统。尽管大语言模型(LLMs)在自动竞价中展现出强大的推理能力,但现有方法存在轨迹与文本交互浅、微调成本高的问题,难以高效利用预训练知识应对多样约束。为此,我们提出SAGE——一种由大模型引导的策略感知型高效竞价框架。SAGE包含三个核心组件:(i) 位置增强模块采用时空语义位置嵌入,有效捕捉内在动态与语义结构;(ii) 文本对齐模块利用门控交叉注意力,对齐轨迹与文本模态的嵌入空间,实现高效多模态融合,同时缓解长轨迹带来的计算开销;(iii) 约束门控LoRA模块以约束作为路由信号,仅激活少量专家,从而高效适配冻结的大模型。在大规模自动竞价基准上的实验表明,SAGE始终表现优异,且参数调整量不足全微调的10%。消融实验证实各组件对整体性能具有关键贡献。
原文摘要 · Abstract (English)
Advertising bidding has evolved from manual strategies to auto-bidding systems better adapted for large-scale, dynamic auction environments. While recent advances in Large Language Models (LLMs) offer strong reasoning for auto-bidding, existing methods suffer from shallow trajectory-text interactions and require costly fine-tuning, hindering the efficient use of pretrained knowledge under diverse constraints. To address these challenges, we propose SAGE, a novel Strategy-aware Auto-bidding framework Guided by LLMs for Efficient bidding. SAGE introduces a parameter-efficient multi-modal alignment framework for constrained auto-bidding with LLMs. Specifically, SAGE comprises three key components: (i) the position augmentation module adopts temporal-semantic positional embeddings to effectively capture the intrinsic dynamics and semantic structures; (ii) the text alignment module leverages gated cross-attention to align the embedding spaces of trajectory and text modalities, enabling effective multi-modal fusion while alleviating the computational overhead caused by long trajectories; (iii) the constraint-gated LoRA module employs constraints as routing signals, activating only a small subset of experts to adapt the behavior of a frozen LLM efficiently. Extensive experiments on large-scale auto-bidding benchmark demonstrate that SAGE consistently achieves superior performance while tuning less than 10% of the trainable parameters required by full fine-tuning. Ablation studies further validate the critical contribution of each component to the framework's overall performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。