arXiv:2512.21578cs.AI2025-12被引 1

用微调小模型提升支付平台智能代理的检索效率,降低延迟与成本。

NEMO-4-PAYPAL: Leveraging NVIDIA's Nemo Framework for empowering PayPal's Commerce Agent

  • 用LoRA微调Nemotron小模型替代原基模型,优化检索性能。
  • 使检索环节响应时间减少超50%,系统延迟与成本显著下降。
  • 适合电商场景中追求低延迟、高性价比的智能代理开发者。

我们介绍了 PayPal 商业代理系统的开发与优化,基于 NEMO-4-PAYPAL 多智能体系统,旨在革新 PayPal 平台上的智能代理商业应用。通过与 NVIDIA 的合作,我们利用 NeMo 框架对大语言模型进行微调,以提升代理性能。具体而言,我们通过替换基础模型,采用基于 LoRA 的微调策略,对搜索与发现代理进行了优化,实验使用 llama3.1-nemotron-nano-8B-v1 架构,在学习率、优化器(Adam、AdamW)、余弦退火调度和 LoRA 秩等参数上进行系统性超参数搜索。我们的贡献包括:首次将 NVIDIA NeMo 框架应用于电商专用代理优化;提出面向检索任务的 LLM 微调策略;验证了在保持或提升代理质量的同时,显著降低延迟与成本;构建了可扩展的生产级多智能体系统优化框架。结果表明,微调后的 Nemotron SLM 有效解决了检索组件占总响应时间超过 50% 的关键性能瓶颈,同时维持甚至提升了整体系统表现。

原文摘要 · Abstract (English)

We present the development and optimization of PayPal's Commerce Agent, powered by NEMO-4-PAYPAL, a multi-agent system designed to revolutionize agentic commerce on the PayPal platform. Through our strategic partnership with NVIDIA, we leveraged the NeMo Framework for LLM model fine-tuning to enhance agent performance. Specifically, we optimized the Search and Discovery agent by replacing our base model with a fine-tuned Nemotron small language model (SLM). We conducted comprehensive experiments using the llama3.1-nemotron-nano-8B-v1 architecture, training LoRA-based models through systematic hyperparameter sweeps across learning rates, optimizers (Adam, AdamW), cosine annealing schedules, and LoRA ranks. Our contributions include: (1) the first application of NVIDIA's NeMo Framework to commerce-specific agent optimization, (2) LLM powered fine-tuning strategy for retrieval-focused commerce tasks, (3) demonstration of significant improvements in latency and cost while maintaining agent quality, and (4) a scalable framework for multi-agent system optimization in production e-commerce environments. Our results demonstrate that the fine-tuned Nemotron SLM effectively resolves the key performance issue in the retrieval component, which represents over 50\% of total agent response time, while maintaining or enhancing overall system performance.

智能代理微调电商低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。