arXiv:2511.03186cs.AI2025-11中稿 · 6th Workshop on Da…

Adobe为大会打造的AI助手,靠人工反馈快速上线并稳定运行。

Adobe Summit Concierge Evaluation with Human in the Loop

  • 结合提示工程与人工校验,实现冷启动下的快速迭代。
  • 在数据稀疏环境下仍保持可靠响应,支持多类活动查询。
  • 适合需要快速落地、依赖真实用户反馈的AI应用开发团队。

生成式AI助手在企业环境中具有提升效率、简化信息获取和优化用户体验的巨大潜力。本文介绍为Adobe Summit开发的领域专用AI助手Summit Concierge。该助手可处理多种会议相关问题,同时应对数据稀疏、质量保障和快速部署等现实挑战。为此,我们采用人机协同开发流程,融合提示工程、检索增强和轻量级人工验证。文中详细描述了系统架构、开发流程及实际部署效果。经验表明,敏捷、反馈驱动的开发模式即使在冷启动场景下,也能实现可扩展且可靠的AI助手。

原文摘要 · Abstract (English)

Generative AI assistants offer significant potential to enhance productivity, streamline information access, and improve user experience in enterprise contexts. In this work, we present Summit Concierge, a domain-specific AI assistant developed for Adobe Summit. The assistant handles a wide range of event-related queries and operates under real-world constraints such as data sparsity, quality assurance, and rapid deployment. To address these challenges, we adopt a human-in-the-loop development workflow that combines prompt engineering, retrieval grounding, and lightweight human validation. We describe the system architecture, development process, and real-world deployment outcomes. Our experience shows that agile, feedback-driven development enables scalable and reliable AI assistants, even in cold-start scenarios.

AI助手人机协同冷启动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。