arXiv:2507.17131cs.LGcs.AI2025-07EMNLP被引 16

让AI在运行中持续学习新知识,提升动态环境下的准确率。

Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidance

  • 通过自我对话识别知识盲区,主动向人类求解。
  • 实时更新带时间戳的知识库,自动处理冲突信息。
  • 已在抖音支付上线,服务超1.5亿月活用户。

大型语言模型(LLM)代理在规则和领域知识频繁变化的环境中表现不佳,如合规审查与用户风险筛查。现有方法如离线微调和标准提示无法在实际运行中有效适应新知识。为此,我们提出自适应反射交互代理(ARIA),一种专为测试时持续学习设计的LLM代理框架。ARIA通过结构化自我对话评估自身不确定性,主动识别知识缺口并请求人类专家提供针对性解释或修正。随后,系统性地将人类反馈更新至内部带时间戳的知识库中,通过对比与澄清查询检测并解决冲突或过时信息。我们在TikTok Pay的真实客户尽职调查名称筛查任务及公开的动态知识任务上进行评估,结果表明,相较于使用标准离线微调和现有自改进代理的基线模型,ARIA在适应性和准确性方面均有显著提升。ARIA已部署于TikTok Pay,服务超过1.5亿月活跃用户,验证了其在快速演变环境中的实用性与有效性。

原文摘要 · Abstract (English)

Large language model (LLM) agents often struggle in environments where rules and required domain knowledge frequently change, such as regulatory compliance and user risk screening. Current approaches, like offline fine-tuning and standard prompting, are insufficient because they cannot effectively adapt to new knowledge during actual operation. To address this limitation, we propose the Adaptive Reflective Interactive Agent (ARIA), an LLM agent framework designed specifically to continuously learn updated domain knowledge at test time. ARIA assesses its own uncertainty through structured self-dialogue, proactively identifying knowledge gaps and requesting targeted explanations or corrections from human experts. It then systematically updates an internal, timestamped knowledge repository with provided human guidance, detecting and resolving conflicting or outdated knowledge through comparisons and clarification queries. We evaluate ARIA on the realistic customer due diligence name screening task on TikTok Pay, alongside publicly available dynamic knowledge tasks. Results demonstrate significant improvements in adaptability and accuracy compared to baselines using standard offline fine-tuning and existing self-improving agents. ARIA is deployed within TikTok Pay serving over 150 million monthly active users, confirming its practicality and effectiveness for operational use in rapidly evolving environments.

自改进LLM代理在线学习知识管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。