arXiv:2410.12361cs.AIcs.CL2024-10ICLR被引 96

让大模型主动帮忙,不再等指令。

Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance

  • 用真实人类行为数据训练模型预测何时该主动做事。
  • 在6790个事件上训练后,主动协助准确率达66.47%。
  • 适合想提升智能体主动性的人工智能研究者。

由大语言模型驱动的智能体在解决复杂任务方面表现出色,但多数系统仍处于被动响应状态,限制了其在需要前瞻性和自主决策场景中的表现。本文提出一种全新的数据驱动方法,旨在构建能够预见并主动发起任务的智能体。首先,通过收集真实世界的人类活动数据,生成主动任务预测,并由人工标注为接受或拒绝。这些标注数据用于训练一个模拟人类判断的奖励模型,作为评估大模型智能体主动性水平的自动化工具。在此基础上,我们构建了一个完整的数据生成流程,创建了包含6,790个事件的多样化数据集ProactiveBench。实验表明,使用ProactiveBench微调模型可显著激发大模型的主动性。结果表明,微调后的模型在主动提供帮助任务上的F1分数达到66.47%,优于所有开源与闭源模型。该方法展现了在打造更主动、高效的智能体系统方面的潜力,为未来人机协作的发展铺平道路。

原文摘要 · Abstract (English)

Agents powered by large language models have shown remarkable abilities in solving complex tasks. However, most agent systems remain reactive, limiting their effectiveness in scenarios requiring foresight and autonomous decision-making. In this paper, we tackle the challenge of developing proactive agents capable of anticipating and initiating tasks without explicit human instructions. We propose a novel data-driven approach for this problem. Firstly, we collect real-world human activities to generate proactive task predictions. These predictions are then labeled by human annotators as either accepted or rejected. The labeled data is used to train a reward model that simulates human judgment and serves as an automatic evaluator of the proactiveness of LLM agents. Building on this, we develop a comprehensive data generation pipeline to create a diverse dataset, ProactiveBench, containing 6,790 events. Finally, we demonstrate that fine-tuning models with the proposed ProactiveBench can significantly elicit the proactiveness of LLM agents. Experimental results show that our fine-tuned model achieves an F1-Score of 66.47% in proactively offering assistance, outperforming all open-source and close-source models. These results highlight the potential of our method in creating more proactive and effective agent systems, paving the way for future advancements in human-agent collaboration.

智能体主动性大模型数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。