用强化学习让AI助手自动处理日程冲突,越用越懂用户偏好。
PEARL: Self-Evolving Assistant for Time Management with Reinforcement Learning
- 给语言模型加外部记忆库,动态存储用户时间偏好。
- 通过逐轮奖励优化决策准确率,错误率降低55%。
- 适合需要长期自适应日程管理的职场人士使用。
重叠的日程邀请迫使忙碌的专业人士反复决定参加、改期或拒绝会议,这一以用户偏好为导向的决策过程称为日程冲突解决。自动化该过程至关重要但极具挑战性:调度琐事耗时数小时,人工委托又难以规模化。这引发一个问题:能否信任大语言模型(LLMs)或语言代理来管理时间?为系统研究此问题,我们提出 CalConflictBench,一个面向长周期日程冲突解决的基准测试。在该基准中,冲突按轮次逐年呈现,要求代理逐步推断并适应用户偏好。实验显示,当前语言代理表现不佳,例如 Qwen-3-30B-Think 的平均错误率达 35%。为此,我们提出 PEARL,一种强化学习框架,(i) 为语言代理添加外部偏好记忆,用于存储和更新推断出的策略(如参会人优先级、议题重要性、时间/地点偏好),(ii) 使用逐轮奖励直接监督决策正确性、排序质量及记忆使用效率。在 CalConflictBench 上的实验表明,PEARL 实现了 0.76 的错误率降低率,相比最强基线平均错误率下降 55%。
原文摘要 · Abstract (English)
Overlapping calendar invitations force busy professionals to repeatedly decide which meetings to attend, reschedule, or decline. We refer to this preference-driven decision process as calendar conflict resolution. Automating this decision process is crucial yet challenging. Scheduling logistics can drain hours, and human delegation often fails at scale, which motivates us to ask: Can we trust large language models (LLMs) or language agents to manage time? To enable a systematic study of this question, we introduce CalConflictBench, a benchmark for long-horizon calendar conflict resolution. In CalConflictBench, conflicts are presented to agents round-by-round over a calendar year, requiring them to infer and adapt to user preferences progressively. Our experiments show that current LLM agents perform poorly with high error rates, e.g., Qwen-3-30B-Think has an average error rate of 35%. To address this gap, we propose PEARL, a reinforcement-learning framework that (i) augments the language agent with an external preference memory that stores and updates inferred strategies (e.g., attendee priorities, topic importance, time/location preferences), and (ii) optimizes the agent with round-wise rewards that directly supervise decision correctness, ranking quality, and memory usage across rounds. Experiments on CalConflictBench show that PEARL achieves an error reduction rate of 0.76 and a 55% improvement in average error rate compared to the strongest baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。