通过动态调整代理自主性,减轻个性化带来的隐私担忧。
Autonomy Reshapes How Personalization Affects Privacy Concerns and Trust in LLM Agents
- 设计风险触发式自主机制,代理在检测到隐私泄露时回退控制权。
- 用户感知控制力提升,隐私担忧和信任下降幅度减少30%以上。
- 适合关注人机信任与隐私平衡的AI系统设计师参考。
大语言模型代理需获取个人信息以实现个性化,从而更好地代表用户行动,但这也引发隐私担忧,抑制数据共享,限制了代理的自主水平及个性化效果。然而,代理自主性的扩展设计空间提供了重塑这些影响的机遇,目前仍缺乏探索。本研究开展一项3×3的被试间实验(N=450),探究代理自主性水平如何影响个性化对用户隐私担忧、信任及使用意愿的影响,以及其背后的心理机制。结果发现,风险触发式自主(即代理在检测到潜在隐私泄露时将控制权交还用户)可提升用户的感知控制力,进而缓解个性化的负面效应:隐私担忧上升更少,信任下降更轻微。研究建议,设计支持人类自主性(包括感知控制与监督有效性)的代理自主性,有助于用户在不被隐私担忧阻碍的前提下获益于个性化。这表明,在用户与代理之间对决策权进行对齐(自主性对齐)是实现可信人机交互的重要机遇与挑战。
原文摘要 · Abstract (English)
LLM agents require personal information for personalization in order to effectively act on users' behalf, but this raises privacy concerns that can discourage data sharing, limiting both the autonomy levels at which agents can operate and the effectiveness of personalization. Yet the expanded design space of agent autonomy also presents opportunities to shape these effects, which remain underexplored. We conducted a $3\times3$ between-subjects experiment ($N=450$) to study how agent autonomy level influences personalization's effects on users' privacy concerns, trust, and willingness to use, as well as the underlying psychological processes. We find that risk-contingent autonomy, where the agent delegates control back to users upon detecting potential privacy leakage, improves users' perceived control. This in turn attenuates personalization's adverse effects: privacy concerns rise less and trust declines less. Our results suggest that designing $\textbf{agent's autonomy}$ that supports $\textbf{human autonomy}$ (both perceived control and oversight effectiveness) helps users benefit from personalization without being deterred by growing privacy concerns. This positions aligning decision authority between users and agents ($\textbf{autonomy alignment}$) as an important opportunity and challenge for trustworthy human-agent interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。