研究AI何时该问问题,平衡效率与公平性。
When to Ask a Question: Understanding Communication Strategies in Generative AI Tools

- 基于用户偏好相关性,优化提问时机以减少偏见。
- 理论证明合理提问可降低主流偏好垄断风险。
- 适合关注AI公平性与交互设计的研究者阅读。
生成式AI允许用户自由选择输入信息量,但常因忽略细节导致模型依赖分布性知识推断,从而偏向主流偏好,损害少数群体。与传统推荐系统不同,大语言模型可通过自然语言主动询问用户偏好。然而频繁提问会增加用户负担。本文构建用户-大模型交互的简化模型,提出权衡用户负担与偏好表达的优化目标。利用偏好间相关性分析,确定内容生成前应获取的最佳信息量。结果表明,适度提问可缓解偏好推断的系统性偏差,使生成工具更包容多样观点,同时保持效率。理论分析结合实证评估验证了模型预测,并探讨其实际应用意义。
原文摘要 · Abstract (English)
Generative AI models differ from traditional machine learning tools in that they allow users to provide as much or as little information as they choose in their inputs. This flexibility often leads users to omit certain details, relying on the models to infer and fill in under-specified information based on distributional knowledge of user preferences. Such inferences may privilege majority viewpoints and disadvantage users with atypical preferences, raising concerns about fairness. Unlike more traditional recommender systems, LLMs can explicitly solicit more information from users through natural language. However, while directly eliciting user preferences could increase personalization and mitigate inequality, excessive querying places a burden on users who value efficiency. We develop a stylized model of user-LLM interaction and develop an objective that captures tradeoff between user burden and preference representation. Building on the observation that individual preferences are often correlated, we analyze how AI systems should balance inference and elicitation, characterizing the optimal amount of information to solicit before content generation. Ultimately, we show that information elicitation can mitigate the systematic biases of preference inference, enabling the design of generative tools that better incorporate diverse user perspectives while maintaining efficiency. We complement this theoretical analysis with an empirical evaluation illustrating the model's predictions and exploring their practical implications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。