arXiv:2504.01205cs.HCcs.AI2025-04被引 26

提出知识传递框架,让大模型更准确回应用户对信息可信度的要求。

Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Delivery

  • 基于认识论构建十类知识传递挑战,建立用户与模型间的沟通桥梁。
  • 分析OpenAI与Anthropic发现:系统缺乏明确表达和验证用户知识偏好机制。
  • 适合关注AI信息可信度、个性化知识服务的研究者与开发者。

大语言模型日益成为知识获取工具,但用户难以有效表达信息呈现方式偏好。当要求模型‘引用可靠来源’‘体现适当不确定性’或‘涵盖多视角’时,现有界面无法结构化支持这些需求,导致用户依赖社区间复制粘贴的提示语(prompt sharing folklore)。本文提出认知对齐框架(Epistemic Alignment Framework),源自认识论文献的十类知识传递挑战,涵盖证据质量评估与证言依赖校准等问题。该框架作为用户需求与系统能力间的中介,提供共同语言以弥合期望与实现之间的差距。通过对在线社区中自定义提示与个性化策略的主题分析,发现用户已发展出复杂应对方案。进一步通过内容分析评估OpenAI与Anthropic的政策与功能,发现两者虽部分解决挑战,但缺乏指定认知偏好的机制,透明度不足,且无验证工具确认偏好是否被遵循。该框架为开发者提供支持多样化知识交付路径的具体指引,助用户获得符合其特定需求的信息,而非默认通用输出。

原文摘要 · Abstract (English)

LLMs increasingly serve as tools for knowledge acquisition, yet users cannot effectively specify how they want information presented. When users request that LLMs "cite reputable sources," "express appropriate uncertainty," or "include multiple perspectives," they discover that current interfaces provide no structured way to articulate these preferences. The result is prompt sharing folklore: community-specific copied prompts passed through trust relationships rather than based on measured efficacy. We propose the Epistemic Alignment Framework, a set of ten challenges in knowledge transmission derived from the philosophical literature of epistemology, concerning issues such as evidence quality assessment and calibration of testimonial reliance. The framework serves as a structured intermediary between user needs and system capabilities, creating a common vocabulary to bridge the gap between what users want and what systems deliver. Through a thematic analysis of custom prompts and personalization strategies shared on online communities where these issues are actively discussed, we find users develop elaborate workarounds to address each of the challenges. We then apply our framework to two prominent model providers, OpenAI and Anthropic, through content analysis of their documented policies and product features. Our analysis shows that while these providers have partially addressed the challenges we identified, they fail to establish adequate mechanisms for specifying epistemic preferences, lack transparency about how preferences are implemented, and offer no verification tools to confirm whether preferences were followed. For AI developers, the Epistemic Alignment Framework offers concrete guidance for supporting diverse approaches to knowledge; for users, it works toward information delivery that aligns with their specific needs rather than defaulting to one-size-fits-all approaches.

认知对齐知识传递LLM交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。