让普通用户像做批注一样操作大模型内部文本,实现真正理解。
Interpretative Interfaces: Designing for AI-Mediated Reading Practices and the Knowledge Commons
- 设计可交互的界面,让用户追踪文本在模型中的语义变化轨迹。
- 支持非专家通过标注、标记等方式介入模型中间表示空间。
- 适合科研人员和知识工作者,提升对AI生成内容的批判性掌控力。
可解释人工智能(XAI)界面旨在提升大语言模型的透明度,但仅提供解释并不等于真正理解。理解系统行为与能够直接干预、探查其运作机制之间存在本质区别。尤其对依赖大模型进行文献阅读、引用和综述撰写的科学工作者而言,缺乏直接参与模型文本处理过程的手段。本设计研究提出从“可解释性”转向“可解读性”的范式转变:不再仅描述系统行为,而是让用户操控模型的中间表征。基于文本研究、计算诗学及阅读书写技术史,如批注、注释、索引等实践,本文构想“解读界面”——一种允许用户选择特定词元并追踪其在模型各层间语义演变的交互环境。用户可观察词义如何随上下文变化,并对有意义的转换进行标注。正如读者可通过批注构建自己的阅读地图,解读界面也使用户能留下对模型内部表征的理解印记。该研究目标是将人工智能可解释性重构为交互设计问题,推动支持解读参与和科学知识批判性管理的AI辅助阅读新路径。
原文摘要 · Abstract (English)
Explainable AI (XAI) interfaces seek to make large language models more transparent, yet explanation alone does not produce understanding. Explaining a system's behavior is not the same as being able to engage with it, to probe and interpret its operations through direct manipulation. This distinction matters for scientific disciplines in particular: scientists who increasingly rely on LLMs for reading, citing, and producing literature reviews have little means of directly engaging with how these models process and transform the texts they generate. In this ongoing design research project, I argue for a shift from explainability to interpretative engagement. This shift moves away from accounts of system behavior to instead enable users to manipulate a model's intermediate representations. Drawing on textual scholarship, computational poetics, and the history of reading and writing technologies, including practices such as marginalia, glosses, indices, and annotation systems, I propose interpretative interfaces as interactive environments in which non-expert users can intervene in the representational space of a language model. More specifically, such interfaces will allow users to select a token and follow its trajectory through the model's intermediate layers. This way, they can observe how its semantic position shifts as context is processed, and possibly annotate the transformations they find useful or meaningful. The same way readers can create their own maps within a book through annotations and bookmarks, interpretative interfaces will allow users to inscribe their reading of a model's internal representations. The goal of this project is to reframe AI interpretability as an interaction design project rather than a purely technical one, and to open a path toward AI-mediated reading that supports interpretative engagement and critical stewardship of scientific knowledge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。