用XR和AI让参观者在美术馆里自由对话、专注欣赏,提升沉浸感。
WhiteTesseract: Reframing the Interpretation of Cultural Heritage through XR and Conversational AI

- 通过艺术识别实现空间智能,动态减少干扰,支持个性化对话。
- 平均观展时长从35.3秒提升至98.3秒,显著延长用户停留。
- 60%互动超越事实问答,包含分析、情感与比较,适合深度体验者。
文化遗产展览常难以维持观众注意力并促进反思性参与。实体展览依赖固定解说,无法适配个体背景或好奇心,其效果高度依赖参观者的个人背景、先验知识和文化素养。而数字展览虽便捷,却可能削弱具身化文化体验所依赖的物理与社会情境。WhiteTesseract通过高分辨率XR与对话式AI,在现场实现动态阐释:基于作品识别的空间智能,使游客可选择性降低环境干扰(通过减弱现实),并借助大语言模型展开情境感知对话。目标是在保留物理与社交环境丰富性的同时,提供灵活的个人反思空间,增强个人背景理解而不牺牲物理真实性。我们在克劳德·莫奈展览中部署该系统,并对26名参与者开展控制实验。定量结果显示,WhiteTesseract调节使平均观展时长从35.3秒增至98.3秒(p < 0.001)。对529次访客-AI互动分析表明,60%的对话超出事实性提问,涵盖分析、情感与比较性问题。研究证明,XR与AI能通过支持更深层次、个性化的参与,丰富实体展览体验,同时不取代文化遗产的具身体验价值。我们讨论了实际部署中的技术与社会限制,以及受控设置的局限性。
原文摘要 · Abstract (English)
Cultural heritage exhibitions often struggle to sustain attention and support reflective engagement. Physical exhibitions rely on fixed interpretive aids that lack adaptability to individual backgrounds or curiosity, and their effectiveness depends heavily on a visitor's Personal Context, prior knowledge, and cultural literacy. Meanwhile, digital exhibitions prioritize convenience and accessibility but risk weakening the Physical and Social Contexts that define embodied cultural experience. WhiteTesseract addresses this gap by enabling in-situ interpretation through high-resolution XR and conversational AI. The system integrates spatial intelligence via artwork recognition to allow visitors to selectively reduce environmental distractions (via diminished reality) and engage in context-aware dialogue (via large language models). The goal is to preserve the richness of the physical and social environment while providing a flexible space for personal reflection, enhancing Personal Context without compromising physical authenticity. We deployed the system in a Claude Monet exhibition and conducted a controlled user study with 26 participants. Quantitative results showed that WhiteTesseract modulation significantly increased average viewing duration from 35.3 to 98.3 seconds (p < 0.001). Analysis of 529 visitor-AI interactions revealed that 60% extended beyond factual queries to include analytical, emotional, and comparative inquiries. These findings demonstrate how XR and AI can enrich the physical exhibition experience by supporting deeper, more personalized engagement without displacing the embodied value of cultural heritage. We discuss technical and social constraints for real-world deployment and limitations of our controlled setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。