让虚拟世界理解用户身份与认知变化，实现更智能的沉浸体验。
Perspective-Aware AI in Extended Reality
- 用多模态数字足迹构建可推理的用户身份模型
- 闭环系统实时关联用户状态与虚拟环境
- 适合研究人机交互与个性化沉浸体验的学者
AI增强的扩展现实（XR）旨在提供自适应、沉浸式体验，但现有系统因用户建模浅显、认知上下文有限而表现不足。我们提出透视感知人工智能在扩展现实中的框架（PAiR），将透视感知人工智能（PAi）与XR结合，实现基于用户身份的可解释、上下文感知体验。PAi基于Chronicles：从多模态数字足迹中学习的可推理身份模型，捕捉用户的认知与体验演化。PAiR通过闭环系统将动态用户状态与沉浸式环境联动。我们展示了PAiR的架构，包括其模块与系统流程，并在基于Unity的OpenDome引擎中实现了两个概念验证场景。PAiR为人类-人工智能交互开辟了新方向，将基于视角的身份模型嵌入沉浸式系统。
原文摘要 · Abstract (English)
AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences-yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a foundational framework for integrating Perspective-Aware AI (PAi) with XR to enable interpretable, context-aware experiences grounded in user identity. PAi is built on Chronicles: reasoning-ready identity models learned from multimodal digital footprints that capture users' cognitive and experiential evolution. PAiR employs these models in a closed-loop system linking dynamic user states with immersive environments. We present PAiR's architecture, detailing its modules and system flow, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based OpenDome engine. PAiR opens a new direction for human-AI interaction by embedding perspective-based identity models into immersive systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。