XR Blocks让AI与扩展现实应用快速落地。
XR Blocks: Accelerating Human-centered AI + XR Innovation
- 模块化框架，支持用户、世界、交互等核心组件即插即用
- 基于WebXR等技术，降低开发门槛，加速原型制作
- 适合想快速验证AI+XR创意的开发者和研究者
人工智能（AI）与扩展现实（XR）正融合催生新型交互计算范式。然而，两大领域生态存在显著断层：尽管AI有JAX、LMArena等成熟工具链，但构建AI驱动的XR交互仍需手动集成感知、渲染、交互等低级系统，过程繁琐。为此，我们提出XR Blocks——一个跨平台框架，旨在加速以人为本的AI+XR创新。该框架采用模块化设计，提供用户、世界、同伴；界面、上下文、代理等核心抽象的即插即用组件，核心目标是‘从想法到现实’的降阻。基于WebXR、three.js、TensorFlow、Gemini等开源技术，该工具包降低了XR创作门槛。我们通过一系列开源模板、示例和高级演示展示其效能，助力社区快速实现从概念到可交互原型的转化。官网：https://xrblocks.github.io
原文摘要 · Abstract (English)
We are on the cusp where Artificial Intelligence (AI) and Extended Reality (XR) are converging to unlock new paradigms of interactive computing. However, a significant gap exists between the ecosystems of these two fields: while AI research and development is accelerated by mature frameworks like JAX and benchmarks like LMArena, prototyping novel AI-driven XR interactions remains a high-friction process, often requiring practitioners to manually integrate disparate, low-level systems for perception, rendering, and interaction. To bridge this gap, we present XR Blocks, a cross-platform framework designed to accelerate human-centered AI + XR innovation. XR Blocks strives to provide a modular architecture with plug-and-play components for core abstraction in AI + XR: user, world, peers; interface, context, and agents. Crucially, it is designed with the mission of "reducing frictions from idea to reality", thus accelerating rapid prototyping of AI + XR apps. Built upon accessible technologies (WebXR, three.js, TensorFlow, Gemini), our toolkit lowers the barrier to entry for XR creators. We demonstrate its utility through a set of open-source templates, samples, and advanced demos, empowering the community to quickly move from concept to interactive XR prototype. Site: https://xrblocks.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。