通过用户实验，发现大模型辅助3D场景编辑的交互模式与障碍。
Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes
- 12名用户参与实验，结合使用数据与问卷分析交互行为。
- 发现自然语言接口在3D设计中存在理解偏差与操作延迟问题。
- 适合设计师和开发沉浸式内容系统的团队参考。
随着大型语言模型（LLMs）在沉浸式环境中的3D内容应用日益增多，研究用户行为以识别交互模式和潜在障碍，对指导未来集成LLM的沉浸式内容创作与编辑系统设计至关重要。我们通过对12名参与者开展实证用户研究，结合定量使用数据与事后问卷反馈，揭示了在LLM辅助的3D场景编辑系统中常见的交互模式与关键障碍。研究发现了改进3D设计工具中自然语言接口的机会，并提出了未来集成LLM的3D内容创作系统的设计建议。实证研究表明，LLM辅助的交互系统可在沉浸式环境中实现高效使用。
原文摘要 · Abstract (English)
As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive content creation and editing systems which involve LLMs. In an empirical user study with 12 participants, we combine quantitative usage data with post-experience questionnaire feedback to reveal common interaction patterns and key barriers in LLM-assisted 3D scene editing systems. We identify opportunities for improving natural language interfaces in 3D design tools and propose design recommendations for future LLM-integrated 3D content creation systems. Through an empirical study, we demonstrate that LLM-assisted interactive systems can be used productively in immersive environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。