无人机可自适应投影，实现与人实时互动的空中界面。
OmniAI: A Surface-Adaptive Aerial Projection Interface for Human--Drone Interaction
- 通过激光投影在表面切换，动态适配环境
- 支持语音与手势控制，实现飞行与内容双操作
- 无需预设地图，实时检测平面并投影
在人类环境中，无人机常缺乏空间定位的交互接口。本文提出OmniAI，一种具身化的空中智能体，可通过机载屏幕与周边环境表面间切换投影，实现表面自适应交互。系统采用伺服驱动的MEMS激光投影仪，基于网页增强的大型语言模型生成文本与图像响应。利用RGB-D感知与RANSAC平面拟合技术在线检测投影表面，无需预先建图。OmniAI支持与语音和手势功能等效的控制，可同时操控无人机运动与投影内容。结合语音、空中手势、自适应投影与空中移动能力，该系统展示了面向情境感知的人机协同空中增强现实交互界面。
原文摘要 · Abstract (English)
Drones in human environments often lack spatially grounded in- terfaces for situated communication. We present OmniAI, an em- bodied aerial agent that supports surface-adaptive interaction by switching projection between an onboard screen and nearby en- vironmental surfaces. A servo-actuated MEMS laser projector renders text-and-image responses from a web-augmented LLM pipeline. Projection surfaces are detected online using RGB-D sensing and RANSAC plane fitting, without pre-mapped geometry. OmniAI provides functionally equivalent voice and gesture con- trol for both drone motion and projected content. By combining speech, mid-air gestures, adaptive projection, and aerial mobility, OmniAI demonstrates a mobile spatial AR interface for context- aware human-drone interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。