轻量级AR追踪框架，6倍降低延迟，手机+PC协同实现低延迟交互。
UltraArUco: A Lightweight Multilingual Library And Framework With Low-Latency Real-Time Marker-Based Tracking System For Mobile AR Interaction
- 用优化多语言封装替代OpenCV，帧延迟降低6倍
- 支持手机端摄像头与电脑端应用通过Wi-Fi联动
- 适合资源受限移动AR场景，如无专用设备的音乐互动
UltraArUco是一个轻量级多语言库与框架，专为移动增强现实中的低延迟实时标记追踪设计。与标准OpenCV实现不同，其优化的多语言封装使每帧延迟降低六倍，同时保持高精度。采用分布式Wi-Fi架构，将移动设备（摄像头输入）与基于PC的视觉应用连接，实现响应式交互。通过交互式钢琴模拟验证：键盘上的静态ArUco标记实现遮挡式音符触发，手部佩戴标记则支持空间手势识别。该系统需求低，适用于资源受限的移动AR应用，无需特殊设备即可实现可行的AR音乐应用。
原文摘要 · Abstract (English)
UltraArUco is a lightweight multilingual library and framework for low latency, realtime marker-based tracking in mobile augmented reality. Unlike standard OpenCV-based implementations, UltraArUco introduces an optimized multilingual wrapper that reduces per-frame latency in six times, while maintaining high accuracy. Distributed Wi-Fi architecture provides portability, connects a mobile device (camera input) with a PC-based visual application, enabling responsive interactions. The framework is validated through an interactive piano simulation, where static ArUco markers on keys enable occlusion based note triggering, and hand-mounted markers provide spatial gesture recognition. UltraArUco's system requirements make it highly suitable for resource-constrained mobile AR applications, demonstrating a viable AR music application without specialized equipment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。