arXiv:2412.01753cs.RO2024-12被引 9

从狭隘视野到自然语言,升级水下遥控人机交互体验

Human-Machine Interfaces for Subsea Telerobotics: From Soda-straw to Natural Language Interactions

  • 用虚拟现实与自然语言提升操作沉浸感与直观性
  • 现有系统仍受限于反馈真实度、控制直觉性与平台不统一
  • 适合海洋工程、机器人与人机交互研究者参考

本文综述水下遥控机器人中人机接口(HMIs)的演进,从传统第一视角‘吸管式’控制台(视野狭窄的摄像画面)发展到融合手势识别、虚拟现实和自然语言处理的现代界面。通过操作员体验(包括沉浸反馈、认知负荷与人体工学设计)、机器人自主性(情境理解与任务执行)及人机双向通信质量三个维度,系统分析前沿文献。重点指出当前系统在沉浸反馈保真度、直观控制机制和跨平台标准化方面的持续缺陷。同时评估模拟器与数字孪生在操作员训练与系统原型开发中的可扩展作用。研究拓展至共享自主框架,推动人机无缝协作。综合机器人学、海洋工程、人工智能与人因学的洞见,全面梳理当前格局与新兴趋势,并提出关键挑战与未来路线图,旨在推进智能、以用户为中心的水下人机交互技术发展。

原文摘要 · Abstract (English)

This review explores the evolution of human-machine interfaces (HMIs) in subsea telerobotics, charting the progression from traditional first-person "soda-straw" consoles -- characterized by narrow field-of-view camera feeds -- to contemporary interfaces leveraging gesture recognition, virtual reality, and natural language processing. We systematically analyze the state-of-the-art literature through three interrelated perspectives: operator experience (including immersive feedback, cognitive workload, and ergonomic design), robotic autonomy (contextual understanding and task execution), and the quality of bidirectional communication between human and machine. Emphasis is placed on interface features to highlight persistent limitations in current systems, notably in immersive feedback fidelity, intuitive control mechanisms, and the lack of cross-platform standardization. Additionally, we assess the role of simulators and digital twins as scalable tools for operator training and system prototyping. The review extends beyond classical teleoperation paradigms to examine modern shared autonomy frameworks that facilitate seamless human-robot collaboration. By synthesizing insights from robotics, marine engineering, artificial intelligence, and human factors -- this work provides a comprehensive overview of the current landscape and emerging trajectories in subsea HMI development. Finally, we identify key challenges and open research questions and outline a forward-looking roadmap for advancing intelligent and user-centric HMI technologies in subsea telerobotics.

人机交互水下机器人虚拟现实自然语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。